System Info

Docker run is failing on Apple M2 chip laptop. Here is the command I fired and the exception:

docker run --shm-size 1g -p 8080:80 -v . ghcr.io/huggingface/text-generation-inference:1.0.3 --model-id EleutherAI/pythia-1b --disable-custom-kernels Unable to find image 'ghcr.io/huggingface/text-generation-inference:1.0.3' locally 1.0.3: Pulling from huggingface/text-generation-inference docker: no matching manifest for linux/arm64/v8 in the manifest list entries. See 'docker run --help'. 

Also I am looking to run custom fine tuned model saved in my local machine. Could someone please help?

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

Just running the above command in the Apple M2 chip laptop.

Expected behavior

text-generation-inference up and running in my local setup