jondurbin
/

bagel-8b-v1.0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jondurbin commited on Apr 24

Commit

a8f289b

•

1 Parent(s): 6b31b01

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -727,7 +727,7 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
 4) Deploy the VM!
 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
 6) Once inside the VM, open the terminal and run `volume=$PWD/data`
-7) Run `model=jondurbin/bagel-7b-v0.5`
 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
 9) The model will take some time to load...
 10) Once loaded the model will be available on port 8080

 4) Deploy the VM!
 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
 6) Once inside the VM, open the terminal and run `volume=$PWD/data`
+7) Run `model=jondurbin/bagel-8b-v1.0`
 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
 9) The model will take some time to load...
 10) Once loaded the model will be available on port 8080