jondurbin
/

bagel-dpo-20b-v04-llama

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jondurbin commited on Feb 13

Commit

95b186d

•

1 Parent(s): b6d9024

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -774,7 +774,7 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
 4) Deploy the VM!
 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
 6) Once inside the VM, open the terminal and run `volume=$PWD/data`
-7) Run `model=jondurbin/bagel-dpo-20b-v04`
 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
 9) The model will take some time to load...
 10) Once loaded the model will be available on port 8080

 4) Deploy the VM!
 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
 6) Once inside the VM, open the terminal and run `volume=$PWD/data`
+7) Run `model=jondurbin/bagel-dpo-20b-v04-llama`
 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
 9) The model will take some time to load...
 10) Once loaded the model will be available on port 8080