Update README.md
Browse files
README.md
CHANGED
@@ -759,19 +759,25 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
|
|
759 |
|
760 |
## Renting instances to run the model
|
761 |
|
762 |
-
###
|
763 |
|
764 |
[Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
|
765 |
|
766 |
-
1) For this model
|
767 |
-
2) After you
|
768 |
-
3)
|
769 |
-
|
770 |
-
|
771 |
-
|
772 |
-
|
773 |
-
|
774 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
775 |
|
776 |
Sample command within the VM
|
777 |
```
|
@@ -813,8 +819,6 @@ Access the webui via `http://{container IP address}:7860`, navigate to model, do
|
|
813 |
|
814 |
## Support me
|
815 |
|
816 |
-
https://bmc.link/jondurbin
|
817 |
-
|
818 |
-
|
819 |
-
|
820 |
-
BTC bc1qdwuth4vlg8x37ggntlxu5cjfwgmdy5zaa7pswf
|
|
|
759 |
|
760 |
## Renting instances to run the model
|
761 |
|
762 |
+
### Massed Compute Virtual Machine
|
763 |
|
764 |
[Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
|
765 |
|
766 |
+
1) For this model, [create an account](https://bit.ly/jon-durbin) in Massed Compute. When renting a Virtual Machine use the code 'JonDurbin' for 50% your rental.
|
767 |
+
2) After you created your account update your billing and navigate to the deploy page.
|
768 |
+
3) Select the following
|
769 |
+
- GPU Type: A6000
|
770 |
+
- GPU Quantity: 1
|
771 |
+
- Category: Creator
|
772 |
+
- Image: Jon Durbin
|
773 |
+
- Coupon Code: JonDurbin
|
774 |
+
4) Deploy the VM!
|
775 |
+
5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
|
776 |
+
6) Once inside the VM, open the terminal and run `volume=$PWD/data`
|
777 |
+
7) Run `model=jondurbin/bagel-dpo-20b-v04`
|
778 |
+
8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
|
779 |
+
9) The model will take some time to load...
|
780 |
+
10) Once loaded the model will be available on port 8080
|
781 |
|
782 |
Sample command within the VM
|
783 |
```
|
|
|
819 |
|
820 |
## Support me
|
821 |
|
822 |
+
- https://bmc.link/jondurbin
|
823 |
+
- ETH 0xce914eAFC2fe52FdceE59565Dd92c06f776fcb11
|
824 |
+
- BTC bc1qdwuth4vlg8x37ggntlxu5cjfwgmdy5zaa7pswf
|
|
|
|