jondurbin commited on
Commit
b6d9024
1 Parent(s): a79be08

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -15
README.md CHANGED
@@ -759,19 +759,25 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
759
 
760
  ## Renting instances to run the model
761
 
762
- ### MassedCompute
763
 
764
  [Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
765
 
766
- 1) For this model rent the [Jon Durbin 2xA6000](https://shop.massedcompute.com/products/jon-durbin-2x-a6000?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) Virtual Machine use the code 'JonDurbin' for 50% your rental
767
- 2) After you start your rental you will receive an email with instructions on how to Login to the VM
768
- 3) Once inside the VM, open the terminal and run `conda activate text-generation-inference`
769
- 4) Then `cd Desktop/text-generation-inference/`
770
- 5) Run `volume=$PWD/data`
771
- 6) Run `model=jondurbin/bagel-dpo-20b-v04-llama`
772
- 7) `sudo docker run --gpus '"device=0,1"' --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
773
- 8) The model will take some time to load...
774
- 9) Once loaded the model will be available on port 8080
 
 
 
 
 
 
775
 
776
  Sample command within the VM
777
  ```
@@ -813,8 +819,6 @@ Access the webui via `http://{container IP address}:7860`, navigate to model, do
813
 
814
  ## Support me
815
 
816
- https://bmc.link/jondurbin
817
-
818
- ETH 0xce914eAFC2fe52FdceE59565Dd92c06f776fcb11
819
-
820
- BTC bc1qdwuth4vlg8x37ggntlxu5cjfwgmdy5zaa7pswf
 
759
 
760
  ## Renting instances to run the model
761
 
762
+ ### Massed Compute Virtual Machine
763
 
764
  [Massed Compute](https://massedcompute.com/?utm_source=huggingface&utm_creative_format=model_card&utm_content=creator_jon) has created a Virtual Machine (VM) pre-loaded with TGI and Text Generation WebUI.
765
 
766
+ 1) For this model, [create an account](https://bit.ly/jon-durbin) in Massed Compute. When renting a Virtual Machine use the code 'JonDurbin' for 50% your rental.
767
+ 2) After you created your account update your billing and navigate to the deploy page.
768
+ 3) Select the following
769
+ - GPU Type: A6000
770
+ - GPU Quantity: 1
771
+ - Category: Creator
772
+ - Image: Jon Durbin
773
+ - Coupon Code: JonDurbin
774
+ 4) Deploy the VM!
775
+ 5) Navigate to 'Running Instances' to retrieve instructions to login to the VM
776
+ 6) Once inside the VM, open the terminal and run `volume=$PWD/data`
777
+ 7) Run `model=jondurbin/bagel-dpo-20b-v04`
778
+ 8) `sudo docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.3 --model-id $model`
779
+ 9) The model will take some time to load...
780
+ 10) Once loaded the model will be available on port 8080
781
 
782
  Sample command within the VM
783
  ```
 
819
 
820
  ## Support me
821
 
822
+ - https://bmc.link/jondurbin
823
+ - ETH 0xce914eAFC2fe52FdceE59565Dd92c06f776fcb11
824
+ - BTC bc1qdwuth4vlg8x37ggntlxu5cjfwgmdy5zaa7pswf