aisquared
/

dlite-v1-124m

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jacobrenn commited on Apr 6, 2023

Commit

e1801e1

•

1 Parent(s): 1c0d84d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -55,7 +55,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 model_id = 'aisquared/dlite-v1-124m'
 tokenizer = AutoTokenizer.from_pretrained(model_id, padding_side = 'left')
-model = AutoModelForCausalLM.from_pretrained(model_id)
 ```

 model_id = 'aisquared/dlite-v1-124m'
 tokenizer = AutoTokenizer.from_pretrained(model_id, padding_side = 'left')
+model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code = True, device_map = 'auto')
 ```