yuan-tian
/

chartgpt-llama3

Text2Text Generation

text-generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

yuan-tian commited on Oct 15

Commit

bd6ed33

•

1 Parent(s): ebbe24d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -115,7 +115,7 @@ Previous Answer:
 ### Response:"""
 inputs = tokenizer(input_text, return_tensors="pt", padding=True).to("cuda")
-outputs = model.generate(**inputs)
 print(tokenizer.decode(outputs[0], skip_special_tokens = True))
 ```

 ### Response:"""
 inputs = tokenizer(input_text, return_tensors="pt", padding=True).to("cuda")
+outputs = model.generate(**inputs, max_new_tokens=256)
 print(tokenizer.decode(outputs[0], skip_special_tokens = True))
 ```