1TuanPham
/

T-VisStar-7B-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

1TuanPham commited on Oct 2

Commit

b25423b

•

1 Parent(s): de2cd13

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -282,7 +282,7 @@ while True:
     # Generate a response
     outputs = model.generate(
         input_ids=tokenized_chat.to('cuda'),
-        max_new_tokens=2048,
         do_sample=True,
         top_p=0.4,
         min_p=0.025,

     # Generate a response
     outputs = model.generate(
         input_ids=tokenized_chat.to('cuda'),
+        max_new_tokens=2048, # Can be up to 8192
         do_sample=True,
         top_p=0.4,
         min_p=0.025,