shanchen
/

llama3-8B-slerp-biomed-chat-chinese

Text Generation

shanchen/llama3-8B-slerp-med-chinese

shenzhi-wang/Llama3-8B-Chinese-Chat

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shanchen commited on Apr 30

Commit

41b8e8a

•

1 Parent(s): 3ba9fe5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -65,7 +65,7 @@ input_ids = tokenizer.apply_chat_template(
 outputs = model.generate(
     input_ids,
-    max_new_tokens=8192,
     do_sample=True,
     temperature=0.6,
     top_p=0.9,

 outputs = model.generate(
     input_ids,
+    max_new_tokens=192 max#8192,
     do_sample=True,
     temperature=0.6,
     top_p=0.9,