BAAI
/

Bunny-v1_1-4B

Text Generation

Model card Files Files and versions Community

BoyaWu10 commited on May 30

Commit

540de87

•

1 Parent(s): 799a126

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -76,7 +76,9 @@ output_ids = model.generate(
     input_ids,
     images=image_tensor,
     max_new_tokens=100,
-    use_cache=True)[0]
 print(tokenizer.decode(output_ids[input_ids.shape[1]:], skip_special_tokens=True).strip())
 ```

     input_ids,
     images=image_tensor,
     max_new_tokens=100,
+    use_cache=True,
+    repetition_penalty=1.0 # increase this to avoid chattering
+)[0]
 print(tokenizer.decode(output_ids[input_ids.shape[1]:], skip_special_tokens=True).strip())
 ```