iyanello
/

openchat_3.5-1210-q4f16_1-mlc-llm

Model card Files Files and versions Community

iyanello commited on Dec 27, 2023

Commit

f1f7de2

•

1 Parent(s): adac593

Update added_tokens.json

Files changed (1) hide show

added_tokens.json +1 -0

added_tokens.json CHANGED Viewed

@@ -1,4 +1,5 @@
 {
   "<|end_of_turn|>": 32000,
   "<|pad_0|>": 32001
 }

 {
   "<|end_of_turn|>": 32000,
+  "<|endoftext|>": 50256,
   "<|pad_0|>": 32001
 }