sft_final_model3 / added_tokens.json
keonju's picture
Upload tokenizer
73220e3
raw
history blame contribute delete
126 Bytes
{
"</s>": 2,
"<s>": 1,
"<unk>": 0,
"▁<EOT>": 32010,
"▁<MID>": 32009,
"▁<PRE>": 32007,
"▁<SUF>": 32008
}