G15-merged / added_tokens.json
kst23's picture
Upload tokenizer
3e2491a verified
raw
history blame
84 Bytes
{
"<|begin_of_text|>": 64128,
"<|end_of_text|>": 64129,
"<|im_end|>": 64130
}