rupgt-chatml-tokenizer / added_tokens.json
mrsteyk's picture
Upload 6 files
8fbcaa9
raw
history blame contribute delete
77 Bytes
{
"<|endoftext|>": 50257,
"<|im_end|>": 50259,
"<|im_start|>": 50258
}