leo-hessianai-70b-chat / _added_tokens.json
bjoernp's picture
Rename added_tokens.json to _added_tokens.json
528cb77
raw
history blame
141 Bytes
{
"<CLS>": 32000,
"<EOD>": 32001,
"<EOD>": 32002,
"<MASK>": 32003,
"<PAD>": 32004,
"<|im_start|>": 32005,
"<|im_end|>": 32006
}