snakmodel-7b-base / added_tokens.json
personads's picture
uploaded final SnakModel-7B (base) tokenizer
267086f verified
raw
history blame
94 Bytes
{
"<CLS>": 32000,
"<EOD>": 32002,
"<MASK>": 32003,
"<PAD>": 32004,
"<SEP>": 32001
}