areegtarek's picture
Upload tokenizer
b9756db verified
raw
history blame
92 Bytes
{
"<end_of_utterance>": 32002,
"<fake_token_around_image>": 32000,
"<image>": 32001
}