malayalam_combined_ / added_tokens.json
akrishnan's picture
Upload tokenizer
ca49120 verified
raw
history blame
30 Bytes
{
"</s>": 93,
"<s>": 92
}