cportoca's picture
Upload tokenizer
d0ece43 verified
raw
history blame
60 Bytes
{
"</s>": 37,
"<s>": 36,
"[PAD]": 35,
"[UNK]": 34
}