brabant-xvii-from-scratch / added_tokens.json
xaviergillard's picture
Upload tokenizer
3abd111 verified
raw
history blame contribute delete
94 Bytes
{
"[CLS]": 24312,
"[MASK]": 24313,
"[PAD]": 24311,
"[SEP]": 24310,
"[UNK]": 24309
}