Narsil's picture
Narsil HF staff
Adding tokenizer.
94afb37
raw
history blame contribute delete
104 Bytes
{
"vocab_size": 258,
"model_type": "albert",
"bos_token_id": 256,
"eos_token_id": 257
}