Not match vocab size in vocal.json and config.json

#25
by myleee - opened

The number of vocab in vocab.json is 50265,
but in the config.json, there is "vocab_size": 50272.
What is the true vocab size?

Sign up or log in to comment