NeelNanda
/

gpt-neox-tokenizer-digits

Model card Files Files and versions Community

gpt-neox-tokenizer-digits / tokenizer.json

NeelNanda's picture

Remove added tokens to make compatible with tokenizers>=0.14 (#1)

0f66715 12 months ago

history contribute delete

2.04 MB

File too large to display, you can check the raw version instead.