alternative-neel-tokenizer / tokenizer_config.json
ArthurConmy's picture
Upload 4 files
0e1ec3a
raw
history blame
44 Bytes
{
"tokenizer_class": "GPTNeoXTokenizer"
}