RecursionError: maximum recursion depth exceeded
#3
by
andrews-llms
- opened
Hi all, this model is producing the following error when using AutoTokenizer.from_pretrained:
RecursionError: maximum recursion depth exceeded while calling a Python object
I think this might be related to transformers or tokenizers
I am using tranformers==4.33.1
and tokenizers==0.13.3
This should now be fixed. Some old models didn't include the BOS/EOS/UNK tokens in tokenizer_config.json, and with later versions of Transformers this causes that error.
I've fixed the file. Please try a download again and then it should work.