error with example inference
#9
by
xaq
- opened
"Can't load tokenizer using from_pretrained, please update its configuration: Can't load tokenizer for 'hivemind/gpt-j-6B-8bit'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'hivemind/gpt-j-6B-8bit' is the correct path to a directory containing all relevant files for a GPT2TokenizerFast tokenizer."
Please read the model card. This code is not supposed to work with from_pretrained. It requires a custom notebook that uses the tokenizer from the original model. Also, this notebook has been deprecated for 4 months now.