ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

#4
by HelixPark - opened

ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

Transformers = 4.27.1

tokenizer_config.json中 "tokenizer_class": "LlamaTokenizer",

请问修改哪些地方

shareAI org

建议升级一下transformers库版本再进行尝试,没有能够复现到你这个问题

Baicai003 changed discussion status to closed

Sign up or log in to comment