Unable to load Llama-3.2-1B Tokenizer?

#25
by hawkiyc - opened

Hi everyone,

I am trying to finetune llama-3.2-1B model. Everything is fine while loading pretrained model with AutoModelForCausalLM.
But I get error message as screenshot while loading llama tokenizer.
截圖 2024-10-17 19.40.55.jpg

And I looked into the "files and versions" page, this model indeed have tokenizer.json file. Why I got above error?

Sign up or log in to comment