TypeError: Value for eos_token_id is not of expected type <class 'int'>

by St33lMouse - opened Jul 24

Jul 24

I'm getting that error on Ooba when I try and load this model. I don't get it with other llama 3.0 models.

Owner Jul 24

Please mind the model card. Llama3.1 needs the dev branch of ExLlamaV2 until the new wheels finish building.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment