anon8231489123

/

vicuna-13b-GPTQ-4bit-128g

like 667

I followed this tutorial: https://www.youtube.com/watch?v=cCQdzqAHcFk

I use CPU.

And I got these error:
WARNING:The model weights are not tied. Please use the tie_weights method before using the infer_auto_device function.
WARNING:The safetensors archive passed at models\vicuna-13b-GPTQ-4bit-128g\vicuna-13b-4bit-128g.safetensors does not contain metadata. Make sure to save your model with the save_pretrained method. Defaulting to 'pt' metadata.

What can I do to solve this? The model doesn't work.