Question about consolidated.safetensors vs model*.safetensors

#25
by JineLD - opened

Hi,

it seems I was too early to the party and downloaded consolidated.safetensors version, at that point the model*.safetensors files were not yet available. Now I am failing to convert it to .gguf for use with llama.cpp, the configuration json files are pointing to the model*.safetensors variants and I am wondering what it is that I got?

I am on a slow connection with a traffic limit and it took me a whole day and a big portion of the monthly traffic to get the model, so before I go ahead and download the model*.safetensors files I'd rather try to figure out if the consolidated.safetensors is perhaps also usable and if it can be converted?

What exactly is the difference between consolidated.safetensors and the model*.safetensors files?

Kind regards,
Jin

Sign up or log in to comment