TheBloke

/

lzlv_70B-GGUF

like 42

You mean between the Q4_K_M I released, and the one released by the model creator? If so then no, I'd expect them to be identical

Thanks for the quick response. I downloaded a quantized version from your hugging face page, LZLV Q4_K_M, some 23 days ago, and then again, I recently saw perhaps 2 days ago another upload from your end on hugging face, "lzlv_70b_fp16_hf.Q4_K_M.gguf" , so I got confused on 2 fronts:

1. Is this the same model as the last one? If yes, then why the reupload? If not, what has changed? (I tried looking at the model creator page, yet couldn't spot anything new on my end.)
2. I noticed the naming scheme has been changed, cause earlier when I downloaded, I got the model downloaded as "lzlv_Q4_K_M" and now its been reflected as "lzlv_70b_fp16_hf.Q4_K_M.gguf", does this mean its the same model, yet with fp16 precision or something new that has come along 😅

Oh, hang on now I'm confused - let me check. Did I do the same model twice?

Can you link me to the model I uploaded 23 days ago?

I can't find any evidence I've done this model before 3 days ago

OP might be referring quants released by a different person.
might be this one:
https://huggingface.co/lizpreciatior/lzlv_70B.gguf

Yeah that's what I thought they meant at first, as the original model creator also released GGUFs.

So my original answer stands @PrimeD , there should be no difference between my GGUFs and those done by the original model creator.

I forgot to remove the fp16_hf from the filenames before creating the GGUFs. It has no significance, it's there simply because that's how the original model repo was named and I forgot to take it out of the filename prefixes.

Yeah that's what I thought they meant at first, as the original model creator also released GGUFs.

So my original answer stands @PrimeD , there should be no difference between my GGUFs and those done by the original model creator.

I forgot to remove the fp16_hf from the filenames before creating the GGUFs. It has no significance, it's there simply because that's how the original model repo was named and I forgot to take it out of the filename prefixes.

Aah... you guys are right, after @Tom9000 mentioned about the https://huggingface.co/lizpreciatior/lzlv_70B.gguf and furthermore @TheBloke explained about the naming schema ( or the how about it 😄), it all comes back to me now... Tom 9000 is correct, I did download 23 days ago from the original model creator GGUF variant and got all mixed up looking with the naming scheme today... 🙃

Again, thanks for the quick responses @TheBloke @Tom9000 and might I add, I am amazed how tom 9000 was able to fill in the blank... without ever met me or spoken to me, and you filling in the rest.. it's pretty intuitive... yet what is even more surprising to me is... that tom just filled in my memory blank... ( acting as if an extended brain over the internet, if that makes any sense ) Cheers guys 🍻

You're welcome.

We are all parts of one collective consciousness of the internet.

Thanks for answering if there was any difference between lizpreciatior and theblokes GGUF's