Download just weights to get around Windows limit

#2
by Uneveris - opened

New to HF and attempting to download weights of various models for testing to use Llamafile on windows server. Cant seem to find just the weights, only entire llamafiles. Any assistance? TIA

the .gguf files are the ones you should be looking for I believe. I don't have a windows machine so I cant test. if you search gguf on huggingface you should find a ton of them!

mozilla org

The llamafiles themselves are weights too. You can say for instance llamafile -m foo.llamafile ...

jartine changed discussion status to closed

Sign up or log in to comment