I used the official convert-hf-to-gguf.py script in the llama.cpp repo to generate these GGUF files. Let me know if there's anything else I can add here!

Closed in favor of #3, I forgot to rename the model files and couldn't figure out how to do it inside huggingface

asg017 changed pull request status to closed

Sign up or log in to comment