FantasiaFoundry/GGUF-Quantization-Script
Text Generation
•
Updated
•
61
Useful tools.
Note About: Simple python script to generate various GGUF-Imatrix quantizations from a Hugging Face author/model input, for Windows and NVIDIA hardware.