AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated 6 days ago • 62

Note About: Simple python script to generate various GGUF-Imatrix quantizations from a Hugging Face author/model input, for Windows and NVIDIA hardware.