Llama 3.1 GPTQ, AWQ, and BNB Quants
Collection
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗
•
9 items
•
Updated
•
56
Rodri Mora
bullerwins
AI & ML interests
Gen AI, MLOps, Fine tuning and Quantizing models
Recent Activity
updated
a model
8 days ago
bullerwins/Mistral-Large-Instruct-2411-exl2_5.5bpw
updated
a model
8 days ago
bullerwins/Mistral-Large-Instruct-2411-exl2_4.0bpw
updated
a model
8 days ago
bullerwins/Mistral-Large-Instruct-2411-exl2_5.0bpw
Organizations
None yet