hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
•
Updated
•
2.11k
•
4
Gemma2 AWQ Quants
Optimised AWQ Quants for high-throughput deployments of Gemma2! Compatible with Transformers, TGI & VLLM 🤗