Hugging Face's logo

TechxGenus
/
Mistral-Large-Instruct-2411-GPTQ

Safetensors
vllm
mistral
4-bit precision
gptq
Model card Files Community
1
New discussion

感觉新版的Mistrial-LargeV3的GPTQ量化的int4版本对显存的需求大大提升了
#1 opened about 6 hours ago by YanchengQian