Hugging Face's logo

LoneStriker
/
Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.75bpw-h6-exl2

Text Generation
Transformers
Safetensors
English
mixtral
mergekit
Merge
conversational
text-generation-inference
Model card Files Community
1
New discussion

What quantization is it? Can be used with vLLM?

1
#1 opened 8 months ago by rafa9