Hugging Face's logo

turboderp
/
Mixtral-8x7B-instruct-exl2

Model card Files Community
6
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

EXL2 quants of Mistral 8x7B Instruct v0.1

Supported in ExLlamaV2 0.0.11 and up

2.40 bits per weight
2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json

image/png

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .