Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
TheBloke
/
Mixtral_34Bx2_MoE_60B-AWQ
like
4
Text Generation
Transformers
Safetensors
mixtral
text-generation-inference
4-bit precision
awq
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
Mixtral_34Bx2_MoE_60B-AWQ
1 contributor
History:
4 commits
TheBloke
Upload README.md
3a262b3
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
18.7 kB
Upload README.md
11 months ago
config.json
Safe
1.09 kB
AWQ model commit
11 months ago
generation_config.json
Safe
137 Bytes
AWQ model commit
11 months ago
model-00001-of-00004.safetensors
Safe
9.95 GB
LFS
AWQ model commit
11 months ago
model-00002-of-00004.safetensors
Safe
9.93 GB
LFS
AWQ model commit
11 months ago
model-00003-of-00004.safetensors
Safe
9.93 GB
LFS
AWQ model commit
11 months ago
model-00004-of-00004.safetensors
Safe
3.14 GB
LFS
AWQ model commit
11 months ago
model.safetensors.index.json
Safe
188 kB
AWQ model commit
11 months ago
quant_config.json
Safe
144 Bytes
AWQ model commit
11 months ago
special_tokens_map.json
Safe
436 Bytes
AWQ model commit
11 months ago
tokenizer.json
Safe
3.56 MB
AWQ model commit
11 months ago
tokenizer.model
Safe
1.03 MB
LFS
AWQ model commit
11 months ago
tokenizer_config.json
Safe
867 Bytes
AWQ model commit
11 months ago