Hugging Face's logo

Mozilla
/
Mixtral-8x22B-Instruct-v0.1-llamafile

llamafile
English
Model card Files Community
Mixtral-8x22B-Instruct-v0.1-llamafile

Commit History

Quantize Q4_0 with llamafile-0.8.7
e25b58a
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
058de68
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
6dd6354
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
4ca6782
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
2b0d13f
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
e883333
verified

jartine commited on

Quantize F16 with llamafile-0.8.7
7725333
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
08735a5
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
09c1e40
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
2617344
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
2c5cf54
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
c4cdd96
verified

jartine commited on

Quantize BF16 with llamafile-0.8.7
d06358b
verified

jartine commited on

Quantize Q6_K with llamafile-0.8.7
977fe96
verified

jartine commited on

Quantize Q6_K with llamafile-0.8.7
00bec50
verified

jartine commited on

Quantize Q6_K with llamafile-0.8.7
ee364bf
verified

jartine commited on

Quantize Q5_K_M with llamafile-0.8.7
97c44ea
verified

jartine commited on

Quantize Q5_K_M with llamafile-0.8.7
ab0c061
verified

jartine commited on

Quantize Q5_K_M with llamafile-0.8.7
4b82d14
verified

jartine commited on

Quantize Q4_K_M with llamafile-0.8.7
7461ab5
verified

jartine commited on

Quantize Q4_K_M with llamafile-0.8.7
e61fbef
verified

jartine commited on

Quantize Q4_K_S with llamafile-0.8.7
22628b8
verified

jartine commited on

Quantize Q4_K_S with llamafile-0.8.7
34c867b
verified

jartine commited on

Quantize Q3_K_M with llamafile-0.8.7
d48986e
verified

jartine commited on

Quantize Q3_K_M with llamafile-0.8.7
4fc91c6
verified

jartine commited on

Quantize Q3_K_S with llamafile-0.8.7
696eea4
verified

jartine commited on

Quantize Q3_K_S with llamafile-0.8.7
4559390
verified

jartine commited on

Quantize Q2_K with llamafile-0.8.7
210da7c
verified

jartine commited on

Quantize Q2_K with llamafile-0.8.7
a2d6827
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0
8bbaa44
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0
92e1294
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0
22f7c33
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_0
a48b886
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_0
b1857cd
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
729fe90
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
18c6cf6
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
9b53de9
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
90d0da0
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
1885c58
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16
dd5f914
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
a8dbe77
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
483ae08
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
ee6b58e
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
1ca70f8
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
f7c142f
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16
d8e75d0
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K
8f6e344
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K
efdbbd2
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K
4c6226e
verified

jartine commited on

Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q5_K_M
d311d7e
verified

jartine commited on