Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0 8bbaa44 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0 92e1294 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q8_0 22f7c33 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_0 a48b886 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_0 b1857cd verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 729fe90 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 18c6cf6 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 9b53de9 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 90d0da0 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 1885c58 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 F16 dd5f914 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 a8dbe77 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 483ae08 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 ee6b58e verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 1ca70f8 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 f7c142f verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 BF16 d8e75d0 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K 8f6e344 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K efdbbd2 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q6_K 4c6226e verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q5_K_M d311d7e verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q5_K_M 7867ebf verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q5_K_M 3139132 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_K_M 655e592 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_K_M 20153be verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_K_S 7a191e0 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q4_K_S 9856fbf verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q3_K_M 0edbc9c verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q3_K_M 10050b8 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q3_K_S 486af2c verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q3_K_S f8f7027 verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q2_K e39cd9f verified jartine commited on May 11
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8.4 Q2_K 0490ca8 verified jartine commited on May 11
jartine
commited on
