venketh
/

Mixtral-8x7B-Instruct-v0.1-GGUF-imatrix

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-GGUF-imatrix

Commit History

Import IQ3_M quantization (3.66 bpw, 20 GB)

7d6ea65

venketh commited on Mar 5

Import Q5_K_M quantization (31 GB)

4e52c4e

venketh commited on Mar 4

Import IQ4_XS quantization (4.25 bpw, 24 GB)

4a8ea59

venketh commited on Feb 29

Import source and imatrix.dat

11f6605

Venkatesh Srinivas commited on Feb 29

Track imatrix.dat and *.gguf

18759df

Venkatesh Srinivas commited on Feb 29

initial commit

a804198
verified

venketh commited on Feb 29