ikawrakow
/

mistral-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mistral-7b-quantized-gguf / mistral-7b-q4km.gguf

Commit History

Adding 4-bit k- and traditional ggml quants

c5374fb

ikawrakow commited on Dec 7, 2023