InferenceIllusionist
/

Mistral-Large-Instruct-2407-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

InferenceIllusionist commited on Jul 24

Commit

5ca8e3f

•

1 Parent(s): d478f21

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -17,7 +17,6 @@ license: other
 Quantized from Mistral-Large-Instruct-2407 123B fp16
 * Weighted quantizations were creating using fp16 GGUF and groups_merged.txt in 105 chunks and n_ctx=512
-* Static fp16 will also be included in repo
 * For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)
 * <i>All quants are verified working prior to uploading to repo for your safety and convenience</i>

 Quantized from Mistral-Large-Instruct-2407 123B fp16
 * Weighted quantizations were creating using fp16 GGUF and groups_merged.txt in 105 chunks and n_ctx=512
 * For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)
 * <i>All quants are verified working prior to uploading to repo for your safety and convenience</i>