alchemonaut
/

QuartetAnemoi-70B-t0.0001

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

lodrick-the-lafted commited on Feb 20

Commit

4f64b3d

•

1 Parent(s): ab56f2c

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -124,13 +124,15 @@ In our testing, this model seems like a storyteller, as might be expected, but t
 <br/>
 GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
 Some exl2 quants were made by llmixer too:
  - [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
  - [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
  - [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
-As well as [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF) by Nexesenex.
 <br/>
 <br/>

 <br/>
 GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
+Nexesenex made some [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF).
 Some exl2 quants were made by llmixer too:
  - [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
  - [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
  - [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
+[AWQ quant by tachyphylaxis](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ)
 <br/>
 <br/>