Update README.md
Browse files
README.md
CHANGED
@@ -31,10 +31,24 @@ Both experts are used in tandem when generating a token.
|
|
31 |
|
32 |
------------------------------------------------------------------------------
|
33 |
|
34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
|
36 |
----> [Q6_K GGUF](https://huggingface.co/v000000/L3.1-Celestial-Stone-2x8B-Q6_K-GGUF)
|
37 |
|
|
|
|
|
|
|
|
|
38 |
------------------------------------------------------------------------------
|
39 |
|
40 |
*The first expert* is Instruct 405B distillation/RP vector merge <b>(Supernova-Lite, Niitama1.1, Storm)</b>
|
|
|
31 |
|
32 |
------------------------------------------------------------------------------
|
33 |
|
34 |
+
* *Llama.CPP - GGUF:*
|
35 |
+
|
36 |
+
Thank you mradermacher for the quants!
|
37 |
+
|
38 |
+
----> [GGUF iMatrix](https://huggingface.co/mradermacher/L3.1-Celestial-Stone-2x8B-i1-GGUF)
|
39 |
+
|
40 |
+
----> [GGUF static](https://huggingface.co/mradermacher/L3.1-Celestial-Stone-2x8B-GGUF)
|
41 |
+
|
42 |
+
Other alternative quants:
|
43 |
+
|
44 |
+
----> [Q8_0 GGUF by dasChronos1](https://huggingface.co/dasChronos1/L3.1-Celestial-Stone-2x8B-Q8_0-GGUF)
|
45 |
|
46 |
----> [Q6_K GGUF](https://huggingface.co/v000000/L3.1-Celestial-Stone-2x8B-Q6_K-GGUF)
|
47 |
|
48 |
+
----> [Q4_K_M by aashish1904](https://huggingface.co/aashish1904/L3.1-Celestial-Stone-2x8B-Q4_K_M-GGUF)
|
49 |
+
|
50 |
+
----> [Q2_K by aashish1904](https://huggingface.co/aashish1904/L3.1-Celestial-Stone-2x8B-Q2_K-GGUF)
|
51 |
+
|
52 |
------------------------------------------------------------------------------
|
53 |
|
54 |
*The first expert* is Instruct 405B distillation/RP vector merge <b>(Supernova-Lite, Niitama1.1, Storm)</b>
|