Update README.md
Browse files
README.md
CHANGED
|
@@ -27,4 +27,26 @@ Please go to:
|
|
| 27 |
|
| 28 |
Exl2 Quant - 4 bpw - Special thanks to James2313123 for this:
|
| 29 |
|
| 30 |
-
[ https://huggingface.co/James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-EXL2-4bpw ]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
Exl2 Quant - 4 bpw - Special thanks to James2313123 for this:
|
| 29 |
|
| 30 |
+
[ https://huggingface.co/James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-EXL2-4bpw ]
|
| 31 |
+
|
| 32 |
+
Additional Quants:
|
| 33 |
+
|
| 34 |
+
EXL2:
|
| 35 |
+
[ https://huggingface.co/James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS_5bpw-h8-EXL2]
|
| 36 |
+
|
| 37 |
+
EXL2:
|
| 38 |
+
[ https://huggingface.co/James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-EXL2-3bpw]
|
| 39 |
+
|
| 40 |
+
EXL2:
|
| 41 |
+
[ https://huggingface.co/MikeRoz/DavidAU_MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-8.0bpw-h8-exl2]
|
| 42 |
+
|
| 43 |
+
EXL2:
|
| 44 |
+
[ https://huggingface.co/MikeRoz/DavidAU_MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-4.0bpw-h6-exl2]
|
| 45 |
+
|
| 46 |
+
[ https://huggingface.co/RichardErkhov/DavidAU_-_MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-gguf]
|
| 47 |
+
|
| 48 |
+
IMATRIX GGUF:
|
| 49 |
+
[ https://huggingface.co/mradermacher/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-i1-GGUF]
|
| 50 |
+
|
| 51 |
+
[ https://huggingface.co/mradermacher/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS-GGUF]
|
| 52 |
+
|