Adding 4-bit k- and traditional ggml quants
Browse files- mistral-7b-q40.gguf +3 -0
- mistral-7b-q41.gguf +3 -0
- mistral-7b-q4km.gguf +3 -0
- mistral-7b-q4ks.gguf +3 -0
mistral-7b-q40.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:56a75a428a3097eb4829ec09c0cc04ecf6b57fcaa446394252445ef8a840a97d
|
| 3 |
+
size 4108916352
|
mistral-7b-q41.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1d2e82a5f5046a9bae5040f2c9b670d2b053410fc585ee8b125c49ab95e41b77
|
| 3 |
+
size 4553315968
|
mistral-7b-q4km.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2010fa21ab2cca537e81fa27a1ef7c30109ed282bfa9bb7064c48d2c73c3baec
|
| 3 |
+
size 4454946432
|
mistral-7b-q4ks.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:15064660f4bd3fccfe85090cc41c0e84d15539ce5157425150d4b1186f401964
|
| 3 |
+
size 4155053696
|