Hugging Face's logo

Lewdiculous
/
Prima-LelantaclesV5-7b-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
Model card Files Community
1
Lewdiculous commited on
Commit
4c8e019
•
1 Parent(s): ee7399a

Add --imatrix quantized GGUF model files.

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Prima-LelantaclesV5-7b-Q3_K_M-imatrix.gguf +3 -0
  3. Prima-LelantaclesV5-7b-Q4_K_M-imatrix.gguf +3 -0
  4. Prima-LelantaclesV5-7b-Q4_K_S-imatrix.gguf +3 -0
  5. Prima-LelantaclesV5-7b-Q5_K_M-imatrix.gguf +3 -0
  6. Prima-LelantaclesV5-7b-Q5_K_S-imatrix.gguf +3 -0
  7. Prima-LelantaclesV5-7b-Q6_K-imatrix.gguf +3 -0
.gitattributes CHANGED
@@ -40,3 +40,9 @@ Prima-LelantaclesV5-7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
  Prima-LelantaclesV5-7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
  Prima-LelantaclesV5-7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
40
  Prima-LelantaclesV5-7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
  Prima-LelantaclesV5-7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
43
+ Prima-LelantaclesV5-7b-Q3_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Prima-LelantaclesV5-7b-Q4_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Prima-LelantaclesV5-7b-Q4_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Prima-LelantaclesV5-7b-Q5_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Prima-LelantaclesV5-7b-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Prima-LelantaclesV5-7b-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Prima-LelantaclesV5-7b-Q3_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d32d783c0329a4b90f3410c63994c183a02b1a1172b40582770f26755966539
3
+ size 3518985920
Prima-LelantaclesV5-7b-Q4_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df54c4c244e5f8cbb83ed0021e83a8db504765f4436bd2e6eaa9baead62ee837
3
+ size 4368438976
Prima-LelantaclesV5-7b-Q4_K_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c2bf14df1e91cc86b44e8e9e52602211e5f7d11b272f5e9d61836c3dd9f6386
3
+ size 4140373696
Prima-LelantaclesV5-7b-Q5_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9441f3965039ef467bf0f1bd0aafc9d2ea81c09320d771ba2ace4e18e22c7a7c
3
+ size 5131409088
Prima-LelantaclesV5-7b-Q5_K_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b832036a0d1ac311eb3237778d10c1b475926ca2cbb528cad8690dc393a2fc54
3
+ size 4997715648
Prima-LelantaclesV5-7b-Q6_K-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa2ac11ba3f51c9fb6d1f40264cdca8ecd3b9c408f89b9e65f884c55ad5510b7
3
+ size 5942064832