Hugging Face's logo

Clevyby
/
DarkSapling-v2.0-7B-Q5_K_S-GGUF-iMatrix

Text Generation
Transformers
GGUF
mistral
Merge
text-generation-inference
roleplay
sillytavern
quantized
Inference Endpoints
Model card Files Community
Clevyby Lewdiculous commited on
Commit
5366722
•
0 Parent(s):

Duplicate from Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix

Browse files

Co-authored-by: Lewdiculous <[email protected]>

Files changed (15) hide show
  1. .gitattributes +47 -0
  2. DarkSapling-7B-v2.0-F16.gguf +3 -0
  3. DarkSapling-7B-v2.0-IQ3_M-imat.gguf +3 -0
  4. DarkSapling-7B-v2.0-IQ3_S-imat.gguf +3 -0
  5. DarkSapling-7B-v2.0-IQ3_XXS-imat.gguf +3 -0
  6. DarkSapling-7B-v2.0-IQ4_XS-imat.gguf +3 -0
  7. DarkSapling-7B-v2.0-Q4_K_M-imat.gguf +3 -0
  8. DarkSapling-7B-v2.0-Q4_K_S-imat.gguf +3 -0
  9. DarkSapling-7B-v2.0-Q5_K_M-imat.gguf +3 -0
  10. DarkSapling-7B-v2.0-Q5_K_S-imat.gguf +3 -0
  11. DarkSapling-7B-v2.0-Q6_K-imat.gguf +3 -0
  12. DarkSapling-7B-v2.0-Q8_0-imat.gguf +3 -0
  13. README.md +19 -0
  14. imatrix-with-rp-data.txt +0 -0
  15. imatrix.dat +3 -0
.gitattributes ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ DarkSapling-7B-v2.0-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ DarkSapling-7B-v2.0-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ DarkSapling-7B-v2.0-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ DarkSapling-7B-v2.0-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
41
+ DarkSapling-7B-v2.0-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ DarkSapling-7B-v2.0-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ DarkSapling-7B-v2.0-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ DarkSapling-7B-v2.0-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ DarkSapling-7B-v2.0-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ DarkSapling-7B-v2.0-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ DarkSapling-7B-v2.0-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
DarkSapling-7B-v2.0-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:250f3e9966219c4ce67076c49e5671a78d07450cd62aed0a43b99a258383e1d6
3
+ size 14484764448
DarkSapling-7B-v2.0-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f1bbc0007c3cdd1ef55afda8df6eee8ed901ce48f95507c27a08685d4da549b
3
+ size 3284901696
DarkSapling-7B-v2.0-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9a6873cbe6a58fbc9285961ebf45e3285034a01a96d16dda6bff9aca5d344ec
3
+ size 3182403392
DarkSapling-7B-v2.0-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2753f6908e630c07bba796a5544e24ff1476464a30a34a909bd85e36bac907e
3
+ size 2827352832
DarkSapling-7B-v2.0-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8ca7222c64cd95e031d3941c3e4308890ed433cc6473443890b5085508f5c5e
3
+ size 3907699328
DarkSapling-7B-v2.0-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52b3a23fd4dc45c3eb3b730fd12185cfc8be743fa34a61980e58971fc2a06cfa
3
+ size 4368450432
DarkSapling-7B-v2.0-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38567ec20af4ca2259e37b9f57581cd1aacc00c17380206d72e8777ddfbec944
3
+ size 4140385152
DarkSapling-7B-v2.0-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd50386e3b0b265d7d995afe0d4bc937ef3e2e727c1114718af4be2a128b541c
3
+ size 5131421568
DarkSapling-7B-v2.0-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cbeb05bb264a3358af261f0feffb6e2e43f9f83822500ef5156ea12f88cac4b
3
+ size 4997728128
DarkSapling-7B-v2.0-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12a9074ea6787263261087f57e413dc0bbfcbf6a2658d13903b6cae0e33374bb
3
+ size 5942078400
DarkSapling-7B-v2.0-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8edbc3dc4628175686eaf9f7e1c2b17c73da211a6989043221adbf7c63bd6105
3
+ size 7695874880
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - gguf
5
+ - merge
6
+ - text-generation-inference
7
+ - mistral
8
+ - roleplay
9
+ - sillytavern
10
+ - quantized
11
+ ---
12
+ **Model request:**
13
+
14
+ As per request [#20](https://huggingface.co/Lewdiculous/Model-Requests/discussions/20) I'll be uploading additional GGUF-IQ-Imatrix quants for [**TeeZee/DarkSapling-7B-v2.0**](https://huggingface.co/TeeZee/DarkSapling-7B-v2.0).
15
+
16
+ "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
17
+ "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
18
+
19
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/3NdasDn51w7uas_rVHqeC.png)
imatrix-with-rp-data.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:996be0a5621acefa66e45c0914a3d031b6cc31c17d4b9ab0a4d8b5d349e9712f
3
+ size 4988126