Hugging Face's logo

Lewdiculous
/
Sonya-7B-GGUF-IQ-Imatrix

GGUF
mistral
roleplay
Inference Endpoints
Model card Files Community
Lewdiculous commited on
Commit
5f6f640
•
1 Parent(s): b225f4e

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Sonya-7B-Q5_K_S-imat.gguf +3 -0
  3. Sonya-7B-Q6_K-imat.gguf +3 -0
  4. Sonya-7B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,6 @@ Sonya-7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Sonya-7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Sonya-7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Sonya-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
39
  Sonya-7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Sonya-7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Sonya-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Sonya-7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Sonya-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Sonya-7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Sonya-7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:acba21ca16865c2c5be10f84bf9822d5a64b02b1535ee2d931e38fcccac5ff1a
3
+ size 4997715712
Sonya-7B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656354e8dd05bcd8a3bf78883fc2fc7d928976cc33c030142cdf540936e35116
3
+ size 5942064896
Sonya-7B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a58787d7c289bb9a75c0ae82e2cf49e59d835ad5106bd0b11e5cdb10b8e25366
3
+ size 7695857408