Hugging Face's logo

Lewdiculous
/
Layris_9B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
2
Lewdiculous commited on
Commit
b912953
•
1 Parent(s): bebcce7

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Layris_9B-IQ3_M-imat.gguf +3 -0
  3. Layris_9B-IQ3_S-imat.gguf +3 -0
  4. Layris_9B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -40,3 +40,6 @@ Layris_9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Layris_9B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Layris_9B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
  Layris_9B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
40
  Layris_9B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Layris_9B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
  Layris_9B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Layris_9B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Layris_9B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Layris_9B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Layris_9B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9256ba6ac3168c6f582ab44a0a25449104da3aee75c0b21803c098b20147bdbd
3
+ size 4064970688
Layris_9B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:660f24fb6a21b6cc3ea9ca07ff36b79c3cb809419737de466f1a1285547cf508
3
+ size 3936847808
Layris_9B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:128e9bd5fd37b344605196ea1ff7e07ad0a4f9efc13bb5159ef6dccfebc9e150
3
+ size 9550006208