Hugging Face's logo

Lewdiculous
/
Eris_7B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
1
Lewdiculous commited on
Commit
d0db3a2
•
1 Parent(s): fb1ca51

IQ Quants

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Eris_7B-IQ3_M-imatrix.gguf +3 -0
  3. Eris_7B-IQ3_S-imatrix.gguf +3 -0
  4. Eris_7B-IQ3_XS-imatrix.gguf +3 -0
  5. Eris_7B-IQ3_XXS-imatrix.gguf +3 -0
  6. Eris_7B-IQ4_NL-imatrix.gguf +3 -0
  7. Eris_7B-IQ4_XS-imatrix.gguf +3 -0
.gitattributes CHANGED
@@ -40,3 +40,9 @@ Eris_7B-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
40
  imatrix-Eris_7B-F16.dat filter=lfs diff=lfs merge=lfs -text
41
  Eris_7B-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
42
  Eris_7B-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
40
  imatrix-Eris_7B-F16.dat filter=lfs diff=lfs merge=lfs -text
41
  Eris_7B-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
42
  Eris_7B-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Eris_7B-IQ3_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Eris_7B-IQ3_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Eris_7B-IQ3_XS-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Eris_7B-IQ3_XXS-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Eris_7B-IQ4_NL-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Eris_7B-IQ4_XS-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Eris_7B-IQ3_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49fa76b84577ecd245fe55bb824e37766c362adb318e8102846c08a09b8ab433
3
+ size 3284891328
Eris_7B-IQ3_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc033dedde32e3728ac18309a2a7fd548a96a291b1778a5aa2a60c306a694292
3
+ size 3182393024
Eris_7B-IQ3_XS-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e56e2a1dd09bc4126dfcd845132f9b37e3a2f8e087f57c9543c7a33e921a513d
3
+ size 3000989376
Eris_7B-IQ3_XXS-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f51f08d02738e35660e5c441e2aaf284c164c23c4801927ca8ccfb03608fe13e
3
+ size 2827343552
Eris_7B-IQ4_NL-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a101b51f6a3ce4f60706576aa83d622073d337a78176b4ed7bf36e5f9a8ba0f9
3
+ size 4125693632
Eris_7B-IQ4_XS-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe2e693e94474ef0b5e2c67e7396686d45fcb45bcd9d678a71e7931b1b20894e
3
+ size 3907688128