Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints
text-generation-inference
Model card Files Community
15

Upload folder using huggingface_hub

#3
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+40
-0
Files changed (11) hide show
  1. .gitattributes +10 -0
  2. WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf +3 -0
  3. WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf +3 -0
  4. WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf +3 -0
  5. WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf +3 -0
  6. WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf +3 -0
  7. WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf +3 -0
  8. WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf +3 -0
  9. WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf +3 -0
  10. WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf +3 -0
  11. WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,13 @@ WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
38
  WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
38
  WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
+ WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
43
+ WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
46
+ WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
47
+ WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
48
+ WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
49
+ WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
50
+ WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:507606f84c52f2f3e73985fa7717f491a9a6a1328d4650d023ebecaef8033614
3
+ size 13520020416
WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e566a04d762cddc4579b844e425c614b46e2266756e7255e99d03bd93c3144e
3
+ size 13483630784
WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fafb55b1e73da0c6ababd35b4086578f0c29b1a04b5492ad3e3475660f85ddab
3
+ size 12270264448
WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e421a93a1fcbd9ff769cc5eed1e74b8c3ab281ecdc7977f915c6929ffa9859b7
3
+ size 13339615392
WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37afb9affd4192da35e6d4e4879a79571457b1d2b2d358f5ab269978c1bc506c
3
+ size 5614673216
WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02c67f83658f8039c146642741936c7a1ad18d786af0364e7486f616c45508fc
3
+ size 13958259648
WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4578f7ef6150c93b7347bdb77c6f2c3f839bec145ec9022bccea8900d8e3caf2
3
+ size 14525849792
WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbf516d44516ac5f1478f48dfb37c45ebd91940111b32af93edbcf629441e8a5
3
+ size 13197467776
WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f4433ced22748b00fabffe18ef41b93aa164214029603286ecc55ad7ef6f8e1
3
+ size 14193090720
WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13b984ca43dcbf4d0a873d7658400060ab00629cc784716142819dbb045da01c
3
+ size 5623520576