Hugging Face's logo

LiteLLMs
/
WizardLM-2-8x22B-GGUF

GGUF
GGUF
Inference Endpoints
conversational
Model card Files Community
andrijdavid commited on
Commit
b927c41
•
1 Parent(s): d039aee

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q2_K/Q2_K-00001-of-00009.gguf +3 -0
  3. Q2_K/Q2_K-00002-of-00009.gguf +3 -0
  4. Q2_K/Q2_K-00003-of-00009.gguf +3 -0
  5. Q2_K/Q2_K-00004-of-00009.gguf +3 -0
  6. Q2_K/Q2_K-00005-of-00009.gguf +3 -0
  7. Q2_K/Q2_K-00006-of-00009.gguf +3 -0
  8. Q2_K/Q2_K-00007-of-00009.gguf +3 -0
  9. Q2_K/Q2_K-00008-of-00009.gguf +3 -0
  10. Q2_K/Q2_K-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -69,3 +69,12 @@ Q5_1/Q5_1-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
69
  Q5_1/Q5_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
70
  Q5_1/Q5_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
71
  Q5_1/Q5_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
69
  Q5_1/Q5_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
70
  Q5_1/Q5_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
71
  Q5_1/Q5_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
72
+ Q2_K/Q2_K-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
73
+ Q2_K/Q2_K-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
74
+ Q2_K/Q2_K-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
75
+ Q2_K/Q2_K-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
76
+ Q2_K/Q2_K-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
+ Q2_K/Q2_K-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
+ Q2_K/Q2_K-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ Q2_K/Q2_K-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ Q2_K/Q2_K-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q2_K/Q2_K-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:533bdb37fd0893796b4101050c44a55f3297be73d150b438a407cd21cef34b9a
3
+ size 531932704
Q2_K/Q2_K-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b745deff4d6ef44c79202275f9816a54037a9160b2dbc0035c1042a8574976a
3
+ size 466800512
Q2_K/Q2_K-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b5db0618d054ca910024507762a33c90534c7ec0bd70d9e2fa6861033c1fb25
3
+ size 473386880
Q2_K/Q2_K-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8731eb34d1c99f3448d7c6b05569e755b0c73595fad1c83efb5f73bfe45c6fa4
3
+ size 492654464
Q2_K/Q2_K-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f1f1ec12e533f14c8489cdb7bb8c5918fd7c4e46cb030dd380a28df194a151e
3
+ size 479088512
Q2_K/Q2_K-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edde5ed0a39e1717b778bd55fb25ed489785e78f13b3bd1c102f6f699d1d253e
3
+ size 473386880
Q2_K/Q2_K-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:622ef6489995fa9e46b03fb2343ff2c13b7e614787b9552dc34d7831b879f88e
3
+ size 15690195520
Q2_K/Q2_K-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76c99c472a232d62d4d28a985a5a06adddb5acd5f02013bdcdbc5bcc96913b4b
3
+ size 18629006080
Q2_K/Q2_K-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0db3965a7640d237f0c79f79fbebaf0193ac2c3e8ce93d7101baf41c1c6b13d1
3
+ size 14866714432