Hugging Face's logo

TheDrummer
/
UnslopNemo-12B-v4-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
1
TheDrummer commited on
Commit
aa3e105
•
1 Parent(s): 9514a74

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Rocinante-12B-v2i-BF16.gguf +3 -0
  3. Rocinante-12B-v2i-Q2_K.gguf +3 -0
  4. Rocinante-12B-v2i-Q3_K_M.gguf +3 -0
  5. Rocinante-12B-v2i-Q4_K_M.gguf +3 -0
  6. Rocinante-12B-v2i-Q5_K_M.gguf +3 -0
  7. Rocinante-12B-v2i-Q6_K.gguf +3 -0
  8. Rocinante-12B-v2i-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Rocinante-12B-v2i-BF16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Rocinante-12B-v2i-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Rocinante-12B-v2i-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Rocinante-12B-v2i-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Rocinante-12B-v2i-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Rocinante-12B-v2i-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Rocinante-12B-v2i-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Rocinante-12B-v2i-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2df1806aabd4a68f8215d1bdb7ccfd2d4c9c2c0e667b07cc396c2d5189c2b5fc
3
+ size 24504279424
Rocinante-12B-v2i-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3c7d6d0a6d3fb56ca723278a85a2a226f1bd07ca0ff53af987b88eb4cb9f3a6
3
+ size 4791050624
Rocinante-12B-v2i-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2dd45c5102de638db61f9dc1861cb4ea2655fe980aed545d0f7545786c3fdafc
3
+ size 6083092864
Rocinante-12B-v2i-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41f687f6026bfb4692e2a42808ee7744e90556f172d5ce89e23a9dd1cf6e59d1
3
+ size 7477207424
Rocinante-12B-v2i-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddb6aa260f0d2eb969708732bce988214c2b5aadc22d271900f4eb5e277c538b
3
+ size 8727634304
Rocinante-12B-v2i-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f418e1b31da26f15e12376026df06066a18cd347ea4926d69239a98cc6f355cc
3
+ size 10056212864
Rocinante-12B-v2i-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e1d4862ee7deaecc280b6dd09847198a1347031dbc6f6279c06eac9f5e1f85c
3
+ size 13022372224