Hugging Face's logo

latestissue
/
rwkv-6-finch-7b-gguf

GGUF
Inference Endpoints
Model card Files Community
1
latestissue commited on
Commit
c637c46
•
1 Parent(s): eb6331a

Upload 7 files

Browse files
Files changed (7) hide show
  1. rwkv-6-finch-7b-iq3_s.gguf +3 -0
  2. rwkv-6-finch-7b-iq3_xxs.gguf +3 -0
  3. rwkv-6-finch-7b-iq4_nl.gguf +3 -0
  4. rwkv-6-finch-7b-iq4_xs.gguf +3 -0
  5. rwkv-6-finch-7b-q2_k.gguf +3 -0
  6. rwkv-6-finch-7b-q3_k.gguf +3 -0
  7. rwkv-6-finch-7b-q3_k_l.gguf +3 -0
rwkv-6-finch-7b-iq3_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c4f1ba936f2d96eb1d76952706372e661d33c2e0a43f4fdb917f0d7133beca6
3
+ size 3696539072
rwkv-6-finch-7b-iq3_xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86d247736fab9d1f17fb5e4ad1aa76c4125bad815843ed18f2f90c46f75b3578
3
+ size 3332945344
rwkv-6-finch-7b-iq4_nl.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45530b8b1aad8911f5a73bf9539161b500e7d0e492e3c5a0fc66725d99779147
3
+ size 4661360064
rwkv-6-finch-7b-iq4_xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:564295bd452cc080c66cf892a4908369c248a8273b6e366a39f662f70044f8f5
3
+ size 4434343360
rwkv-6-finch-7b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d5d8e4366bcad00f4b37fc772e457fed6262ee0979f7aeb00b74e0185997e44
3
+ size 2958734784
rwkv-6-finch-7b-q3_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c3aea619984023ba89270137d663e63054a76bb5def0e78e292ebade57b314f
3
+ size 3696539072
rwkv-6-finch-7b-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea3c0e4a6760672d1ec6392ea9425f66552fc76193297319518b12f28f8efac3
3
+ size 3696539072