Hugging Face's logo

second-state
/
OpenHermes-2.5-Mistral-7B-GGUF

Text Generation
Transformers
GGUF
English
mistral
instruct
finetune
chatml
gpt4
synthetic data
distillation
Model card Files Community
Xin Liu commited on
Commit
0a6c817
•
1 Parent(s): 4569126

Add models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (12) hide show
  1. OpenHermes-2.5-Mistral-7B-Q2_K.gguf +3 -0
  2. OpenHermes-2.5-Mistral-7B-Q3_K_L.gguf +3 -0
  3. OpenHermes-2.5-Mistral-7B-Q3_K_M.gguf +3 -0
  4. OpenHermes-2.5-Mistral-7B-Q3_K_S.gguf +3 -0
  5. OpenHermes-2.5-Mistral-7B-Q4_0.gguf +3 -0
  6. OpenHermes-2.5-Mistral-7B-Q4_K_M.gguf +3 -0
  7. OpenHermes-2.5-Mistral-7B-Q4_K_S.gguf +3 -0
  8. OpenHermes-2.5-Mistral-7B-Q5_0.gguf +3 -0
  9. OpenHermes-2.5-Mistral-7B-Q5_K_M.gguf +3 -0
  10. OpenHermes-2.5-Mistral-7B-Q5_K_S.gguf +3 -0
  11. OpenHermes-2.5-Mistral-7B-Q6_K.gguf +3 -0
  12. OpenHermes-2.5-Mistral-7B-Q8_0.gguf +3 -0
OpenHermes-2.5-Mistral-7B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1da951e44e203de32b023fbf88dd5f7f615bc348e950eaa80c589ec7e88a221a
3
+ size 3083107456
OpenHermes-2.5-Mistral-7B-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01f1ca6b4e0cc34137246fcd990fdd1b7b4cca3b479906111ce8b203a5e117a9
3
+ size 3822034880
OpenHermes-2.5-Mistral-7B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6a1780460ce1b45a26bd08b1828b3a80617ce54ce2dce83f173859d9295b03a
3
+ size 3518996416
OpenHermes-2.5-Mistral-7B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ce450e11697c2382e928690fd4e41dbd6c6bb231880e15a8e7361e3724aa34d
3
+ size 3164577728
OpenHermes-2.5-Mistral-7B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba89c11d2cd357de6e152fd1adc34b6d297ae9d54e56c5a3217f3a2e84502a0f
3
+ size 4108928000
OpenHermes-2.5-Mistral-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14ddcc71f610e9f5894787dbcf062d85573b5fec76374ca4d0cd5170ddd13a06
3
+ size 4368450560
OpenHermes-2.5-Mistral-7B-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2d4e760cef98a5da427ed97492c621a017a44dbeb516ccda0a61ac9ca02b172
3
+ size 4140385280
OpenHermes-2.5-Mistral-7B-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ff085ef82dd968f030b10185510af4b02149bdefa9348068f4df8dddc62a03a
3
+ size 4997728256
OpenHermes-2.5-Mistral-7B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76746d87d2c47ce32218fe05e4b20e5fa1849f3a33c743101309e48912581536
3
+ size 5131421696
OpenHermes-2.5-Mistral-7B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7cde90338800e579b0dd595ba52bae6dd1a41984ef82c955c39c107f1483f20
3
+ size 4997728256
OpenHermes-2.5-Mistral-7B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7315fc5ec561dff9d4d3f7428ee25597fc9e69a4a61e89dede8964b77f8ffca
3
+ size 5942078528
OpenHermes-2.5-Mistral-7B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ed9e13ddc8de2920625cad2208adcdf4811cf175630955384f6b971b954d97f
3
+ size 7695875008