Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Meraj-Mini-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
4541bfe
Meraj-Mini-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
5cbd69d3212b4c1c5c6c5b5a3fb30bfd38fa32d8b18c8ed799c327a268c03189
4541bfe
verified
about 1 month ago
.gitattributes
Safe
2.46 kB
5cbd69d3212b4c1c5c6c5b5a3fb30bfd38fa32d8b18c8ed799c327a268c03189
about 1 month ago
Meraj-Mini-GGUF_imatrix.dat
4.54 MB
LFS
db92885a03ab27f17ae898e420b11cce80bcc8871192ed7d932442e2ca911c5c
about 1 month ago
Meraj-Mini.IQ1_M.gguf
Safe
2.04 GB
LFS
db92885a03ab27f17ae898e420b11cce80bcc8871192ed7d932442e2ca911c5c
about 1 month ago
Meraj-Mini.IQ2_XS.gguf
Safe
2.47 GB
LFS
b27e7a6fddecd99c17b01ba04b59a7147185d2576d3eddf2c349e5224390e0d2
about 1 month ago
Meraj-Mini.IQ3_XS.gguf
Safe
3.35 GB
LFS
cfa1e568f76012586b473aedfa63b0f49767e0f3eb89d6954bd19631eb65407d
about 1 month ago
Meraj-Mini.IQ4_XS.gguf
Safe
4.22 GB
LFS
eecec9431ea7e257f9983a65d10a16d889d3996fd698830849e9531203629991
about 1 month ago
Meraj-Mini.Q2_K.gguf
Safe
3.02 GB
LFS
9368b99cc87038260ebdd1877e2220aab86d89f12b5280e1b53abf157d960032
about 1 month ago
Meraj-Mini.Q3_K_L.gguf
Safe
4.09 GB
LFS
76395e683af48ffd0a6c9fcd6d67896812f63524d94b5d3ca1c0783a60d1371f
about 1 month ago
Meraj-Mini.Q3_K_M.gguf
Safe
3.81 GB
LFS
2544111670e309c8f1c907a7c3ab1dc29c890ebc12a34dc49a5b0887a0a4d2d7
about 1 month ago
Meraj-Mini.Q3_K_S.gguf
Safe
3.49 GB
LFS
9cdc74c2afffd213a0b4f70b2f91847d7be802032feb96204537ce0525eaf6c2
about 1 month ago
Meraj-Mini.Q4_K_M.gguf
Safe
4.68 GB
LFS
56471b069839242057fae32412f82b236cd1d3e3ac1e78398b28b3dac2822ef8
about 1 month ago
Meraj-Mini.Q4_K_S.gguf
Safe
4.46 GB
LFS
ddff462a12f18626b2d062bcd1dea0c71953bd9fa88dae12ef96fab3116271fa
about 1 month ago
Meraj-Mini.Q5_K_M.gguf
Safe
5.45 GB
LFS
eb8f9e183ece3fe8a1b3b81cbf1a3408ab8a36f82792539beeec1ba60e5069c2
about 1 month ago
Meraj-Mini.Q5_K_S.gguf
Safe
5.32 GB
LFS
bab3208a94458b1eea71a286e2f27a0be5d2bc8972478902b585e2f914c181b8
about 1 month ago
Meraj-Mini.Q6_K.gguf
Safe
6.25 GB
LFS
ca0560f84790b192e340ea8f64afae802c6e1ebe3999bc774dac8123c5fe7db1
about 1 month ago
Meraj-Mini.Q8_0.gguf
Safe
8.1 GB
LFS
34a90e051fdb5961002446ce7a8dc1a76c37c1925d8a03bf8d2c2e73aae0b00f
about 1 month ago
Meraj-Mini.fp16.gguf
Safe
15.2 GB
LFS
5cbd69d3212b4c1c5c6c5b5a3fb30bfd38fa32d8b18c8ed799c327a268c03189
about 1 month ago
