Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Meraj-Mini-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
68fb55d
Meraj-Mini-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
ddff462a12f18626b2d062bcd1dea0c71953bd9fa88dae12ef96fab3116271fa
68fb55d
verified
about 1 month ago
.gitattributes
2.17 kB
ddff462a12f18626b2d062bcd1dea0c71953bd9fa88dae12ef96fab3116271fa
about 1 month ago
Meraj-Mini-GGUF_imatrix.dat
4.54 MB
LFS
db92885a03ab27f17ae898e420b11cce80bcc8871192ed7d932442e2ca911c5c
about 1 month ago
Meraj-Mini.IQ1_M.gguf
2.04 GB
LFS
db92885a03ab27f17ae898e420b11cce80bcc8871192ed7d932442e2ca911c5c
about 1 month ago
Meraj-Mini.IQ2_XS.gguf
2.47 GB
LFS
b27e7a6fddecd99c17b01ba04b59a7147185d2576d3eddf2c349e5224390e0d2
about 1 month ago
Meraj-Mini.IQ3_XS.gguf
3.35 GB
LFS
cfa1e568f76012586b473aedfa63b0f49767e0f3eb89d6954bd19631eb65407d
about 1 month ago
Meraj-Mini.IQ4_XS.gguf
4.22 GB
LFS
eecec9431ea7e257f9983a65d10a16d889d3996fd698830849e9531203629991
about 1 month ago
Meraj-Mini.Q2_K.gguf
3.02 GB
LFS
9368b99cc87038260ebdd1877e2220aab86d89f12b5280e1b53abf157d960032
about 1 month ago
Meraj-Mini.Q3_K_L.gguf
4.09 GB
LFS
76395e683af48ffd0a6c9fcd6d67896812f63524d94b5d3ca1c0783a60d1371f
about 1 month ago
Meraj-Mini.Q3_K_M.gguf
3.81 GB
LFS
2544111670e309c8f1c907a7c3ab1dc29c890ebc12a34dc49a5b0887a0a4d2d7
about 1 month ago
Meraj-Mini.Q3_K_S.gguf
3.49 GB
LFS
9cdc74c2afffd213a0b4f70b2f91847d7be802032feb96204537ce0525eaf6c2
about 1 month ago
Meraj-Mini.Q4_K_M.gguf
4.68 GB
LFS
56471b069839242057fae32412f82b236cd1d3e3ac1e78398b28b3dac2822ef8
about 1 month ago
Meraj-Mini.Q4_K_S.gguf
4.46 GB
LFS
ddff462a12f18626b2d062bcd1dea0c71953bd9fa88dae12ef96fab3116271fa
about 1 month ago