MiniCPM-V-2_6-GGUF / README.md
AI-Engine's picture
Update README.md
e157104 verified
---
license: other
license_name: minicpm-model-license
license_link: https://github.com/OpenBMB/MiniCPM/blob/main/MiniCPM%20Model%20License.md
base_model:
- openbmb/MiniCPM-V-2_6
pipeline_tag: image-text-to-text
tags:
- vision
---
GGUF [llama.cpp](https://github.com/ggerganov/llama.cpp) quantized version of:
- Original model: [MiniCPM-V-2_6](https://huggingface.co/openbmb/MiniCPM-V-2_6)
- Model creator: [OpenBMB](https://huggingface.co/openbmb)
- [License](https://github.com/OpenBMB/MiniCPM/blob/main/MiniCPM%20Model%20License.md)
## Recommended Prompt Format (ChatML)
```
<|im_start|>system
Provide some context and/or instructions to the model.<|im_end|>
<|im_start|>user
The user’s message goes here<|im_end|>
<|im_start|>assistant
AI message goes here<|im_end|>
```
Quant Version: [b3933](https://github.com/ggerganov/llama.cpp/releases/tag/b3933) with [imatrix](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)