openbmb
/

MiniCPM3-4B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This repo includes the GGUF versions of MiniCPM3-4B:

minicpm3-4b-fp16.gguf
minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month: 6,039

GGUF

Model size

4.07B params

Architecture

minicpm3

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for openbmb/MiniCPM3-4B-GGUF

Base model

openbmb/MiniCPM3-4B

Quantized

(3)

this model

Quantizations

1 model

Collection including openbmb/MiniCPM3-4B-GGUF

MiniCPM

The MiniCPM family of LLMs and VLLMs. • 31 items • Updated about 1 month ago • 54