Quantized mamba-2.8b models using recent versions of llama.cpp.
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Base model