Severian
/

Jamba-Bagel-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Q6_K Version of the Jamba-Bagel fine-tune: https://huggingface.co/jondurbin/bagel-jamba-v05

(Q4_K_M and Q8 are in the works, just takes a bit to upload)

Can only be used with this fork until the merge is complete: https://github.com/ggerganov/llama.cpp/pull/7531

Downloads last month: 14

GGUF

Model size

51.6B params

Architecture

jamba

6-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including Severian/Jamba-Bagel-GGUF

Jamba GGUF

Current GGUF's conversion of the Jamba models. Will be updated as support in llama.cpp merges/ https://github.com/ggerganov/llama.cpp/pull/7531 • 4 items • Updated May 30 • 2