README.md exists but content is empty. Use the Edit model card button to edit it.

GGUF

Model size

7.24B params

Architecture

llama

5-bit

6-bit

Inference API

Inference API (serverless) does not yet support llama.cpp models for this pipeline type.