CarrotAI
/

Llama3-Ko-Carrot-8B-it-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

CarrotAI/Llama3-Carrot-8B-IT-GGUF

Downloads last month: 38

GGUF

Model size

8.03B params

Architecture

llama

4-bit

8-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for CarrotAI/Llama3-Ko-Carrot-8B-it-gguf

Base model

CarrotAI/Llama3-Ko-Carrot-8B-it

Quantized

(1)

this model

Collection including CarrotAI/Llama3-Ko-Carrot-8B-it-gguf

GGUF

GGUF • 4 items • Updated Jul 4