Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
CarrotAI
/
Llama3-Ko-Carrot-8B-it-gguf
like
1
Text Generation
GGUF
Korean
English
llama-cpp
gguf-my-repo
Inference Endpoints
conversational
License:
llama3
Model card
Files
Files and versions
Community
Deploy
Use this model
Edit model card
CarrotAI/Llama3-Carrot-8B-IT-GGUF
CarrotAI/Llama3-Carrot-8B-IT-GGUF
Downloads last month
38
GGUF
Model size
8.03B params
Architecture
llama
4-bit
Q4_K_M
8-bit
Q8_0
Inference Examples
Text Generation
Unable to determine this model's library. Check the
docs
.
Model tree for
CarrotAI/Llama3-Ko-Carrot-8B-it-gguf
Base model
CarrotAI/Llama3-Ko-Carrot-8B-it
Quantized
(
1
)
this model
Collection including
CarrotAI/Llama3-Ko-Carrot-8B-it-gguf
GGUF
Collection
GGUF
•
4 items
•
Updated
Jul 4