Llamacpp Quantizations of llama-3-Korean-Bllossom-70B(Quantization less than 40GB)
Using llama.cpp release b4048 for quantization.
Original model: https://huggingface.co/Bllossom/llama-3-Korean-Bllossom-70B
- Downloads last month
- 456
Model tree for legenduck/llama-3-Korean-Bllossom-70B-GGUF
Base model
meta-llama/Meta-Llama-3-70B
Finetuned
Bllossom/llama-3-Korean-Bllossom-70B