Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
YukiTomita-CC
/
Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja
like
0
GGUF
Inference Endpoints
imatrix
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja
1 contributor
History:
24 commits
YukiTomita-CC
Upload imatrix.dat
3697597
verified
4 months ago
.gitattributes
Safe
3.34 kB
Upload imatrix.dat
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ1_M.gguf
Safe
2.16 GB
LFS
Upload a model quantized as IQ1_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ1_S.gguf
Safe
2.02 GB
LFS
Upload a model quantized as IQ1_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ2_M.gguf
Safe
2.95 GB
LFS
Upload a model quantized as IQ2_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ2_S.gguf
Safe
2.76 GB
LFS
Upload a model quantized as IQ2_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ2_XS.gguf
Safe
2.61 GB
LFS
Upload a model quantized as IQ2_XS
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ2_XXS.gguf
Safe
2.4 GB
LFS
Upload a model quantized as IQ2_XXS
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ3_M.gguf
Safe
3.78 GB
LFS
Upload a model quantized as IQ3_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ3_S.gguf
Safe
3.68 GB
LFS
Upload a model quantized as IQ3_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ3_XS.gguf
Safe
3.52 GB
LFS
Upload a model quantized as IQ3_XS
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ3_XXS.gguf
Safe
3.27 GB
LFS
Upload a model quantized as IQ3_XXS
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ4_NL.gguf
Safe
4.68 GB
LFS
Upload a model quantized as IQ4_NL
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.IQ4_XS.gguf
Safe
4.45 GB
LFS
Upload a model quantized as IQ4_XS
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q2_K.gguf
Safe
3.18 GB
LFS
Upload a model quantized as Q2_K
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q2_K_S.gguf
Safe
2.99 GB
LFS
Upload a model quantized as Q2_K_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q3_K_L.gguf
Safe
4.32 GB
LFS
Upload a model quantized as Q3_K_L
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q3_K_M.gguf
Safe
4.02 GB
LFS
Upload a model quantized as Q3_K_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q3_K_S.gguf
Safe
3.66 GB
LFS
Upload a model quantized as Q3_K_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q4_K_M.gguf
Safe
4.92 GB
LFS
Upload a model quantized as Q4_K_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q4_K_S.gguf
Safe
4.69 GB
LFS
Upload a model quantized as Q4_K_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q5_K_M.gguf
Safe
5.73 GB
LFS
Upload a model quantized as Q5_K_M
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q5_K_S.gguf
Safe
5.6 GB
LFS
Upload a model quantized as Q5_K_S
4 months ago
Llama-3-Swallow-8B-Instruct-v0.1.Q6_K.gguf
Safe
6.6 GB
LFS
Upload a model quantized as Q6_K
4 months ago
imatrix.dat
Safe
4.99 MB
LFS
Upload imatrix.dat
4 months ago
