Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-Smaug-8B-GGUF
like
4
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
conversational
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
09869af
Llama-3-Smaug-8B-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
fa098bfada8532d5b199bb2d61e8630d376c2f511c981f0b83fe5e23553620ae
09869af
verified
7 months ago
.gitattributes
2.04 kB
fa098bfada8532d5b199bb2d61e8630d376c2f511c981f0b83fe5e23553620ae
7 months ago
Llama-3-Smaug-8B.IQ3_XS.gguf
3.52 GB
LFS
57d481cb839ad5871f4dd8c8e58a2c019011ca7bd1a39bcfecde141e42fc4fb0
7 months ago
Llama-3-Smaug-8B.IQ4_XS.gguf
4.48 GB
LFS
808aa969f5c8129deb8ef63dfc41cb09163d5c4d42c5e5f681230065be7724ba
7 months ago
Llama-3-Smaug-8B.Q2_K.gguf
3.18 GB
LFS
8e786cd83a34faad8ec3ac0d1bd475ec82832627eadd1a66dc6c756c94eecc39
7 months ago
Llama-3-Smaug-8B.Q3_K_L.gguf
4.32 GB
LFS
98291d8ab1abe96f8b1939e006aa3883dffa622a3f04ce7cd94350488c805de1
7 months ago
Llama-3-Smaug-8B.Q3_K_M.gguf
4.02 GB
LFS
7a062b9c6f159c3a0f5718582c54b383fe436bfd862e318cc2e2c3d3d8d2bc3c
7 months ago
Llama-3-Smaug-8B.Q3_K_S.gguf
3.67 GB
LFS
1ca3d8a5086e71a726b3a317584461276a879233a0868ca55bf27d34451ed8bf
7 months ago
Llama-3-Smaug-8B.Q4_K_M.gguf
4.92 GB
LFS
7566ba13b6096752485e75d6fef6d7cbd9d658ce5166ff9619539ffdec2180ed
7 months ago
Llama-3-Smaug-8B.Q4_K_S.gguf
4.69 GB
LFS
fa098bfada8532d5b199bb2d61e8630d376c2f511c981f0b83fe5e23553620ae
7 months ago
