Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Meta-Llama-3.1-8B-Instruct-bf16-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
d73444f
Meta-Llama-3.1-8B-Instruct-bf16-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
02b754aacd030f241cfbd87ef8d57e16a8c7149fbf66881488208022033883a4
d73444f
verified
27 days ago
.gitattributes
Safe
2 kB
02b754aacd030f241cfbd87ef8d57e16a8c7149fbf66881488208022033883a4
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16-GGUF_imatrix.dat
4.99 MB
LFS
02b754aacd030f241cfbd87ef8d57e16a8c7149fbf66881488208022033883a4
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16.Q5_K_M.gguf
Safe
5.73 GB
LFS
bd5830d7769e184747b7e05eba7bf9b3e50136d8cd81b41f9643d0d64231c227
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16.Q5_K_S.gguf
Safe
5.6 GB
LFS
4e76d98c1e3679c0070a72224c31962c05c394c2a0587e789c9af2c8ff6b6710
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16.Q6_K.gguf
Safe
6.6 GB
LFS
3556c26b27ac4e66feba92935cff3c632728c545c2cfd33c83d0ed3e61332a0d
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16.Q8_0.gguf
Safe
8.54 GB
LFS
9642cc5f3a0e4382200d494f110553ee0c27afeda73838954036c4b1d053c8c1
27 days ago
Meta-Llama-3.1-8B-Instruct-bf16.fp16.gguf
Safe
16.1 GB
LFS
d3484e854e74cec933cb03b0a9490c694757ac57e4ebcd439313812b8c452e92
27 days ago
README.md
Safe
3.13 kB
02b754aacd030f241cfbd87ef8d57e16a8c7149fbf66881488208022033883a4
27 days ago
