Hugging Face's logo

ek826
/
Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2

Text Generation
Transformers
Safetensors
PyTorch
8 languages
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2
  • 1 contributor
 History: 2 commits
ek826's picture
ek826
new 4.5bpw with 8 heads gqa
85731ee verified