Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-405B-FP8

Text Generation
Transformers
Safetensors
llama
fp8
vllm
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
Meta-Llama-3.1-405B-FP8
  • 3 contributors
 History: 7 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
e6569ff verified