Llama-3.1 Quantization Collection Neural Magic quantized Llama-3.1 models • 21 items • Updated 5 days ago • 28
FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 37 items • Updated 3 days ago • 49
