Llama-3.1 Quantization Collection Neural Magic quantized Llama-3.1 models • 22 items • Updated 3 days ago • 39
FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17 • 58
