neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated 28 days ago • 34.1k • 25
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated 15 days ago • 26.1k • 21
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated 15 days ago • 5.4k • 8
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • Updated 28 days ago • 3.7k • 12
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • Updated 20 days ago • 390 • 14
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • Updated 28 days ago • 960 • 2
neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • Updated 20 days ago • 2.13k • 4
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated 28 days ago • 13.9k • 11
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated 15 days ago • 9.34k • 11
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated 29 days ago • 1.46k • 3
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • Updated 29 days ago • 490 • 2