neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • Updated 18 days ago • 2.16k • 4
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated 28 days ago • 1.4k • 3
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated 27 days ago • 14.3k • 11
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated 27 days ago • 55.9k • 25
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • Updated 27 days ago • 3.74k • 12
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortext-v1 Text Generation • Updated 7 days ago • 82 • 2
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortext-v2 Text Generation • Updated 5 days ago • 39 • 2
ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortext-v3 Text Generation • Updated 5 days ago • 126 • 2