neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
•
Updated
•
35.8k
•
24
Llama-3.1 Quantization
Neural Magic quantized Llama-3.1 models
-
-
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation • Updated • 70.7k • 15 -
neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • Updated • 34.9k • 25 -
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • Updated • 11.4k • 19 -
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • Updated • 4.43k • 7 -
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • Updated • 6.96k • 8 -
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • Updated • 1.2k • 13 -
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • Updated • 508 • 1 -
neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • Updated • 1.59k • 1 -
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • Updated • 5k • 5 -
neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • Updated • 5.22k • 5 -
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • Updated • 663 • 27 -
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • Updated • 2.73k • 8 -
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • Updated • 647 • 1 -
neuralmagic/Meta-Llama-3.1-8B-FP8
Text Generation • Updated • 2.65k • 5 -
neuralmagic/Meta-Llama-3.1-70B-FP8
Text Generation • Updated • 166 -
neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation • Updated • 102 • 1 -
neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation • Updated • 174 • 1 -
neuralmagic/Meta-Llama-3.1-405B-FP8
Text Generation • Updated • 6 -
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • Updated • 75 • 2