amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation
•
Updated
•
10
Quark Quantized ONNX LLMs for Ryzen AI 1.3 EA
ONNX Runtime generate() API based models quantized by Quark and optimized for Ryzen AI Strix Point NPU
-
-
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Updated • 8 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 12 -
amd/Meta-Llama-3-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 4 -
amd/Llama2-7b-chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 7 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 32 • 1 -
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 56 • 1 -
amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 14 • 1