INT8 LLMs for vLLM
Collection
Accurate INT8 quantized models by Neural Magic, ready for use with vLLM!
•
49 items
•
Updated
•
7
README.md exists but content is empty.
Use the Edit model card button to edit it.
- Downloads last month
- 12
Inference API (serverless) is not available, repository is disabled.