---
language:
  - en
  - fr
  - de
  - es
  - it
  - pt
  - ru
  - zh
  - ja
license: apache-2.0
base_model: mistralai/Mistral-Nemo-Instruct-2407
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---

4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407).