File size: 417 Bytes
904fdb1
e7d54dd
 
 
 
 
 
 
 
 
 
904fdb1
e7d54dd
 
 
 
904fdb1
e7d54dd
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---

language:
  - en
  - fr
  - de
  - es
  - it
  - pt
  - ru
  - zh
  - ja
license: apache-2.0
base_model: mistralai/Mistral-Nemo-Instruct-2407
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---


4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407).