license:apache-2.0 region:us
---
license: apache-2.0
---

We release instruction corpora with 8M examples for training a small ChatGPT, naming HugChat. 

How to use this data for training:

- download the corpora, and unzip;
- clone the HugNLP library: https://github.com/wjn1996/HugNLP
```
git clone https://github.com/wjn1996/HugNLP.git
```
- Put the corpora into user-defined path, and perform:
```
bash ./application/instruction_prompting/instruction_tuning/run_causal_instruction.sh
```

More details can be found in the HugNLP documents: [HugNLP: Generative Instruction-tuning](https://github.com/wjn1996/HugNLP/blob/main/documents/instruction_prompting/generative_instruction_tuning.md)