license:cc-by-nc-4.0 region:us
---
license: cc-by-nc-4.0
---

The data was generated by gpt-4, and therefore is subject to OpenAI ToS.  The tool used to generate the data [airoboros](https://github.com/jondurbin/airoboros) is apache-2.

Specific areas of focus for this training data:
* trivia
* math
* nonsensical math
* coding
* closed context question answering
* closed context question answering, with multiple contexts to choose from as confounding factors
* writing
* multiple choice

This is largely an overlap of the original [dataset](https://huggingface.co/datasets/jondurbin/airoboros-gpt4), but with a few extras:
* fixed contextual entries that were missing closing tags (e.g. "ENDINPUT", "ENDINSTRUCTION", etc.)
* fixed an issue where source information was provided, even if not asked (the model always tried to provide source info)
* added some questions that were unrelated to the provided context, to train the model to say when it can't provide an answer
* added several new contexual instructions, including some with FAQ style to hopefully prevent questions in the context from breaking the inference
* hundreds more coding samples, focusing primarily on python, java, javascript, c/c++, and golang

### Usage and License Notices

All airoboros models and datasets are intended and licensed for research use only.  I've used the 'cc-nc-4.0' license, but really it is subject to a custom/special license because:

- the base model is LLaMa, which has it's own special research license
- the dataset(s) were generated with OpenAI (gpt-4 and/or gpt-3.5-turbo), which has a clausing saying the data can't be used to create models to compete with openai

So, to reiterate: this model (and datasets) cannot be used commercially.