license:other region:us
---
license: other
---

A continuation (including many fixes) of [gpt4-1.3](https://huggingface.co/datasets/jondurbin/airoboros-gpt4-1.3), with:
* fixed (+ more examples of) multi-character, multi-turn conversations
* coding examples in 10 languages from [rosettacode.org](https://rosettacode.org/) [dataset](https://huggingface.co/datasets/jondurbin/rosettacode-10) thanks to Mike aka kryptkpr: https://huggingface.co/datasets/mike-ravkine/rosettacode-parsed
* more roleplay examples
* jokes

_*Note: I did not filter by token length for this dataset, some are well over 2048 so use carefully.*_

### License and usage

This is a real gray area, here's why:

- the dataset was generated with gpt-4, via https://github.com/jondurbin/airoboros
- the ToS for openai API usage has a clause preventing the output from being used to train a model that __competes__ with OpenAI
  - what does *compete* actually mean here, and can an open source model really compete in any meaniningful way with gpt-4 quality?
  - I am bound by the ToS, but anyone else using the data is not as far as I can tell
- the training data used in essentially all large language models includes a significant of copyrighted or otherwise unallowable licensing in the first place
- other work using the self-instruct method, e.g. the original here: https://github.com/yizhongw/self-instruct released the data and model as apache-2

I am purposingly not placing a license on here because I am not a lawyer and refuse to attempt to interpret all of the terms accordingly.
Your best bet is probably to avoid using this to train a commercial model, but I will leave that up to you.

I personally don't care how you use this data - it is published to allow others to replicate results, but wouldn't mind some attribution if you do use it.