task_categories:text-generation task_categories:conversational size_categories:100K<n<1M language:en region:us
---
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: input
    dtype: string
  - name: output
    dtype: string
  - name: text
    dtype: string
  splits:
  - name: train
    num_bytes: 693502500.8465096
    num_examples: 399050
  - name: test
    num_bytes: 173376494.1534904
    num_examples: 99763
  download_size: 369952246
  dataset_size: 866878995.0
task_categories:
- text-generation
- conversational
language:
- en
size_categories:
- 100K<n<1M
---

# Dataset Card for "open-instruct-v1"

Open Instruct V1 is an amalgamation of different datasets which are cleaned and then collated into a singular format for training.
Uses Stability AI's System Prompt.
```
### System: StableLM Tuned (Alpha version)
- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.
- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
- StableLM is more than just an information source, StableLM is also able to write poetry, short stories, and make jokes.
- StableLM will refuse to participate in anything that could harm a human.
```

## Dataset Breakdown

| Dataset        | Amount of Samples |
|----------------|-------------------|
| [Alpaca](https://github.com/tatsu-lab/stanford_alpaca) |         51759 |
| [Self Instruct](https://github.com/yizhongw/self-instruct)  |  82599 |
| [GPT-4 Instruct](https://github.com/teknium1/GPTeacher) |  18194 |
| [Code Alpaca](https://huggingface.co/datasets/HuggingFaceH4/CodeAlpaca_20K) | 18019 |
| [Dolly](https://huggingface.co/datasets/HuggingFaceH4/databricks_dolly_15k) | 15015 |
| [Synthetic](https://huggingface.co/datasets/Dahoas/synthetic-instruct-gptj-pairwise)      |  33143 |
| [Roleplay](https://github.com/teknium1/GPTeacher)       |   3146 |
| [asss](https://huggingface.co/datasets/HuggingFaceH4/asss) | 448 |
| [instruction-dataset](https://huggingface.co/datasets/HuggingFaceH4/instruction-dataset) | 327 |
| [Human assistant deduped](https://huggingface.co/datasets/Isotonic/human_assistant_conversation_deduped) | 209350
| Total          | 432000            |