license:apache-2.0 region:us
---
license: apache-2.0
dataset_info:
  features:
  - name: messages
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  splits:
  - name: train_ift
    num_bytes: 30802170.224582057
    num_examples: 19111
  - name: test_ift
    num_bytes: 3423358.775417942
    num_examples: 2124
  download_size: 18666186
  dataset_size: 34225529.0
---
# Dataset Card for `oasst1_en`

This dataset is a processed version of [OpenAssistant's `oasst1` dataset](https://huggingface.co/datasets/OpenAssistant/oasst1) to:

* Filter all conversations for English.
* Group all conversation trees such that each row in the dataset corresponds to a single conversation.

See the `create_dataset.py` script in this repo for the processing details.

## Splits

| Split | Description | Size | 
| :--- | :--- | :--- |
| `train` | The full training split | 19034 |
| `test` | The full test split | 2115 |