task_categories:text-classification size_categories:10K<n<100K language:pt language:en license:apache-2.0 reward model instruction alignment region:us
---
license: apache-2.0
task_categories:
- text-classification
language:
- pt
- en
tags:
- reward model
- instruction
- alignment
pretty_name: Reward-Aira Dataset
size_categories:
- 10K<n<100K
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: chosen_response
    dtype: string
  - name: rejected_response
    dtype: string
  splits:
  - name: english
    num_bytes: 53232958
    num_examples: 32675
  - name: portuguese
    num_bytes: 59650447
    num_examples: 32675
  download_size: 65455319
  dataset_size: 112883405
---
# Dataset (`Reward-Aira Dataset`)

### Overview

This dataset contains a collection of prompt + completion examples of LLM following instructions in a conversational manner. All prompts come with two possible completions (one better than the other). The dataset is available in both Portuguese and English languages.

### Dataset Details

-   **Dataset Name:** Reward-Aira Dataset
-   **Language:** Portuguese and English
-   **Total Size:** 32,675 pairs of demonstrations (in Portuguese and English)

### Contents

The dataset consists of data frames with the following columns:

-   **Prompt (`instruction`):** The initial prompt provided to the model.
-   **Completion (`chosen_response`):** A completion to the prompt.
-   **Completion (`rejected_response`):** A worst completion to the prompt.

```python
{
"instruction":"Why is AI Ethics important?",
"chosen_response": "The field of AI Ethics delves deeply into the intricate ethical considerations that arise with respect to AI systems. This includes the role of humanity in creating and deploying these systems, as well as the conduct of machines themselves. Broadly speaking, AI Ethics can be divided into two major categories : concerns surrounding the morality of human actions in relation to creating and using AI, and concerns regarding the moral implications of machine behavior.",
"rejected_response": "Who cares about AI Ethics? It's just a bunch of whining about humans making and using AI and bitching about what the machines do."
}

```

### Use Cases

`Reward-Aira Dataset` can be utilized to train a reward/preference model.

## How to use

Available splits are `portuguese` and `english`.

```python

from datasets import load_dataset

dataset = load_dataset("nicholasKluge/reward-aira-dataset")

```

### Dataset License

The `Reward-Aira Dataset` is licensed under the Apache License, Version 2.0. See the [LICENSE](LICENSE) file for more details.

### Disclaimer

This dataset is provided as is, without any warranty or guarantee of its accuracy or suitability for any purpose. The creators and contributors of this dataset are not liable for any damages or losses arising from its use. Please review and comply with the licenses and terms of the original datasets before use.