task_categories:conversational task_categories:text-generation size_categories:10K<n<100K language:pt language:en license:apache-2.0 alignment instruction chat region:us
---
license: apache-2.0
task_categories:
- conversational
- text-generation
language:
- pt
- en
tags:
- alignment
- instruction
- chat
pretty_name: Instruct-Aira Dataset
size_categories:
- 10K<n<100K
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: completion
    dtype: string
  splits:
  - name: portuguese
    num_bytes: 53113297
    num_examples: 41815
  - name: english
    num_bytes: 47263211
    num_examples: 41815
  download_size: 56235150
  dataset_size: 100376508
---
# Dataset (`Instruct-Aira Dataset`)

### Overview

This dataset contains a collection of demonstrations on how to answer questions and follow instructions. We used prompts from the [`synthetic-instruct-gptj-pairwise`](https://huggingface.co/datasets/Dahoas/synthetic-instruct-gptj-pairwise) dataset, the [`databricks_dolly_15k`](https://huggingface.co/datasets/HuggingFaceH4/databricks_dolly_15k) dataset, and the [`instruction-dataset`](https://huggingface.co/datasets/HuggingFaceH4/instruction-dataset) dataset, to create an instruction-tuning dataset, where the completions were generated by already tuned models (ChatGPT, LLama 2, Open-Assistant, etc). The dataset is available in both Portuguese and English.

### Dataset Details

-   **Dataset Name:** Instruct-Aira Dataset
-   **Language:** Portuguese and English
-   **Total Size:** Over 41,000 demonstrations

### Contents

The dataset consists of data frames with the following columns:

-   **Prompt:** The initial text or question provided to the model.
-   **Completion:** The demonstration of a generated completion or response for the given prompt.

```python

{
"prompt":"What is the capital of Brazil?",
"completion": "The capital of Brazil is Brasília."
}

```

All `prompt + completion` examples are less than 400 tokens (measured using the `GPT-2` and `BLOOM` tokenizers).
   
### Use Cases

`Instruct-Aira Dataset` can be utilized for various natural language processing tasks, including but not limited to:

-   Language generation.
-   Question-answering systems.
-   Chatbot development.
-   Evaluation of language models.
-   AI ethics research.
-   Alignment research.

## How to use

Available splits are `english` and `portuguese`.

```python

from datasets import load_dataset

dataset = load_dataset("nicholasKluge/instruct-aira-dataset")

```

### Dataset License

The `Instruct-Aira Dataset` is licensed under the Apache License, Version 2.0. See the [LICENSE](LICENSE) file for more details.

### Disclaimer

This dataset is provided as is, without any warranty or guarantee of its accuracy or suitability for any purpose. The creators and contributors of this dataset are not liable for any damages or losses arising from its use. Please review and comply with the licenses and terms of the original datasets before use.