task_categories:text-classification size_categories:10K<n<100K language:pt language:en license:apache-2.0 toxicity harm region:us
---
license: apache-2.0
task_categories:
- text-classification
language:
- pt
- en
tags:
- toxicity
- harm
pretty_name: Toxic-Aira Dataset
size_categories:
- 10K<n<100K
dataset_info:
  features:
  - name: non_toxic_response
    dtype: string
  - name: toxic_response
    dtype: string
  splits:
  - name: portuguese
    num_bytes: 5544823
    num_examples: 16730
  - name: english
    num_bytes: 19577715
    num_examples: 41843
  download_size: 14914871
  dataset_size: 25122538
---
# Dataset (`Toxic-Aira Dataset`)

### Overview

This dataset contains a collection of texts containing harmful/toxic and harmless/non-toxic conversations and messages. All demonstrations are separated into two classes (`non_toxic_response` and `toxic_response`). This dataset was created from the Anthropic [helpful-harmless-RLHF](https://huggingface.co/datasets/Anthropic/hh-rlhf) dataset, the AllenAI [prosocial-dialog](https://huggingface.co/datasets/allenai/prosocial-dialog) dataset, the [real-toxicity-prompts](https://huggingface.co/datasets/allenai/real-toxicity-prompts) dataset (also from AllenAI), and the [Toxic Comment Classification](https://github.com/tianqwang/Toxic-Comment-Classification-Challenge) dataset.

The Portuguese version has translated copies from the above mentioned datasets ([helpful-harmless-RLHF](https://huggingface.co/datasets/Anthropic/hh-rlhf), [prosocial-dialog](https://huggingface.co/datasets/allenai/prosocial-dialog), [real-toxicity-prompts](https://huggingface.co/datasets/allenai/real-toxicity-prompts)), plus the [hatecheck-portuguese](https://huggingface.co/datasets/Paul/hatecheck-portuguese) and [told-br](https://huggingface.co/datasets/told-br) datasets.

### Dataset Details

-   **Dataset Name:** Toxic-Aira Dataset
-   **Language:** Portuguese and English
-   **Total Size:** Over 40,000 demonstrations (Portuguese 16,730, English 41,843)
-   **Sources:**
    -   Anthropic [helpful-harmless-RLHF](https://huggingface.co/datasets/Anthropic/hh-rlhf) dataset.
    -   AllenAI [prosocial-dialog](https://huggingface.co/datasets/allenai/prosocial-dialog) dataset.
    -   AllenAI [real-toxicity-prompts](https://huggingface.co/datasets/allenai/real-toxicity-prompts) dataset.
    -   The [Toxic Comment Classification](https://github.com/tianqwang/Toxic-Comment-Classification-Challenge).dataset.
    -   The [hatecheck-portuguese](https://huggingface.co/datasets/Paul/hatecheck-portuguese) dataset.
    -   The [told-br](https://huggingface.co/datasets/told-br) dataset.

### Contents

⚠️ THE EXAMPLES IN THIS DATASET CONTAIN TOXIC/OFFENSIVE LANGUAGE ⚠️

The dataset consists of data frames with the following columns:

- **non_toxic_response:** Text that was evaluated as non-toxic.
- **toxic_response:** Text evaluated as toxic.

```python
{
"non_toxic_response": "I prefer to see it as the study of change.",
"toxic_response":"So to my secret santa in the words of Jessie Pinkman, THANKS BITCH",
}

```

All demonstrations of examples are less than 350 tokens (measured using the `BERT` tokenizer).

### Use Cases

`Toxic-Aira Dataset` can be utilized to train models to detect harmful/toxic text.

## How to use

Available splits are `portuguese` and `english`.

```python

from datasets import load_dataset

dataset = load_dataset("nicholasKluge/toxic-aira-dataset")

```

### Dataset License

The `Toxic-Aira Dataset` is licensed under the Apache License, Version 2.0. See the [LICENSE](LICENSE) file for more details.

### Disclaimer

This dataset is provided as is, without any warranty or guarantee of its accuracy or suitability for any purpose. The creators and contributors of this dataset are not liable for any damages or losses arising from its use. Please review and comply with the licenses and terms of the original datasets before use.