arxiv:2001.07487 region:us
---
dataset_info:
  features:
  - name: text
    dtype: string
  - name: sexual
    dtype: float64
  - name: hate
    dtype: float64
  - name: violence
    dtype: float64
  - name: self-harm
    dtype: float64
  - name: sexual/minors
    dtype: float64
  - name: hate/threatening
    dtype: float64
  - name: violence/graphic
    dtype: float64
  splits:
  - name: train
    num_bytes: 23614214277
    num_examples: 114647404
  download_size: 14061193653
  dataset_size: 23614214277
---
# Dataset Card for "kjj0/4chanpol-openaimod"

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by [Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board](https://arxiv.org/abs/2001.07487).
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We have also provided OpenAI moderation scores. A variant without these scores can be found at [kjj0/4chanpol](https://huggingface.co/datasets/kjj0/4chanpol).

```
@inproceedings{papasavva2020raiders,
  title={Raiders of the lost kek: 3.5 years of augmented 4chan posts from the politically incorrect board},
  author={Papasavva, Antonis and Zannettou, Savvas and De Cristofaro, Emiliano and Stringhini, Gianluca and Blackburn, Jeremy},
  booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
  volume={14},
  pages={885--894},
  year={2020}
}
```