license:cc0-1.0 region:us
---
license: cc0-1.0
---

## A cleaned up version of train dataset from kaggle, the *Toxic Comment Classification Challenge*

https://www.kaggle.com/competitions/jigsaw-toxic-comment-classification-challenge

https://www.kaggle.com/competitions/jigsaw-toxic-comment-classification-challenge/data?select=train.csv.zip

the `alt_format` directory contains an alternate format intended for a tutorial.

<img src="https://huggingface.co/datasets/vluz/Tox/resolve/main/images/datasetwc.jpg" width=70% height=70%>

<hr>

What was done:
- Removed extra spaces and new lines
- Removed non-printing characters
- Removed punctuation except apostrophe
- Removed html tags and web links
- Removed numbers
- Converted to lower case

<hr>

`alt_format/train.csv` used as training set for Tox example here: 

https://huggingface.co/spaces/vluz/Tox

https://huggingface.co/vluz/toxmodel20

https://huggingface.co/vluz/toxmodel30

https://github.com/vluz/ToxTest

