task_categories:text-classification size_categories:1K<n<10K language:es license:apache-2.0 region:us
---
task_categories:
- text-classification
language:
- es
size_categories:
- 1K<n<10K
license: apache-2.0
---

# Dataset Description

* Example model using the dataset: https://huggingface.co/hackathon-somos-nlp-2023/roberta-base-bne-finetuned-suicide-es
* Example space using the dataset: https://huggingface.co/spaces/hackathon-somos-nlp-2023/suicide-comments-es
* Language: Spanish

## Dataset Summary

The dataset consists of comments on Reddit, Twitter, and inputs/outputs of the Alpaca dataset translated to Spanish language and classified as suicidal ideation/behavior and non-suicidal.

# Dataset Structure

The dataset has 10050 rows (777 considered as Suicidal Ideation/Behavior and 9273 considered Not Suicidal).

## Dataset fields

* `Text`: User comment.
* `Label`: 1 if suicidal ideation/behavior; 0 if not suicidal comment.

# Dataset Creation

## Suicidal Ideation/Behavior

* 90 rows from Columbia Suicide Severity Rating Scale (C-SSRS)
https://zenodo.org/record/2667859#.ZDGnX-xBxYi
C-SSRS is a gold dataset for suicidal comments detection on Reddit.
We use `Helsinki-NLP/opus-mt-en-es` to translate the dataset. We also explode on paragraphs, filter messages less than 240 characters, and we filter the positive ones validating against the [Moderation API of OpenAI](https://platform.openai.com/docs/guides/moderation).
* 519 rows from https://github.com/laxmimerit/twitter-suicidal-intention-dataset/tree/master
The dataset contains the tweet data of suicidal intention and no intention data.
We use `Helsinki-NLP/opus-mt-en-es` to translate the dataset. We filter the positive ones validating against the [Moderation API of OpenAI](https://platform.openai.com/docs/guides/moderation).
* 168 rows added manually from public forums and public blogs.

## Non Suicidal

* 5000 rows from instructions of https://huggingface.co/datasets/somosnlp/somos-clean-alpaca-es 
* 2000 rows from output of https://huggingface.co/datasets/somosnlp/somos-clean-alpaca-es
* 2000 rows from Columbia Suicide Severity Rating Scale (C-SSRS)
* 100 rows from https://huggingface.co/datasets/ziq/depression_advice. We use `Helsinki-NLP/opus-mt-en-es` to translate the dataset.
* 100 rows added manually from public forums, blogs and podcasts.

# Considerations for Using the Data

## Social Impact of Dataset

The dataset could contain some patterns to detect suicidal ideation/behavior.

## Discussion of Biases

No measures have been taken to estimate the bias and toxicity embedded in the dataset. However, the most of the data is collected on Reddit, Twitter, and ChatGPT. So there is probably an age bias because [the Internet is used more by younger people](https://www.statista.com/statistics/272365/age-distribution-of-internet-users-worldwide).

# Additional Information

## Team

* [dariolopez](https://huggingface.co/dariolopez)
* [diegogd](https://huggingface.co/diegogd)

## Licesing

This work is licensed under a [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)

