task_categories:text-generation size_categories:1K<n<10K language:en license:mit human-feedback rlhf region:us
---
license: mit
task_categories:
- text-generation
language:
- en
pretty_name: Social Reasoning RLHF
size_categories:
- 1K<n<10K
tags:
- human-feedback
- rlhf
---

## Dataset Summary

This repository provides access to a social reasoning dataset that aims to provide signal to how humans navigate social situations, how they reason about them and how they understand each other. It contains questions probing people's thinking and understanding of various social situations.

This dataset was created by collating a set of questions within the following social reasoning tasks:
* understanding of emotions
* intent recognition
* social norms
* social responsibility
* reading of social cues
* perspective taking
* conflict resolution
* ethics
* moral judgement
* communication skills
* negotiation strategies
* understanding of empathy
* understanding of compassion
* understanding of trust
* understanding and use of humour
* showing kindness
* navigating diversity and cultural differences
* use of figurative language
* self-awareness

We asked a group of participants to provide their responses to the given questions, then we asked another group of participants to rate their responses in a pairwise comparison setting. The format of the dataset is as following:

```json
{
  "question": "Question",
  "chosen": "The chosen response",
  "rejected": "The rejected response"
}
```

## Disclaimer

The guidelines encouraged participants to provide respectful, empathetic and inclusive responses, however the dataset may still contain responses that some may find offensive or upsetting.

## Usage

```python
from datasets import load_dataset

dataset = load_dataset("ProlificAI/social-reasoning-rlhf")
```

## About Prolific

Robust AI is built on high-quality human data. [Prolific](https://www.prolific.com/) makes it easy to get honest, accurate feedback on your models, from our balanced and vetted pool of taskers.

### Contact

Got any questions? Email ai@prolific.co