task_categories:text-generation task_categories:question-answering size_categories:10K<n<100K language:it RLHF preferences RL human feedback reddit region:us
---
task_categories:
- text-generation
- question-answering
language:
- it
tags:
- RLHF
- preferences
- RL
- human feedback
- reddit
size_categories:
- 10K<n<100K
---
# 🚢  Stanford Human Preferences Dataset (SHP) (Italian Translation)

The Stanford Human Preferences Dataset (SHP) is a collection of responses to questions and instructions in 18 different subject areas, ranging from cooking to legal advice. This version of the dataset is a **partial** Italian translation of the original English dataset.

Please note that the quality of the translations has not been verified. However, the dataset may still be useful for training models.

Each example in the dataset consists of a Reddit post that includes a question or instruction and a pair of top-level comments. The comments are ranked according to their perceived helpfulness by Reddit users. SHP uses the fact that if comment A has a higher score than comment B despite being written after B, then A is considered more preferred.

The preference labels in the dataset reflect the helpfulness of a response, rather than identifying harmful responses. This approach differs from previous work that focused on identifying harmful responses.