task_categories:question-answering task_categories:text-generation size_categories:100M<n<1B language:zh language:en license:apache-2.0 reward model rlhf arxiv:2204.05862 region:us
@dataset{rlhf_reward_dataset,
  author       = {Xing Tian},
  title        = {rlhf_reward_dataset},
  month        = sep,
  year         = 2023,
  publisher    = {Xing Tian},
  version      = {1.0},
}
---
license: apache-2.0
task_categories:
- question-answering
- text-generation
language:
- zh
- en
tags:
- reward model
- rlhf
size_categories:
- 100M<n<1B
---
## RLHF Reward Model Dataset

奖励模型数据集。

数据集从网上收集整理如下:
| 数据 | 语言 | 原始数据/项目地址 | 样本个数 | 原始数据描述 | 替代数据下载地址 |
| :--- | :---: |     :---:      |   :---: |   :---:    |     :---:     |
| beyond | chinese | [beyond/rlhf-reward-single-round-trans_chinese](https://huggingface.co/datasets/beyond/rlhf-reward-single-round-trans_chinese) | 24858 |  |  |
| helpful_and_harmless | chinese | [dikw/hh_rlhf_cn](https://huggingface.co/datasets/dikw/hh_rlhf_cn) | harmless train 42394 条，harmless test 2304 条，helpful train 43722 条，helpful test 2346 条， | 基于 Anthropic 论文 [Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback](https://arxiv.org/abs/2204.05862) 开源的 helpful 和harmless 数据，使用翻译工具进行了翻译。 | [Anthropic/hh-rlhf](https://huggingface.co/datasets/Anthropic/hh-rlhf) |
| zhihu_3k | chinese | [liyucheng/zhihu_rlhf_3k](https://huggingface.co/datasets/liyucheng/zhihu_rlhf_3k) | 3460 | 知乎上的问答有用户的点赞数量，它应该是根据点赞数量来判断答案的优先级。 |  |
| SHP | english | [stanfordnlp/SHP](https://huggingface.co/datasets/stanfordnlp/SHP) | 385K | 涉及18个子领域，偏好表示是否有帮助。 |  |


<details>
<summary>参考的数据来源,展开查看</summary>
<pre><code>
https://huggingface.co/datasets/ticoAg/rlhf_zh
https://huggingface.co/datasets/beyond/rlhf-reward-single-round-trans_chinese
https://huggingface.co/datasets/dikw/hh_rlhf_cn
https://huggingface.co/datasets/liyucheng/zhihu_rlhf_3k


</code></pre>
</details>
