region:us
# Note
> some rm data from public dataset

- format
```json
{
    "history": [
        ["query1", "answer1"],
        ["query2", "answer2"]
    ],
    "prompt": "query",
    "input": "input for query",
    "output": [
        "output rank1",
        "output rank2",
        "output rank3"
    ]
}
```

Thanks 
- [beyond/rlhf-reward-single-round-trans_chinese](https://huggingface.co/datasets/beyond/rlhf-reward-single-round-trans_chinese) : 
- [dikw/hh_rlhf_cn](https://huggingface.co/datasets/dikw/hh_rlhf_cn)
- [liyucheng/zhihu_rlhf_3k](https://huggingface.co/datasets/liyucheng/zhihu_rlhf_3k)