region:us
---
dataset_info:
  features:
  - name: choice0
    dtype: string
  - name: choice1
    dtype: string
  - name: label
    dtype:
      class_label:
        names:
          '0': '0'
          '1': '1'
  splits:
  - name: train
    num_bytes: 56635938
    num_examples: 42537
  - name: test
    num_bytes: 3195756
    num_examples: 2312
  download_size: 33135346
  dataset_size: 59831694
---
# Dataset Card for "anthropic_hh_modified"

Total copy of [Anthropic/hh-rlhf](https://huggingface.co/datasets/Anthropic/hh-rlhf) (all credit and rights to the authors of that), just with some modifications to the format so that it can be used with the [eleuther-elk](https://github.com/EleutherAI/elk/tree/main/elk) repository.

Changes:
- rename column "chosen" to "choice0" and "rejected" to "choice1"
- randomly flip the entry in column choice0 and choice1 for half of the entries
- create a ClassLabel column "label" that stores an integer 0 or 1, corresponding to which of choice0 or choice1 was preferred by the human.

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)