region:us
---
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
dataset_info:
  features:
  - name: question
    dtype: string
  - name: response_j
    dtype: string
  - name: response_k
    dtype: string
  splits:
  - name: train
    num_bytes: 2648404.1478804825
    num_examples: 1000
  - name: test
    num_bytes: 2648404.1478804825
    num_examples: 1000
  download_size: 3061144
  dataset_size: 5296808.295760965
---
# Ministack-preferences

Subset (1000 training samples and 1000 test samples) of the [`lvwerra/stack-exchange-paired`](https://huggingface.co/datasets/lvwerra/stack-exchange-paired) dataset. The original dataset is really heavy and long to process, so hopefully this will help you to try RLHF a little faster.