size_categories:10K<n<100K language:en human-feedback comparison rlhf dpo preference pairwise arxiv:2009.03300 region:us
---
language:
- en
size_categories:
- 10K<n<100K
tags:
- human-feedback
- comparison
- rlhf
- dpo
- preference
- pairwise
---
[MMLU Github](https://github.com/hendrycks/test)

Only used the auxiliary test set. I have not checked for similarity or contamination, but it's something I need to figure out soon.

Has randomized starting messages indicating it's a multiple choice question, and the response needs to be a single letter. For the rejected response I randomly chose an incorrect answer, or randomly chose any answer written out fully and not just a single letter.

This was done to hopefully teach a model how to properly follow the task of answering a multiple choice question, with a restraint of *only* providing a single letter answer, and do so correctly on a quality set.

# Paper: [Measuring Massive Multitask Language Understanding](https://arxiv.org/abs/2009.03300)
```
@article{hendryckstest2021,
  title={Measuring Massive Multitask Language Understanding},
  author={Dan Hendrycks and Collin Burns and Steven Basart and Andy Zou and Mantas Mazeika and Dawn Song and Jacob Steinhardt},
  journal={Proceedings of the International Conference on Learning Representations (ICLR)},
  year={2021}
}

@article{hendrycks2021ethics,
  title={Aligning AI With Shared Human Values},
  author={Dan Hendrycks and Collin Burns and Steven Basart and Andrew Critch and Jerry Li and Dawn Song and Jacob Steinhardt},
  journal={Proceedings of the International Conference on Learning Representations (ICLR)},
  year={2021}
}
```