1. **HellaSwag**(Zellers et al., 2019) and **HellaSwag DE**: An English commonsense reasoning benchmark composed of multiple-choice questions that are deliberately designed to confuse language models. HellaSwag DE is a German translation of the HellaSwag benchmark. 2. **AI2 Reasoning Challenge (ARC)**(Clark et al., 2018): An English commonsense reasoning benchmark composed of science examination questions in multiple-choice format. The \(7,787\) total questions have been divided into an easy subset with \(5,197\) questions and a hard subset with \(2,590\) questions. ARC-c DE is a German translation of the challenge subset of questions. 3. **BoolQ**(Clark et al., 2019): An English reading comprehension benchmark composed of \(15,942\) yes/no question-answering samples. Each example is split into a question, relevant paragraph, and the solution. 4. **MathQA**(Amini et al., 2019): An English math word problem benchmark composed of multiple-choice questions across various areas of mathematics. 5. **MMLU**(Hendrycks et al., 2021) and **MMLU-DE**: An English benchmark designed to evaluate both zero-shot and few-shot scenarios, in order to evaluate both the general knowledge and on-the-fly problem solving of the model under test. MMLU covers a broad range of subjects. MMLU-DE is a German translation of the MMLU question set, which was translated by the OpenAI GPT 3.5 API. 6. **OpenBookQA (OBQA)**(Mihaylov et al., 2018): An English question-answering benchmark modeled after real-world open-book exams for assessing human understanding of a particular subject. Questions about elementary science are paired with scientific facts and common knowledge, which the model is intended to use in multi-hop reasoning. 7. **PIQA**(Bisk et al., 2019): An English question-answering benchmark designed to test the physical commonsense reasoning abilities of the model. Most questions focus on applying uncommon solutions to everyday situations, which requires understanding of the physical world. 8. **WinoGrande**(Sakaguchi et al., 2019): An English natural language understanding benchmark that involves determining when two or more expressions in a text refer to the same entity. The benchmark includes a diverse set of sentences and a new evaluation metric that rewards models for making human-like predictions. 9. **TruthfulQA** and **TruthfulQA DE**(Lin et al., 2022): An English question-answering benchmark designed to evaluate the truthfulness of generated answers to questions. The questions are designed to contain common human misunderstandings that lead to incorrect answers. TruthfulQA DE is a German translation of the TruthfulQA benchmark. 10. **Natural Questions**(Kwiatkowski et al., 2019): Is an English question-answering benchmark consisting of search queries submitted to the Google search engine. 11. **TriviaQA**(Joshi et al., 2017): Is an English question-answering benchmark comprised of question-answer pairs provided by trivia enthusiasts. Its main focus is to determine a model's general world knowledge.