* **GSM8K**[190] is designed to evaluate the model's ability for multi-step mathematical reasoning. GSM8K includes 8.5K linguistically diverse grade school math word problems written by humans. The dataset is split into two sets: a training set with \(7.5K\) problems, and a test set with \(1\)K problems. These problems need \(2\) to \(8\) steps to be solved. Solutions mainly are a series of elementary calculations using basic arithmetic operations. * **MATH**[191] enables to assess how well models can solve math problems. MATH dataset last \(12\), \(500\) problems from high school math competitions. Each problem in the dataset has a step-by-step solution and a final answer enclosed in a box. The problems cover a wide range of topics and have different levels of complexity. There are seven subjects in total. Furthermore, the difficulty of each problem is rated based on the AoPS standards on a scale from \({}^{\prime}1^{\prime}\) to \({}^{\prime}5^{\prime}\). A \({}^{\prime}1^{\prime}\) shows the easiest problems in a subject, while \({}^{\prime}5^{\prime}\) represents the most difficult. In terms of formatting, all problems and solutions are presented using LATEX and the Asymptote vector graphics language. * **HellaSwag**[192] is designed to assess commonsense reasoning in LLMs. This benchmark includes \(70,000\) multiple-choice questions. Each question is derived from one of two domains: ActivityNet or WikiHow, and presents four answer choices regarding what might happen in the following situation.