Analysis of standard benchmarksWe define that standard benchmarks include PIQA, SIQA, HellaSwag, WinoGrande, ARC Easy and Challenge, OpenBookQA, CommonsenseQA, BoolQ, and MMLU. This categorization is predicated on the observation that these benchmarks, to varying degrees, evaluate the models' understanding of real-world knowledge, reading comprehension, and commonsense reasoning. The descriptions and observations on these datasets are as follows.