to evaluate the various aspects of language understanding and reasoning. Specifically, this benchmark provides a Korean-translated version of language understanding tasks: boolean question answering [1], commonsense causal reasoning (COPA; Roemmele et al.2011, context-sensitive word understanding (WiC; Pilehvar and Camacho-Collados2019), commonsense reasoning [11], and sentiment negation recognition (SentiNeg). For English tasks, we employ the following original tasks of KoBEST, BoolQ, COPA, and HelaSwag, which can better highlight the alignment between the English and Korean capabilities of LLMs. To ensure consistent comparisons, we employ an open-source LLM evaluation framework, lm-evaluation-harness9[7].