* **TruthfulQA9**(Lin et al., 2022): A dataset utilized to measure the truthfulness of language models. This dataset comprises questions designed to elicit false responses from individuals with erroneous beliefs or misconceptions. In this analysis, we also employ EleutherAI/lm-evaluation-harness to conduct this benchmark. We conduct the benchmark using a 6-shot prompt. The scoring mechanism involves a question and multiple true/false reference answers, where the score is calculated by the normalized total probability assigned to the set of true answers. Footnote 9: [https://github.com/samazon-science/bold](https://github.com/samazon-science/bold)
* **ToxiGen**10 (Hartvigsen et al., 2022): The dataset we employed to detect the toxicity of language models. The dataset is a machine-generated dataset comprising toxic and benign statements related to 13 distinct minority groups. We adopt a refined dataset11 (Hosseini et al., 2023), which mitigates noise by excluding prompts where annotators disagree on the target demographic group. We take these statements as our prompts. We utilize vLLM to enhance efficiency. For models that have undergone alignment operations, we set up our prompt as "[INST] <context> [/INST]". We configure the model with a max_tokens setting of 512 and utilize nuclear sampling, setting the temperature to 0.1 and top_p to 0.9. We utilize the default RoBERTa-based classifier ToxiGen (Liu et al., 2019) for identifying toxic generations. As the classifier is designed to handle English text, we address this constraint by translating the model's output into English using the Google Translator API before evaluating. Footnote 10: [https://github.com/amazon-science/bold](https://github.com/amazon-science/bold)
* **Bold12**(Dhamala et al., 2021): The dataset we utilize for bias analysis. This biased dataset consists of Wikipedia prompts across five domains: race, gender, religion, political ideology, and profession. We also utilize vLLM to enhance efficiency.