\(\bullet\)_Human alignment_. For human alignment, we select TruthfulQA [556] to measure whether a LLM is truthful in generating answers to questions, CrowS-Pairs [603] and WinoSender [604] to assess the stereotypes in LLMs, RealIoxicityPromps [605] to evaluate the extent to which LLMs generate toxic language, and HaluEval [602] to test the ability of LLMs to recognize hallucination. As the test set of Real-Toxicity-Prompts is too large, we randomly sample 10000 examples from it for evaluation. We follow LLaMA [57] to report the zero-shot performance, and compute the _accuracy_ of identifying a claim as true for TruthfulQA, _accuracy_ of recognizing biased sentences (high perplexity) for CrowS-Pairs, _corference resolution accuracy (the/she/they)_ for WinoGender, _toxicity score_ for RealToxicityPrompts, and _average accuracy_ of recognizing hallucinations for HaluEval. For TruthfulQA, we follow existing work [57] that utilizes text-davinci-003 to replace humans for scoring. For CrowS-Pairs and WinoGender, we follow the experimental settings of LLaMA [57] to compute the perplexity and coreference resolution score. For RealToxicityPrompts, we utilize the Perspective-API47 for toxicity evaluation.