3. DecodingTrust is a benchmark that covers eight dimensions of safety in English [153]. It covers a range of criteria, from toxicity to privacy and machine ethics. The benchmark has a widely-used leaderboard that is hosted on HuggingFace.30 Footnote 30: [https://huggingface.co/spaces/AI-Secure/llm-trustworthy-leaderboard](https://huggingface.co/spaces/AI-Secure/llm-trustworthy-leaderboard)
4. SafetyBench is a benchmark that covers eight categories of safety, in both English and Chinese [37]. It comprises multiple choice questions. They test 25 models and find that GPT-4 consistently performs best. 5. BiasesLLM is a leaderboard for evaluating the biases of LMs. it tests seven ethical biases, including ageism, political bias, and xenophobia.31 Footnote 31: [https://livablesoftware.com/biases-llm-leaderboard/](https://livablesoftware.com/biases-llm-leaderboard/)
6. BIG-bench contains tests that are related to safety, such as pro- and anti- social behavior like toxicity, bias, and truthfulness [20]. 7. HELM contains tests that are related to safety, such as toxicity, bias, disinformation, copyright infringement, and truthfulness [19]. 8. SafetyPrompts32 is a website that hosts datasets for evaluating the safety of models [13]. It does not aggregate or combine datasets but it makes them available for developers to easily find and use. Footnote 32: [https://safetyprompts.com/](https://safetyprompts.com/)
9. Numerous individual datasets have been released for assessing safety risks of models, such as Malicious Instructions [68], ToxicChat [166] and HarmfulQA [167]. 10. METR's Task Suite is an evaluation suite that elicits the capabilities of frontier models [168]. It includes tasks that present grounded risks to individuals (e.g., phishing) as well as extreme risks.