This paper introduces v0.5 of the **AI Safety Benchmark** which has been created by the MLCommons AI Safety Working Group (WG). The MLCommons AI Safety WG is a consortium of industry and academic researchers, engineers, and practitioners. The primary goal of the WG is to advance the state of the art for evaluating AI safety. We hope to facilitate better AI safety processes and stimulate AI safety innovation across industry and research.