Openness is critical for improving AI safety, building trust with the community and the public, and minimizing duplicative efforts. However, open-sourcing a safety evaluation benchmark creates risks as well as benefits [26]. For v0.5, we openly release all prompts, annotation guidelines, and the underlying taxonomy. The license for the software is Apache 2.0 and the license for the other resources is CC-BY. We do not publish model responses to prompts because, for some hazard categories, these responses may contain content that could enable harm. For instance, if a model generated the names of darknet hacker websites, open-sourcing could make it easier for malicious actors to find such websites. Equally, unsafe responses could be used by technically sophisticated malicious actors to develop ways of bypassing and breaking the safety filters in existing models and applications. Further, to enable open sharing of the benchmark, although it limits the effectiveness of the test items (i.e., prompts), we did not include niche hazard-specific terms or information in the test items themselves.