The AI Safety Benchmark does not evaluate the safety of AI models "in general." This is because the same model may perform differently, and have different safety requirements, depending on how it is deployed, for whom, and where. Instead, the benchmark tests a specific AI system in a specific use case and for a specific set of personas. It is also bounded by the tests (and test items) that have been created, which inevitably do not comprehensively reflect all possible hazards. This is an important difference with previous benchmarking efforts, which have not explicitly factored in these limitations and considerations to their design.