Chat responseIn this setup, models are given prompts and they respond with a free text chat response. The prompt is usually a request or instruction. This approach closely replicates how people actually interact with models and is widely used in existing datasets [47, 48, 49]. However, free text is hard to assess, as models can respond in many different ways. It is not always clear what constitutes a "safe" or "unsafe" answer if the prompt is ambiguous or context-dependent. Chat responses can be split into single-turn and multi-turn interactions. Multi-turn is a more realistic reflection of how most people interact with models, which typically involves a conversation with several inputs and outputs - such as clarifying requests, giving feedback or updating requirements. At the same time, multi-turn interactions are far more difficult to assess than single turn interactions as the second turn in the conversation must be generated in-context to the models' first response. This creates a garden of forking paths that is hard to automatically review.