Exploratory evaluationExploratory evaluation involves open-ended, ad-hoc evaluation of models for novel, unknown, or poorly understood risks. It is well-suited to testing more complex interactions with models, such as multi-turn conversations and use of agents, and is particularly important for assessing frontier models. Red teaming, which has become one of the most popular ways of assessing safety risks, is a form of exploratory evaluation. It involves tasking annotators and experts with probing a model-in-the-loop to identify flaws and vulnerabilities [156]. Red teaming can be implemented both using humans (as with the OpenAI Red Teaming Network29) and AI models [35, 51, 52, 66]. It is very flexible, and a core focus has been understanding susceptibility to being manipulated, persuaded, directed or encouraged to give hazardous responses (often called jailbreaking, prompt injecting, or adversarially attacking) [157, 158, 159]. In 2023, a large-scale red teaming effort organized at the DefCon hacker's conference, which involved over \(2,200\) people, identified numerous model weaknesses, developed hazard categories, and identified effective strategies for red teaming [160].