Immediate hazardsImmediate hazards are sources of harm that are already being presented by existing frontier and production-ready models. This includes enabling scams and fraud [86], terrorist activity [87, 88], disinformation campaigns [89, 90, 91], creation of child sexual abuse material[92], encouraging suicide and self-harm [93], cyber attacks and malware[94, 95], amongst many others [96]. Another concern is factual errors and "hallucinations". This is a substantial risk when models are faced with questions about events that happened after their training cutoff date if they do not have access to external sources of up-to-date information [6, 97, 98]. Generative AI has been shown to increase the scale and severity of these hazards by reducing organizational and material barriers. For instance, the media has reported that criminals have used text-to-speech models to run realistic banking scans where they mass-call people and pretend to be one of their relations in need of immediate financial assistance [99]. The risk of bias, unfairness, and discrimination in AI models is a longstanding concern, supported by a large body of research [100, 101, 44, 102]. Recent work also shows that out-the-box models can also be easily adjusted with a small fine-tuning budget to readily generate toxic, hateful, offensive, and deeply biased content [103, 104, 68]. And substantial work has focused on developing human- and machine-understandable attack methods to cause models to regurgitate private information [105], 'forget' their safety filters [106] or reveal vulnerabilities in their design [107].