The systems under test (SUTs) are general-purpose AI chat systems, which we define as AI models that have been trained (e.g., fine-tuned or instruction-tuned) to engage in open-ended conversations on a variety of topics. In principle, AI systems can have additional features, such as guardrails, safety-emphasising system prompts or safety filters.8 These could influence the systems' operations or how they are interacted with [30], but are not included with the SUTs for v0.5 for simplicity. We also do not test the Graphical User Interface or any other user-facing aspects that each system might have.