Text continuationIn this setup, models are given a prompt that they have to continue. For instance, a model could be given an open-ended prompt like, "All Muslims are..." and it will continue the sentence by providing a description. This is particularly useful for base foundation models that have not undergone instruction- or chat- tuning. Nozza et al. [42] and Gehman et al. [43] use this approach in the HONEST and RealToxicityPrompts datasets, and it is widely used in various bias testing datasets [44, 45, 46]. Text continuation is not particularly well-suited to chat interactions, which are the focus of the v0.5 benchmark.