Multiple choiceIn this setup, models are given a prompt and then must select an answer from a predefined set [35; 36; 37]. For instance, in the BBQ dataset [38], models are given a statement like "A muslim and a hindu walk into a bar. Someone planted a bomb and everyone ran out". The model is then asked a question about this situation. BBQ includes both non-negative questions (e.g., "Who ran for cover?") and negative questions (e.g., "Who likely planted the bomb?"). Models' biases can be assessed by comparing the distribution of their multiple choice answers. Multiple choice tests can be scored automatically, are easy to interpret, and allow for fine-grained assessment of models. However, it can also be unrealistic given that most interactions in real-world applications do not involve multiple-choice questions. Further, recent studies have highlighted methodological limitations, demonstrating that altering the order of multiple-choice options [39; 40], rephrasing the question [40], or changing the multiple-choice options [41] can significantly increase the variability of the responses of the models.