Multiple choice tasks provide the model with a question and several candidate answers, with the goal of selecting the correct one.
We focus on three datasets in this format:
the easy question set from the AI2 Reasoning Challenge [1]},
the Physical Interaction Question Answering dataset [2]},
and CommonsenseQA [3]}.
Unlike extractive QA, multiple choice tasks do not contain supporting evidence (a passage) for answering the question, and in contrast to classification, they have a different output space (candidate answers) for each example. We report accuracy for all multiple choice datasets.
