To evaluate LLaMA models on this dataset, we directly feed the examples to these models. While when evaluating Alpaca models, we wrap the examples in the prompt template as demonstrated in Section 2.5. Then the model is asked to make a one-step prediction and give the probability distribution of the next token \(p(y|\mathbf{x})\), where \(y\in\mathcal{V}\) (\(\mathcal{V}\) is the vocabulary). To map the probability distribution to a valid label \(t\) in {A, B, C, D}, we extract and gather the probabilities of related tokens.