---
language:
- en
metrics:
- f1
- accuracy
base_model:
- google-bert/bert-base-uncased
pipeline_tag: text-classification
---
# Single Best Answer question classifier

This model classifies multiple choice questions as Single-Best-Answer MCQs or not. 
SBA are MCQs where the question requires selecting the best or most correct answer among the set of choices.

The model is trained on 3K labeled questions from MMLU, MMLU_redux, and MMLU_pro benchmarks.
The model aligns with manual annotation (`recall: 0.97`, `precision:0.93`)

TODO: link to the paper preprint when it is published.