Single Best Answer question classifier
This model classifies multiple choice questions as Single-Best-Answer MCQs or not. SBA are MCQs where the question requires selecting the best or most correct answer among the set of choices.
The model is trained on 3K labeled questions from MMLU, MMLU_redux, and MMLU_pro benchmarks.
The model aligns with manual annotation (recall: 0.97
, precision:0.93
)
TODO: link to the paper preprint when it is published.
- Downloads last month
- 2,283
Model tree for ahmedselhady/bert-base-uncased-sba-clf
Base model
google-bert/bert-base-uncased