Edit model card

Single Best Answer question classifier

This model classifies multiple choice questions as Single-Best-Answer MCQs or not. SBA are MCQs where the question requires selecting the best or most correct answer among the set of choices.

The model is trained on 3K labeled questions from MMLU, MMLU_redux, and MMLU_pro benchmarks. The model aligns with manual annotation (recall: 0.97, precision:0.93)

TODO: link to the paper preprint when it is published.

Downloads last month
2,283
Safetensors
Model size
109M params
Tensor type
F32
·
Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for ahmedselhady/bert-base-uncased-sba-clf

Finetuned
(2085)
this model