region:us
## Dataset Summary

Contains 15 Harry Potter trivia questions in Squadv2 format, 3 of which are unanswerable.

## Model Performance

[Test Notebook](https://colab.research.google.com/drive/1VFUJKV7eun68XgQDAHSHsbvoM_CGHzWA?usp=sharing)

| Model      | exact | f1 |
| ----------- | ----------- | ----------- |
| Albert Base ([twmkn9/albert-base-v2-squad2](https://huggingface.co/twmkn9/albert-base-v2-squad2)) | 46.6667       | 46.6667 |
| Albert XXLarge ([ahotrod/albert_xxlargev1_squad2_512](https://huggingface.co/ahotrod/albert_xxlargev1_squad2_512))  | 66.6667  | 66.6667  |

