In Figure 6 of [37], they evaluate 4 tasks in BIG-Bench with the Brier Score metric and find that the emergent abilities disapper. We hypothesis that they normalize the Brier Score with the number of options in each question, otherwise the Brier Score of 0.25 on the swahili_english_proverbs task is too low for the smallest model. Four tasks have 2, 2, 4, 5 options in each question.