Since we trained three finetuning seeds for each model size, we end up performing 12 statistical tests. The results can be found in Figure 3. We do not observe statistically significant \(p\)-values (\(p<0.05\)) for any of the finetuning seeds.