ments in the most and least popular buckets. While fine-tuning boosts performance for less popular categories in smaller models, this advantage decreases in base models and disappears in larger models; see Figure 4 for more details. This is likely due to the improved memorization of larger models.