Others Song et al. (2023) explores the impact of the mixture strategies of different instruction tuning datasets. Tulu series Konchakov et al. (2023); Ivison et al. (2023) show that increasing instruction diversity can effectively improve the performance and different instruction tuning datasets can discover or enhance specific skills, while no one dataset (or combination) provides the best performance across all assessments.