Large Language Models (LLMs), such as GPT-3 Brown et al. (2020), LLaMA Touvron et al. (2023), and PaLM Chowdhery et al. (2023), have demonstrated remarkable capabilities as general-purpose assistants. The cornerstone of this achievement is instruction tuning, which significantly enhances the capabilities and controllability of LLMs through training on datasets composed of instruction-output pairs Zhang et al. (2023). This technique effectively aligns the models' training objectives with human intentions, thereby ensuring that the models can interpret and execute human instructions both effectively and safely. Therefore, the availability of high-quality instruction tuning datasets is crucial for LLMs to operate as efficient and dependable assistants.