Currently, more and more studies has begun to pay attention to the importance of data quality of instruction tuning. LIMA Zhou et al. (2023) only uses 1,000 high-quality instructions and outputs for SFT, and does not even need to perform RLHF training to achieve very strong performance. Alp-Gasus Chen et al. (2023) uses powerful LLM to automatically identify and filter low-quality data, resulting in high-quality instruction tuning data to improve performance and training speed. Humpback Li et al. (2023) filters out high-quality samples to fine-tune a more powerful LLM.