We compare our method against state-of-the-art data generation approaches for instruction tuning. For fair comparison, we provide all methods the same LLM backbones when possible. Moreover, we control the number of instruction-response pairs the same for all methods to ablate the effect of data quantity. Baseline methods include **Self-Instruct**Wang et al. (2022), **Alpagasus**Chen et al. (2023), **Tree-Instruct**, **WizardLM**Xu et al. (2023), and **WizardLM+**, an enhanced version of WizardLM using the same basic instructions generated from CodecLM as seed instructions. Baseline details are presented in Appendix A.2.