As an alternative solution to human annotation, recent work explores generating instruction-response pairs for LLM alignment by prompting them with example data or prompts and iteratively refining the results Honovich et al. (2022); Wang et al. (2022); Li et al. (2023); Xu et al. (2023).