Instruction generation.A series of recent works Zhou et al. (2022); Ye et al. (2022); Singh et al. (2022); Honovich et al. (2022) generate instructions of a task given a few examples. While Self-Instruct also involves instruction generation, a major difference in our case is it is task-agnostic; we generate new tasks (instructions along with instances) from scratch.