All prompts are zero-shot except for the first encoding prompt in Figure 7, which utilizes few-shot demonstrations to showcase the LLM a rough granularity of the task and skills. Also, we choose these prompts as they work quite well in practice. And we believe recent prompt optimization techniques Fernando et al. (2023); Yang et al. (2023) can be incorporated seamlessly into our framework, and we leave them as future work.