\(\bullet\)_More complex tasks can benefit more from careful prompt engineering on ChatGPT._ In the WikiFact and Colored Objects tasks, the designed prompts have greatly improved the performance of ChatGPT, _i.e._, from 23.61 to 28.47 on WikiFact and from 53.20 to 66.75 on Colored Objects. It indicates the necessity of prompt engineering for LLMs to perform well on complex tasks, since these tasks typically have specific output formats or require background knowledge. Our example prompts provide more detailed task description (_e.g._, output format and task goal), which can help ChatGPT better understand the complex task requirement for fulfilling it.