Instruction-tuned GPT3 models.We evaluate InstructGPT (Ouyang et al., 2022), which is developed by OpenAI based on GPT3 to follow human instructions better and has been found by the community to have impressive zero-shot abilities. There are various generations of these models, where newer ones use more expansive data or algorithmic novelties.10 For our SuperNI experiments in SS4.3, we only compare with their text-davinci-001 engine, because their newer engines are trained with the latest user data and are likely to have already seen the SuperNI test set. For our human evaluation on newly written instructions, we include their 001, 002 and 003 engines for completeness.