Figure 7: Human evaluation performance of GPT3SELF-INST models tuned with different sizes of instructions. \(x\)-axis is in log scale. The smallest size is 175, where only the seed tasks are used for instruction tuning. We also evaluate whether improving the data quality will further improve the performance by distilling the outputs from InstructGPT003. We see consistent improvement from using larger data with better quality.