\(\bullet\)_Instruction following_. By fine-tuning with a mixture of multi-task datasets formatted via natural language descriptions (called _instruction tuning_), LLMs are shown to perform well on unseen tasks that are also described in the form of instructions [28, 66, 67]. With instruction tuning, LLMs are enabled to follow the task instructions for new tasks without using explicit examples, thus having an improved generalization ability. According to the experiments in [67], instruction-tuned LaMDA-PT [68] started to significantly outperform the untuned one on unseen tasks when the model size reached 68B, but not for 8B or smaller model sizes. A recent study [69] found that a model size of 62B is at least required for PaLM to perform well on various tasks in four evaluation benchmarks (_i.e._, MMLU, BBH, TyDiQA and MGSM), though a much smaller size might suffice for some specific tasks (_e.g._, MMLU).