* _Task-specific instructions._ For the first type of instructions, we adopt the most commonly-used multi-task instruction dataset, _FLAN-T5_[69], which contains 1,836 tasks and over 15M instructions by combining four data mixtures from prior work. * _Daily chat instructions._ This type of instructions are conversations posed by users about daily life, which are more closely related to real-life scenarios. We adopt the ShareGPT instruciton set, consisting of 63K real-user instructions. It has been used as the core instructions for Vicuna. * _Synthetic instructions._ In addition to reusing existing instructions, we can also automatically synthesize massive instructions using LLMs. We adopt the popular synthetic instruction dataset Self-Instruct-52K [143], consisting of 52K instructions paired with about 82K instance inputs and outputs. These generated instructions have a similar data distribution as the human-written seed tasks (_e.g._, grammar checking, brainstorming).