**Synthetic Datasets.** This kind of datasets are typically constructed by instructing LLMs, based on pre-defined guidance rules or methods. In this category, Self-Instruct-52K [143], Alpaca [142] and Baire [175] are three commonly used synthetic datasets for LLMs.