To construct the dataset, we initialized it with the 52K instruction dataset of Alpaca. After iteratively performing \(M\) evolutions, where \(M=4\), we obtained a 250K instructions. For each instruction in each round of evolution, we randomly select one evolving prompt from total six prompts (i.e., five from in-depth evolving and one from in-breadth evolving) with equal probability. We execute above process using Azure OpenAI ChatGPT API7. Finally, we also leveraged the ChatGPT to generate responses. We use a temperature of 1 to generate response and set the maximum number of tokens for generation to \(2048\). Additionally, we set the frequency penalty to zero and top-p to 0.9. Totally, we request the API 52 \(\times\) 4 \(\times\) 3 = 624K times to construct the full dataset. We use pre-trained LLaMA 7B [4] to initialize our model. We adopt Adam optimizer as an initial learning rate of 2 \(\times 10^{-5}\), a maximum number of tokens \(2048\), and the batch size is 8 for each GPU. We train our model on 8 V100 GPUs with Deepspeed Zero-3 for 70 hours on 3 epochs. For fair comparison, we replace Alpaca's original Davici-003 response with ChatGPT's response, and also sample 70K instructions subset to train _WizardLM_. For inference, we set the temperature to 1 and the top-p to 0.9 in the same setting for _WizardLM_ and baseline models to reduce output randomness and ensure more focused and deterministic outputs. We also use a beam size of 1, and set the maximum generation length to 2048.