To evaluate _WizardLM_, we conduct human evaluation on our _Evol-Instruct_ testset. We perform a blind pairwise comparison between _WizardLM_ and baselines. Specifically, we recruit 10 well-educated annotators. To each annotator, four responses from Alpaca, Vicuna-7b, _WizardLM_ and ChatGPT are presented, which are randomly shuffled to hide their sources. The annotators then judge which response is better following criterion in Appendix H. Then they should rank the four responses from 1 to 5 (1 means best), and allowing equal scores for comparable instances. To estimate the win rate, we compare the frequency of win, lost, and tie between each pair of models.