* We introduce _WizardCoder_, which enhances the performance of the open-source Code LLM, StarCoder, through the application of Code _Evol-Instruct_. * _WizardCoder_ surpasses all other open-source Code LLMs by a substantial margin in terms of code generation, including StarCoder, CodeGen, CodeGee, CodeT5+, InstructCodeT5+, StarCoder-GPTeacher, and Instruct-Codegen-16B. * _WizardCoder_ achieves superior results in code generation compared to the largest closed-source LLMs, such as Claude, Bard, PaLM, PaLM-2, and LaMDA, despite being considerably smaller in size.