Fine-tuning LLMs with different instruction sets tend to lead to model variants with varied performance on downstream tasks. In this section, we will explore the effect of different types of instructions in fine-tuning LLMs (_i.e._, LLaMA (7B) and LLaMA (13B)25), as well as examine the usefulness of several instruction improvement strategies.