To support user requests and conversational interaction, LLMs typically undergo instruction tuning, a critical process involving training on supervised conversational pairs. This step is essential for crafting a versatile model, adept at addressing user queries Wang et al. (2023); Wei et al. (2021); Chung et al. (2022); Faysse et al. (2023); Ding et al. (2023); Wang et al. (2023).