We use next-word prediction loss for finetuning, and only compute loss on the responses, but not system and user instructions. We use AdamW optimizer with \(\beta_{1}\) set to 0.9, \(\beta_{2}\) set to 0.999, and \(\epsilon\) set to \(10^{-8}\). We use a sequence length of 4096, alongside a batch size of 64. We set training step to 300 with a constant \(1\times 10^{-5}\) learning rate, a weight decay of 0.1, gradient clipping with a maximum threshold of 1.0, and NEFTune [34] with a noise scale of 45 for Yi-34B-Chat and 5 for Yi-6B-Chat.