We focus on the first scenario for clarity, though the second can be derived similarly by leveraging an LLM as the encoder (Section 4.1). Our goal is to generate a set of high-quality instruction-response pairs \(\mathcal{D}_{g}=\{(I_{j}^{{}^{\prime}},R_{j}^{{}^{\prime}})\}_{j=1}^{m}\), using a strong LLM \(f_{s}\), and then use \(\mathcal{D}_{g}\) to fine-tune the target LLM \(f_{t}\). We evaluate the performance of the fine-tuned LLM \(f_{t}\) on test instructions from the target distribution \(P_{I}\), to which we are aligning.