Figure 2: Overview of the proposed CodecLM. First, the strong LLM \(f_{s}\) encodes the seed instruction into instruction metadata, specifying its use case and skills required for responses. Next, \(f_{s}\) decodes metadata into basic instructions. Meanwhile, Self-Rubrics leverages \(f_{s}\) to generate rubrics and actions to improve the basic instruction, tailoring them for the downstream task. Finally, Contrastive Filtering uses a scoring function \(S\) to compares \(f_{s}\) and \(f_{t}\)’s responses. The most effective pairs are selected for aligning the LLM, while less effective instructions are sent for further improvement. In this figure, the strong LLM’s response is winning against the target one’s, so we select the corresponding pair for instruction tuning the target LLM.