**Instruction Tuning for LLM Alignment.** Tuning LLM to faithfully follow instructions and align with diverse human preferences remains a significant challenge Efrat and Levy (2020). Early research primarily focused on cross-task generalization, where models were fine-tuned on various public NLP datasets to improve performance on diverse tasks Raffel et al. (2020); Wei et al. (2021); Aribandi et al. (2021); Victor et al. (2022); Chung et al. (2022). More recently, researchers have extended instruction tuning to open-domains, characterized by a wider range of formats and task types. This shift has been driven by crowdsourcing human-generated instruction-response pairs Ouyang et al. (2022); Kopf et al. (2023); Zhou et al. (2023) and LLM-generated data Taori et al. (2023); Chiang et al. (2023). Unlike prior work, CodecLM presents a unique approach for tailoring synthetic data to specific downstream tasks without human annotation, utilizing the concept of instruction metadata.