2021) involves transferring data from a pre-trained, larger model to a smaller one, often using methods such as embedded matching. Research has even been conducted on data distillation using LMs as the technology has evolved.