Shi et al. (2023) utilises knowledge distillation to divide the retrieval process into four distinct steps. Firstly, documents are retrieved and retrieval likelihoods are computed. Secondly, the retrieved documents are scored using a language model. Thirdly, the parameters of the retrieval model are updated by minimising the KL discrepancy between the retrieval likelihoods and the distribution of the language model scores. Finally, asynchronously updating of the indexes of the data is performed. Based on this technique, Lin et al. (2023) further improve the accuracy of knowledge distillation. They present a data distillation scheme that combines sentence truncation and query enhancement with incremental relevance label enhancement using multiple enhancers.