Lewis et al. (2020) and Guu et al. (2020) were among the first researchers to apply end-to-end training to the field of RALM. However, they differed in their approach. REALM Guu et al. (2020) used masked language training in the pre-training phase and included a retriever that can be trained end-to-end. In the fine-tuning phase, only the QA task was targeted while keeping the retriever frozen. On the other hand, RAG Lewis et al. (2020) used an already trained retriever, DPR, and only employed BART for partial end-to-end training. Similar to REALM, Sachan et al. (2021) present an unsupervised pre-training method that involves an inverse cloze task and masked salient spans. This is followed by supervised fine-tuning using question-context pairs. In addition, they find that the use of end-to-end trained retrievers resulted in a significant improvement in performance across tasks. Singh et al. (2021) apply end-to-end training to multi-document processing, in their proposed approach, the value of the latent variable, which represents the set of relevant documents for a given question, is estimated iteratively. This estimate is then used to update the parameters of the retriever and reader. Siriwardhana et al. (2023) describe the end-to-end optimization of RAG from previous studies and introduces an auxiliary training signal to incorporate more domain-specific knowledge. This signal forces RAG-end2end to reconstruct a given sentence by accessing relevant information in an external knowledge base. This approach has greatly improved domain adaptability.