**Finetuning for RAG** More recently, several papers have been exploring the idea of finetuning a pretrained LLM to be better at RAG tasks Lin et al. (2023); Wang et al. (2023); Xu et al. (2023); Liu et al. (2024). These works focus on constructing a combination of finetuning dataset for RAG and train a model to perform well on these tasks.