RA-DIT (Lin et al., 2023) and RECITE (Sun et al., 2023) emphasize enhancements through internal data modifications. RA-DIT distinguishes between fine-tuning datasets for LLMs and retrievers, aiming to bolster the LLM's contextual comprehension and the retriever's ability to align with queries. RECITE, on the other hand, utilizes passage hints and synthetic question-passage pairs to increase the variety and relevance of its generated recitations and responses. This approach seeks to broaden the model's knowledge base and improve its response accuracy.