Large language models (LLMs), though powerful, are prone to hallucination (Pal et al., 2023; Sun et al., 2024; Ahmad et al., 2023). Additionally, they are restricted to knowledge contained in their training corpus, and so are unable to answer queries about recent events or publicly restricted information. Retrieval augmented generation (RAG) is a commonly used framework that provides relevant retrieved content in the LLM prompt and can significantly improve model accuracy (Mao et al., 2020; Chen et al., 2024; Lewis et al., 2020).