Figure 4: Effect of different prompts using GPT-4 on RAG preference rate vs prior probability. The “Strict” prompt strongly enforces literal adherence to the retrieved context, while the “Loose” prompt encourages the model to make a reasonable judgment in light of the provided context. We observe lower and steeper drops in RAG adherence with the loose vs strict prompts, suggesting that prompt wording plays a significant factor in controlling RAG adherence. Full prompts are provided in the Appendix.