Our main analysis consists of evaluating the RAG question-answering capabilities of GPT-4 when introducing varying levels of perturbations on the RAG documents. For this study, our dataset consists of 1,294 total questions across 6 different domains. Wherever referenced, the GPT-4 model used is _gpt-4-turbo-preview_, accessed in March 2024. We additionally evaluate our dataset on two other models: GPT3.5 (_gpt-3.5-turbo-0125_) and Mistral-7B, the _Mistral-7B-Instituct-v0.1_. We chose these two LLMs as they are top-performing models that also allow access to the model's token probabilities (via the OpenAI and Huggingface APIs). All main figures and tables report results using GPT-4; analyses using GPT-3.5 and Mistral-7B are reported in the Appendix.