The main analysis we perform in this study is comparing the _RAG preference_ of a model against its _internal prior_. The LLM is first queried with a question without context. This response and the average probability of the tokens (accessed via the log probs) are referred to as the model's _prior response_ and the _prior probability_, respectively. The LLM is then queried again, this time with the retrieved content present in the prompt. The resulting response (the response with RAG) is then compared with the prior response: if the response is still the same as the prior response, then the model _prefers its prior_. On the other hand, if the model response aligns with the information present in the retrieved content, then the model _prefers RAG_. For each dataset, the _RAG preference rate_ is computed as the average across all RAG queries.