**Effect of external parameters on RAG and FT.** We delve into additional factors that influence model specialization in processing less popular knowledge. A key aspect under review is the effect of full tuning versus PEFT. Table 2 shows PEFT leads to smaller gains in the _+FT-RAG_ compared to full FT, yet it significantly improves accuracy in the _+FT+RAG_ setup. This suggests that PEFT enables the LLM to maintain its reasoning abilities based on the provided prompts.