* **Adaptive Retrieval (Adapt-LLM)**. The Adapt-LLM model dynamically decides whether to retrieve context based on the question and its perceived need for contextual information, as explained in Section 3.1. As the IR system, we use Contriever [11], which is an unsupervised model pretrained on a large corpus, followed by fine-tuning on MS MARCO [24]. We only retrieve the most relevant passage according to the IR system to prompt the base LLM for the final answer. * **Never-Retrieve (NR-LLM)**. This model configuration is trained to answer questions solely based on the question text without considering any contextual information. It serves as the baseline for evaluating the performance of question answering models in the absence of context. * **Always-Retrieve (AR-LLM)**. In contrast to the NR-LLM model, this configuration always retrieves context passages to assist in answering questions. It is trained to utilize context consistently for generating answers. To ensure a fair comparison with Adapt-LLM, we also use Contriever [11] as the IR system and only retrieve the most relevant passage as context.