* Adapt-LLM consistently outperforms typical fixed strategies for question answering, such as (i) using the IR system for all questions and (ii) relying solely on the parametric memory of the LLM. * Adapt-LLM demonstrates performance comparable to strategies that rely on popularity scores to determine when to use an IR system, even without utilizing any popularity score or similar metric. It's worth noting that popularity scores are a unique feature of the PopQA dataset, rendering them inapplicable to other open-domain question answering datasets. * When Adapt-LLM decides to retrieve additional information, the results obtained with the context are significantly better than those without it. Similarly, when Adapt-LLM directly answers questions relying on its parametric memory, it achieves high accuracies. These observations indicate that the model effectively discerns when to retrieve information and when it can answer a question without further context. * The primary bottleneck for the performance of Adapt-LLM lies in the IR system. Adapt-LLM achieves much higher performance with gold passages compared to passages retrieved by the IR system.