Through extensive experiments conducted on the PopQA dataset, we show that Adapt-LLM performs better than its two fixed alternatives: never retrieving and always retrieving relevant context information. Furthermore, our findings highlight Adapt-LLM's capability to effectively discern the necessity of additional context, which is the primary objective of this work.