To further validate the behavior of Adapt-LLM when requesting additional context, Figure 2 illustrates the proportion of questions for which our model generates the \(\langle\text{RET}\rangle\) token, aggregated by popularity score intervals (left image for Adapt-LLM trained on NQ and right image for SQuAD). Mallen, Alex Troy and Asai, Akari and Zhong, Victor and Das, Rajarshi and Khashabi, Daniel and Hajishirzi, Hannaneh [22] suggest that high-popularity questions can be adequately answered using the parametric memory of the LLM, while lower popularity scores necessitate extra context. In Figure 2, we observe this pattern for both versions of Adapt-LLM, indicating that our model, despite lacking access to popularity scores during training or inference, has learned effective criteria for requesting additional context.