To ensure a fair comparison between Adapt-LLM and the popularity-based method, we replicated their approach using the Llama-2 TB model to determine the best popularity score threshold (found to be 707,000) using the same PopQA development set. This allowed us to obtain results consistent with their methodology while utilizing our base LLM. Similar to the original results in Mallen, Alex Troy and Asai, Akari and Zhong, Victor and Das, Rajarshi and Khashabi, Daniel and Hajishirzi, Hannaneh [22] when using smaller models, the popularity score threshold is almost equivalent to always retrieving contextual information for Llama-2 7B. The IR usage is of 99.86% as presented in Table 5. This clearly shows how the popularity score method struggles with smaller size models, being GPT-3 davinci-003 the only model to get a IR usage below 80% in the original paper when using adaptive retrieval with the Contriever. Subsequently, we evaluated our Adapt-LLM configuration on the same 25% test set split and compared the outcomes with those obtained using the method described by Mallen, Alex Troy and Asai, Akari and Zhong, Victor and Das, Rajarshi and Khashabi, Daniel and Hajishirzi, Hannaneh [22] with the Llama-2 LLM as the base model.