confidence marker in the sentence, the marker is masked and the rest of the sentence is used for retrieval. Yu et al. (2023) also employed LM to determine the timing of retrieval. However, instead of generating low-confidence markers using LM, they had LM score the output before and after retrieval.Mallen et al. (2022)'s approach differed from the traditional method of having LMs generate low-confidence markers. Instead, they used Wikipedia page views as a measure of prevalence and converted knowledge triples of wiki data with varying levels of prevalence into natural language questions anchored to the original entity and relation types. This approach is more objective and avoids subjective evaluations. For tasks that required reasoning, both He et al. (2022) and Khattab et al. (2022) used chain of thought(CoT) to determine when to perform a retrieval.