Although humans used to rely solely on searching for information, the development of language models has revolutionised the field of natural language processing, making it more vibrant and creative. In contrast to LM, which employs solely the parameters derived from training to complete the task, RALM integrates the nonparametric memory acquired by the retriever with the parametric memory of LM itself to create a semiparametric memory, thereby enhancing the performance of the language model. In the RALM architecture, many researchers utilise off-the-shelf language models for evaluation. This section introduces the language models commonly used in RALM architectures and classifies them into three categories: AutoEncoder-language model, AutoRegressive language model and Encoder-Decoder model. Table 2 lists information about specific applications of LM in the RALM.