While existing RALMs (Siriwardhana et al., 2023) (Guu et al., 2020) (Borgeaud et al., 2022) can greatly improve the performance of LMs in various domains, some of them require extensive model changes as well as complex pre-training and fine-tuning operations, which greatly increases the time and space overhead and also reduces the scalability of RALMs. In addition, as the scale of retrieval increases, so does the complexity of storing and accessing the data sources. As a result, researchers must weigh the benefits of modifying the model against the costs.