Reducing the overhead can be considered from three perspectives: first, some plug-and-play intermediate modules can be designed, e.g., CRAG (Yan et al., 2024), Selfmem (Cheng et al., 2024), AI agent (Peng et al., 2023), or some deployment solutions, e.g., LangChain, Llama Index, so that there is no need to make targeted improvements for each model. Second, Internet retrieval can be utilized to reduce the overhead of the retriever, but attention needs to be paid to the data relevance mentioned earlier. Finally, In-context learning can be employed to reduce the overhead associated with improving LMs, e.g., ICRALM (Ram et al., 2023).