FLAN(Chung et al., 2022) is one of the most systematic and comprehensive approaches among the many studies on instruction tuning. This approach fine-tunes the language model on the instruction-optimised dataset, scales the number of tasks and model size, and incorporates chain-of-thought data in the fine-tuning. Although the authors did not consider a specific approach to tuning instructions in RALM architecture, their work provides a valuable reference for future research. In the instruction fine-tuning of RALM, Lin et al. (2023) integrated in-context retrieval augmentation. This greatly reduces the likelihood of the language model being misled by irrelevant retrieval content. SAIL(Luo et al., 2023) builds language generation and instruction tracking capabilities on complex search results generated by internal and external search engines. Using a corpus of instruction tuning, they collect search results for each training case from different search APIs and domains, and construct a search-based training set containing a triplet of (instruction, grounding information, response). In contrast to training on instruction-tuned datasets, Madaan et al. (2022) and Lazaridou et al. (2022) propose to prompt large models directly from retrieved knowledge. Madaan et al. (2022) used GPT-3 to clarify memory pairings of recorded cases where the model misinterpreted the user's intention, as well as user feedback. This ensures that their system can generate enhanced prompts for each new query based on user feedback. In contrast, Lazaridou et al. (2022) uses few-shot prompts and answer reordering to improve inference computation.