We use NarrativeQA for this study, since each question has a corresponding long document. For NarrativeQA, we originally use a summary of the long document as the context, which contains the answer. To incorporate discontinuous contexts, we first cut the long document into 300-word chunks. Then, we use Dragon retriever to retrieve top-4 chunks to the question as the additional context. Finally, we take the retrieved four chunks and the summary of the long document as the "top-5" chunks. 7 We use this reconstructed NarrativeQA to replace the original one for the stage-2 instruction tuning.