In Table 5, we find that using "top-5" chunks as the context for training leads to improvements on the datasets that need retrieval. But it downgrades the performance on non-retrieval datasets. Overall, these two models perform comparable. It is because incorporating "top-5" retrieved chunks in stage-2 tuning aligns with the inference stage where retrieval is needed and hence, improves the Avg-ret score. However, mixing continuous and discontinuous documents could make the stage-2 tuning less stable, leading to sub-optimal results on non-retrieval datasets. We believe more future work can be conducted regarding the balance of incorporating continuous context and top-\(k\) retrieved chunks in the stage-2 tuning.