Pre-instruction-tuning on QA and documents sequentiallyOur second implementation trains on QA and associated documents sequentially (Fig. 4 5), with the intuition that the ability to absorb knowledge from documents can be strengthened if an LLM is trained on the complex documents after it has grasped the associated simpler QA pairs.