Here, we show the instructions and demonstrations used to prompt GPT-4 to collect reflection tokens. Table 8 shows the instructions and demonstrations for the initial retrieval token. Table 9 shows the instruction and demonstrations used to collect the three-way output tokens for [1.1] given instruction, preceding sentences, and previously retrieved passages. Due to the longer demonstration and test input, we only use a single demonstration. Table 10 shows an instruction and demonstrations used to collect the three-way output tokens for [1.1]. Table 11 shows an instruction and demonstrations used to collect the three-way output tokens for [1.1]. Table 12 shows an instruction and demonstrations used to collect the five-way output tokens for [1.1].