We use the prompt format mentioned in SSA.2 for benchmarks in ChatQA, Llama2-Chat, GPT-3.5-turbo and GPT-4. We keep the {Context for Latest Question} the same for all models, while we adjust the {Instruction} for the baselines (i.e., Llama2-Chat, GPT-3.5-turbo and GPT-4) to ensure they do not get sub-optimal results. We use different instructions for test benchmarks with different answer types (e.g., long answer, short answer, arithmetic calculation).