In RAFT, we train the model to answer the question (Q) from Document(s) (D*) to generate an answer (A*), where A* includes chain-of-thought (Wei et al., 2022; Anthropic, 2023), and in the presence of distractor documents (\(D_{k}\)). We explain the methodology in detail in Section 3 and analyze the sensitivity to the number of distractor documents (\(k\)) at train- and test- time in Section 5. RAFT consistently outperforms Supervised-finetuning both with- and without- RAG across PubMed (Dernoncourt and Lee, 2017), HotpotQA (Yang et al., 2018), and HuggingFace Hub, Torch Hub, and Tensorflow Hub Gorilla datasets (Patil et al., 2023), presenting a novel, yet simple technique to improve pre-trained LLMs for in-domain RAG.