However, building a conversational QA model, that can match the accuracy of the state-of-the-art black-box model, i.e., GPT-4 (OpenAI, 2023), is still a grand challenge for the research community. In this work, we introduce ChatQA-70B, a white-box conversational QA model with GPT-4 level accuracy, through a proposed two-stage instruction tuning recipe, an enhanced retriever for retrieval-augmented generation (RAG) in conversational QA, and careful data curation process.