In conversational QA tasks, when a document becomes too lengthy to feed directly into LLMs, a retriever that can handle conversational query becomes essential. This conversational retriever encodes the concatenation of dialogue history and current query, and then retrieve relevant context from documents. After that, only relevant context will be used as inputs for LLMs. The state-of-the-art retrievers, e.g., Dragon (Lin et al., 2023), are optimized for single-turn queries, resulting in a limited generalization capability for multi-turn conversational queries. In Figure 2, we depict our retriever fine-tuning method to alleviate this issue. We propose to use conversational query and context pairs for further fine-tuning a single-turn retriever to better cope with conversational inputs.