However, while LLMs have been shown to encode clinical knowledge and proven capable of highly accurate single-turn medical question-answering [12, 13, 14], their conversational capabilities have been tailored to domains outside clinical medicine [15, 16]. Prior work in LLMs for health [12, 13, 14, 17, 18] has not yet rigorously examined the clinical history-taking and diagnostic dialogue capabilities of AI systems or contextualized this by comparison to the extensive capabilities of expert clinicians.