Using simulated dialogues allowed us to address the limited availability of high-quality, labelled real-world conversation data and improved the model's generalization and adaptability to diverse medical contexts. By leveraging this self-play paradigm, AMIE could continuously learn and refine its conversational and diagnostic capabilities during patient interactions.