**Figure A.1 \(|\) Simulated Dialogue and Self-play Critique Example.** An example of AMIE modifying behavior based on in-context feedback provided during the inner-loop self-play, illustrating how this critique can impact the behavior of AMIE in the simulated dialogues. We demonstrate in Figure A.19 that this process on average results in improved simulated dialogue quality on a set of four PACES clinical criteria. Note that this is one preliminary example of a single round of iterative feedback and does not reflect the full simulated dialogue process. For example, in this round of feedback, the AMIE critique did not identify that management recommendations should primarily include an in-person evaluation by a physician to gauge severity and rule out more concerning causes or sequelae.