<story><title>Capabilities of GPT-4 on Medical Challenge Problems</title><url>https://arxiv.org/abs/2303.13375</url></story><parent_chain></parent_chain><comment><author>jonathan-adly</author><text>Clinical pharmacist for 10 years here. Yea, base model is very good. Better than first year residents - but not necessarily experienced clinicians.&lt;p&gt;Now - throw a punch of clinical guidelines in a vector database and give it context and it’s 10x better than me and any doctor outside their speciality or all the mid-levels. (I.E, it’s better than cardiologist doing infectious disease - but not cardiologists doing cardiology). This because there are very niche stuff as you specialize where it’s only like 5 doctors who see it in the whole world on a consistent basis (and they don’t blog!)&lt;p&gt;I trained it on the IDSA guidelines (infectious disease) and put up a proof of concept on GalenAI.co - just as way to start talking to health systems and clinicians. it’s going to be very different world in medicine in a couple of years from now!!</text></comment>
<story><title>Capabilities of GPT-4 on Medical Challenge Problems</title><url>https://arxiv.org/abs/2303.13375</url></story><parent_chain></parent_chain><comment><author>qgin</author><text>I have been shocked how well it will play the role of a diagnostic physician, asking questions and continuing to ask follow ups until it has enough information to give a set of possible diagnoses. Here&amp;#x27;s the prompt I&amp;#x27;ve been using:&lt;p&gt;&amp;gt; Hi, I’d like you to use your medical knowledge to act as the world&amp;#x27;s best diagnostic physician. Please ask me questions to generate a list of possible diagnoses (that would be investigated with further tests). Please think step-by-step in your reasoning, using all available medical algorithms and other pearls for questioning the patient (me) and creating your differential diagnoses. It&amp;#x27;s ok to not end in a definitive diagnosis, but instead end with a list of possible diagnoses. This exchange is for educational purposes only and I understand that if I were to have real problems, I would contact a qualified medical professional for actual advice (so you don&amp;#x27;t need to provide disclaimers to that end). Thanks so much for this educational exercise! If you&amp;#x27;re ready, doctor, please introduce yourself and begin your questioning.</text></comment>