Incredibly proud of my colleagues @PeterBrodeurMD@LiamGMcCoy and @drethangoh for all the amazing work they put into the inaugural State of AI Report. I'll try to get my thoughts into some sort of thread -- though it's VERY hard to keep up these days!
https://t.co/kthaf7mCCe
There is a lot of buzz about our new paper in Nature Medicine on the effects of LLMs (GPT-4) on physician management reasoning! I had TONS of fun working on this -- but what it MEANS requires some unpacking.
A 🧵⬇️
https://t.co/yLZJw1U5IE
"The chatbot by itself did surprisingly better than all of the doctors, including the doctors that accessed the chatbot. That flew in the face of the fundamental theorem of informatics: human plus computer will deliver better results..." https://t.co/Ti8x0i6awv
"Robots can write more empathetic measures than very busy doctors can." Stanford University's Jonathan Chen and Ethan Goh discuss the integration of #AI in medicine with JAMA Medical News. https://t.co/Y391KnOVqd
Preprint out today that tests o1-preview's medical reasoning experiments against a baseline of 100s of clinicians.
In this case the title says it all:
Superhuman performance of a large language model on the reasoning tasks of a physician
Link: https://t.co/QB0mawHJNE
A 🧵⬇️