Steph Cabral

PCCM Fellow @HarvardPulm | @BIDMC_IM

[Steph Cabral @stephcabral_]

Excited to share our work evaluating an LLM (GPT-4) vs. physicians at clinical reasoning across four stages of data acquisition. Who do you think was superior?

Many thanks to my awesome co-authors @AdamRodmanMD @DrDanRestrepo @zahirkanjee @philipvvilson @BageLeMage @byrondcrowe

[Eric Topol @EricTopol]

How good is #AI at clinical reasoning? An early, simulated assessment
https://t.co/5fXdgwBXRJ
“An LLM was better than physicians in processing
medical data and clinical reasoning using recognizable frameworks as measured by R-IDEA”

[Ben Strober @BennyStrobes]

Exciting updates!!
(1) I just opened my lab at Boston Children’s Hospital (Harvard-affiliated)
(2) I’m hiring a postdoc focused on integrating GWAS and functional genomic data. Reach out if you’re interested or connect at ASHG next week!
(3) Learn more at https://t.co/XHx4vh2niE

[Steph Cabral @stephcabral_]

My husband is starting his lab in statistical genetics at @Bos_CHIP this fall! Very proud of him—reach out if you’re looking to join his group (I can attest he’s great!)

[Ben Strober @BennyStrobes]

I'm excited to share I'll be starting a faculty position at Boston Children's Hospital in the Computational Health Informatics Program (@Bos_CHIP ) this October!!

[Adam Rodman @AdamRodmanMD]

There is a lot of buzz about our new paper in Nature Medicine on the effects of LLMs (GPT-4) on physician management reasoning! I had TONS of fun working on this -- but what it MEANS requires some unpacking.

A 🧵⬇️
https://t.co/yLZJw1U5IE

[Ben Strober @BennyStrobes]

Excited to kick off 2025 with our latest publication! We've developed TGFM, a new statistical method for identifying the causal tissue and gene underlying GWAS disease loci—providing new insights into the biology behind GWAS signals.

https://t.co/Qx5WLtMmjc

[BIDMC Department of Medicine @BIDMC_Medicine]

We're so proud to congratulate our senior residents on graduation! They have been a truly outstanding class and it has been an honor to watch them care for patients. As you head to fellowships or faculty roles near and far, we can't wait to see your bright futures unfold! 🌟🎓🩺

[Steph Cabral @stephcabral_]

Thanks @Anacapa17 and @jonc101x for the fantastic talks on machine learning and LLMs in medicine! Lots of great discussion but more importantly some wild magic 🪄🪄🪄 (@jonc101x is a magician if you can believe it)

[Adam Rodman @AdamRodmanMD]

We are INCREDIBLY excited to host (real magician) @jonc101x and @BIDMC_IM alum @Anacapa17 to talk about their research in AI in medicine. Anyone at @BIDMC_IM is welcome -- Deac 312/315 at 6 PM!

(not on Zoom -- in person only!)

[Steph Cabral @stephcabral_]

@DrDatta_AIIMS @AdamRodmanMD @DrDanRestrepo @zahirkanjee @philipvvilson @BageLeMage @byrondcrowe @DrDatta_AIIMS free version
https://t.co/8r3kjLPbvt

[Steph Cabral @stephcabral_]

Excited to share our work evaluating an LLM (GPT-4) vs. physicians at clinical reasoning across four stages of data acquisition. Who do you think was superior?

Many thanks to my awesome co-authors @AdamRodmanMD @DrDanRestrepo @zahirkanjee @philipvvilson @BageLeMage @byrondcrowe

[Eric Topol @EricTopol]

How good is #AI at clinical reasoning? An early, simulated assessment
https://t.co/5fXdgwBXRJ
“An LLM was better than physicians in processing
medical data and clinical reasoning using recognizable frameworks as measured by R-IDEA”

[Steph Cabral @stephcabral_]

@foundjuliette @AdamRodmanMD @BIDMC_IM @BageLeMage @DrDanRestrepo @zahirkanjee @philipvvilson @byrondcrowe @foundjuliette https://t.co/8r3kjLPbvt

[Adam Rodman @AdamRodmanMD]

Our new study in @JAMAInternalMed looking at the reasoning abilities of GPT-4 compared with human physicians just came out.

Big picture: AI displays (much) better reasoning than humans, makes diagnoses similarly, but hallucinates considerably more.

A 🧵to put in context ⬇️

[JAMA Internal Medicine @JAMAInternalMed]

An LLM outperformed human clinicians in the ability to process medical data and display clinical reasoning, raising hopes that LLMs might be able to serve as “copilots” in clinical workflows. https://t.co/xL9CXR0atc

[Steph Cabral @stephcabral_]

@jpirruccello @DrDanRestrepo @AdamRodmanMD @BageLeMage @byrondcrowe @philipvvilson The majority of all respondents had 100% diagnostic accuracy, or listed the correct diagnosis first on their differential.

[Steph Cabral @stephcabral_]

https://t.co/t6hK0dUwQp

[Steph Cabral @stephcabral_]

Anxiously awaiting future #AI research that will assess the efficacy of LLMs working with physicians in actual clinical practice! @AdamRodmanMD @arjunmanrai @jonc101x @EricTopol @DrEricStrong

[Arjun (Raj) Manrai @arjunmanrai]

We know LLMs can ace multiple-choice exams. Taking us deeper, an important new study led by @stephcabral_ and @AdamRodmanMD conducts a nuanced evaluation of the clinical reasoning abilities of GPT-4 wrt physicians. Guess who wins?

Need more of these!
https://t.co/yGq9OTSwWx

[Ethan Mollick @emollick]

It is remarkable how routine it has become for careful studies to show that GPT-4 (not trained specifically for medicine) outperforms most doctors in key aspects of diagnosis.

That doesn't mean that GPT-4 is reliable in all circumstances, but it still seems like a big deal.

[Eric Topol @EricTopol]

How good is #AI at clinical reasoning? An early, simulated assessment
https://t.co/5fXdgwBXRJ
“An LLM was better than physicians in processing
medical data and clinical reasoning using recognizable frameworks as measured by R-IDEA”