GR

[Andrew Beam @AndrewLBeam]

What does ChatGPT-3.5* know about neonatology? A new paper in @JAMAPeds with @swanbeams, @bhaweshiitk, Cindy Wang, Dara Brodksy, and @crmartin90 takes a look at this question.

We asked all 900+ questions from the well known Brodsky and Martin neonatal board prep book and had Drs. Brodsky and Martin evaluate the answer justifications ChatGPT provided.

On average, it got about 50% of the questions correct, with a lot of variation in accuracy by topic. It seemed well-aligned to the scientific consensus, but often omitted key details or facts in its answer justifications.

ChatGPT-3.5 does seem to know quite a bit about neonatology, but still falls short in important ways.

Paper: https://t.co/rH12m7QSSK

*Since AI progress moves faster than scientific publishing, GPT-4 came out while this paper was under review. We are in the process of updating the results with the new model - stay tuned!

[GR @gisel_river]

@AndrewLBeam @JAMAPeds @swanbeams @bhaweshiitk @crmartin90 @gioroldanc Mira!

[Sujay Kansagra, MD @ThatSleepDoc]

"Darkness cannot drive out darkness; only light can do that. Hate cannot drive out hate; only love can do that." - MLK

[Esther Choo, MD MPH @choo_ek]

Hollywood, if you are scripting this, we've hit rock bottom. Time for the dramatic turn-around.

[GR @gisel_river]

@paalcedo 😂😂😂 totalmente correcto!!!

[GR @gisel_river]

Someone from Honduras or Costa Rica at the #AAP16?

[GR @gisel_river]

#AAP16 so excited in our fist time here!

[GR @gisel_river]

"We live in a world full of stories, pay attention, listen all of them and find your voice to tell your own" #AAP16

[Sujay Kansagra, MD @ThatSleepDoc]

There is always help available. Ask for it.

[Children's National Hospital 🏥 @ChildrensNatl]

This weekend we'll be at #AAP16 in San Francisco showcasing an exclusive #VR experience to attendees! Visit us at booth 2130 & check it out!

[GR @gisel_river]

@medschooladvice @AmerAcadPeds @ncpeds @davhill I will be there!😀

[GR @gisel_river]

CA next week!!! Yay! @AAPexperieNCE

[USMLE AID @UsmleAid]

Causes of NAIL CLUBBING
Cryptogenic fibrosing alveolitis
Lung hydatid cysts
Pulmonary metastases
IBD
Hodgkin disease
Acromegaly
#UA #USMLE

[GR @gisel_river]

Have the best mom in the world❤️

[GR @gisel_river]

If you don't like the whether in Chicago, don't you have to worry! Just have to wait 15 mint ☀️☁️🌧☀️

[Words @wordstionary]

If you don't step forward you will always remain in the same place.

[GR @gisel_river]

Kaplan is extremely quiet today. 👀

[Malia Clark @maliaclark]

"Words matter when you're running for president and they certainly matter when you are president" @HillaryClinton #debatenight

[GR @gisel_river]

Love finding my own old motivational annotations in my books while second-round reading! 😅