Stephen Pfohl

Research Scientist at Google Research.

Researching #fairness #transparency #causality #healthcare #healthequity

[Joe Alderman @jaldmn]

Really great to see this published!

So, what is this all about? 🧵

(1/

[Awa Dieng @adoubleva]

🎉 We are excited to present two recent works detailing the landscape of AI in health in Africa from a fairness and equity angle:

The Nteasee Study https://t.co/8p8r1TFIez

and

The Case for Globalizing Fairness https://t.co/iV3stqXeud (1/11)

[Stephen Pfohl @stephenpfohl]

Also want to thank the editorial team (@NatureMedicine, @LorenzoRighett7) and reviewers (@MMccradden and anonymous reviewers) for their constructive feedback and support for the work.

[Stephen Pfohl @stephenpfohl]

Excited to announce that our paper, “A toolbox surfacing health equity harms and biases in large language models” is now published with @NatureMedicine: https://t.co/dm1OKAlfkV.

[Nature Medicine @NatureMedicine]

Identifying a complex panel of bias dimensions to be evaluated, a framework is proposed to assess how prone large language models are to biased reasoning, with possible consequences on equity-related harms. https://t.co/oDfZZZxYw3

[Stephen Pfohl @stephenpfohl]

This work represents the contributions of many amazing collaborators from @GoogleAI @GoogleDeepMind @MIT @UAlberta, including @hcolelewis @thekaransinghal @DrNealResearch @dr_nyamewaa @adoubleva @weballergy @AziziShekoofeh @negar_rz @LiamGMcCoy @HardyShakerman and many more!

[Stephen Pfohl @stephenpfohl]

@2plus2make5 @Berkeley_EECS Congrats!

[Stephen Pfohl @stephenpfohl]

@kdpsinghlab If this works like the pd.eval or pd.query, you could actually drop the f string and replace {value} with @value

[Stephen Pfohl @stephenpfohl]

@_isupriya I'll share it once the FAccT proceedings are online (not sure when that will be exactly, sorry!)

[Stephen Pfohl @stephenpfohl]

Made it to Rio for #FAccT2024

[Isaac Kohane @zakkohane]

Red teaming LLM’s w @TristanNaumann @MSFTResearch @stephenpfohl @GoogleResearch #SAIL2024 #AI detecting threats across the broad taxonomy of LLM vulnerabilities

[Symposium on AI for Learning Health Systems @SAILhealth]

As our attendees settle in the @hyattregencypr, we get ready for a deep dive into medical AI with @TristanNaumann and @stephenpfohl presenting “Red Teaming to Test Limitations of LLMs”.

Welcome everyone to #SAIL24!

We hope you enjoy the conference and beautiful Puerto Rico. 🏝️

[Stephen Pfohl @stephenpfohl]

Landed in Puerto Rico for #SAIL2024

[Stephen Pfohl @stephenpfohl]

@davidthewid @FAccTConference @mikarv @struthious @Borhane_B_H @andrewthesmart Great to hear! I was wondering if I needed to set an alarm for 4:30AM to resubmit after the TAPS support gets back to me 😅

[Stephen Pfohl @stephenpfohl]

@davidthewid @FAccTConference @mikarv @struthious @Borhane_B_H @andrewthesmart FWIW, I have been stuck in this state for a few days now

[Stephen Pfohl @stephenpfohl]

@PhDemetri Charles Elkan called it in 2001 https://t.co/dVX1M5gHCV

[Karan Singhal @thekaransinghal]

Excited to share our newest work! 📝 Evaluation of LLMs is hard, especially for health equity. We provide a multifaceted human assessment framework, 7 newly-released adversarial datasets, and perform the largest human eval study on this topic to date. 🧵:

https://t.co/8yBo2q9wMT