Yining Hua

PhD candidate @Harvard PHS | Making AI eval more rigorous

[Stephan Rabanser @steverab]

📢 Just wrapped up some cool agent evaluation work for ICLR? Or are you simply interested in learning more about the evals landscape? Come to our Agent Evaluation Science Fall Symposium in New York City on November 20, 2026 where we bring together researchers & practitioners!

The day will focus on how agents should be scientifically evaluated, with topics spanning measurement and benchmark design, reliability, safety, and real-world performance. If you have some exciting work in this space, please consider submitting it for poster presentation!

Abstract registration deadline: October 20
Submission deadline: October 25
OpenReview: https://t.co/3R6N0UI3KS

We are also excited to welcome a strong lineup of speakers, with more to be announced. Confirmed so far: @yoavartzi (Cornell Tech), @jaseweston (Meta AI), @nouhadziri (Cohere Labs), @PeterHndrsn (Princeton University), @walesalaudeen96 (Microsoft Research), @criticalneuro (Microsoft Research), and @saurabhjha2010 (IBM Research).

Important: You do not need to submit work in order to join! Just register through the Luma link below. If space becomes limited however, we will prioritize authors with accepted submissions.

Register: https://t.co/u3VmVzzpYD
Details: https://t.co/v0D95KuP4o

Huge thanks to the entire organizing team, including @yininghua, @HongbinNLP, @manuelcherep, @dubrovnik07, @HuaYilun, @ishapuri101, @liuzhuang1234, Lori Chibnik, @vbingliu, @CsabaSzepesvari, @PeterStone_TX, @sirrice, @ang3linawang, and @nikhilsinghmus for putting this together!

Feel free to reach out with any questions and we hope to see many of you there!

[John Torous, MD MBI @JohnTorousMD]

"Standardizing and Scaffolding Healthcare AI-Chatbot Evaluation". New preprint from our team led by @yininghua. We reviewed 11 frameworks, refining 271 questions into a structured framework encompassing 3 main constructs, 18 2nd-level, and 60 3rd-level: https://t.co/zeCojqmiaw

[Yining Hua @yininghua]

@hjian42 @DBatesSafety @lizhou08 @harvardmed @CCCatMIT @medialab Many thanks to @JieHealthAI for the great feedback on experiment designs. This work will be presented at @AMIAinformatics Annual Symposium 2022 in November.