@liuzhuang1234 True. The race for SOTA and publications pushes everyone to focus on leaderboards, but in healthcare, performance is not the only bottleneck. Robustness, interpretability, clinical validation, and workflow matter too. There’s still plenty of hard research to do.
📣 Proud to share HealthBench, an open-source benchmark from our Health AI team at OpenAI, measuring LLM performance and safety across 5000 realistic health conversations. 🧵
Unlike previous narrow benchmarks, HealthBench enables meaningful open-ended evaluation through 48,562 unique physician-written rubric criteria spanning several health contexts (e.g., emergencies, global health) and behavioral dimensions (e.g., accuracy, instruction following, communication).
Blog, paper, code: https://t.co/NsSPeIoHZy
Tuesday Surprise: Honored to receive the @WhiteHouse#PECASE award; endless thanks to my amazing students, collaborators, and @NSF + @NIH for brewing this up. Proof that science + teamwork (and way too much tea ☕️) works! 🚀
https://t.co/suKD7rScKu
@UF@UFWertheim@UFexplore@UFBME
Peri-AIIMS: Perioperative Artificial Intelligence Driven Integrated Modeling of Surgeries using Anesthetic, Physical and Cognitive Statuses for Predicting Hospital Outcomes. https://t.co/abA6jPYnnw
Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: https://t.co/MYHZB79UqN
Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.
Yann LeCun thinks the risk of AI taking over is miniscule. This means he puts a big weight on his own opinion and a miniscule weight on the opinions of many other equally qualified experts.
📢 Exciting News! The 2023 edition of CrossLink, UF BME's annual magazine, is here! Explore the cutting-edge world of #AI in healthcare & research with Drs. Ding, Fang, Fan, Gong, Nichols, & Rashidi. Don’t miss this AI-powered edition! Digital version ➡️https://t.co/tclRmByRog
📢 Introducing our work for multi-turn conversations featuring interleaved images & text input and output!
🌟 Say goodbye to single-image discussions and artificial Q&A with our assistant.
💡Empower your LLMs with amazing features:
✅ Explain concepts/ideas using vivid images
✅ Compare common/different aspects in multiple images
✅ Compose captivating stories from image sets
✅ Generate coherent stories with illustrations & more!
🔗 Access dataset, code, model & demo: https://t.co/jJFd5C3vPC 🚀 @HuayangLi@deng_cai
#AI #ConversationalAI #LLM #TextBind
🖼️🤗Excited to share our latest work on addressing the cultural gap in text-to-image generation. We've introduced a new benchmark, the Challenging Cross-Cultural (C3), and a multi-modal metric to improve cross-cultural image generation. Check it out! 🌍🤖