@FarzaTV@JakhotiaYash I was imagining something similar for radiology, except the dictation copilot would also be screen-aware, with a local medical vision model ?OctoMed 7B supplementing the text with image eval
made a few more changes to the website - y'all can drop a text from within!
sorry to all mobile users though - its not that its not functional but the real game is computer only
speaking of games - I am writing a story first and then building it 🎮
https://t.co/KsVwyl7lFZ
#grok4pt5
#fable5
🔥Today, we are releasing one of the first visual reasoning benchmarks for autonomous AI diagnosis in healthcare!
🚀Introducing Radiology’s Last Exam 2.0 (RadLE 2.0) from @CRASHLabAI, an uncertainty-aware benchmark for autonomous diagnosis in radiology!
✅In the last few days, the AI frontier has moved significantly. @OpenAI launched GPT-5.6 Sol. @Meta launched Muse Spark 1.1. @xAI dropped Grok 4.5.
🙌We’ve benchmarked all frontier, open-source and medical VLMs in RadLE2.0 and the leaderboard is now LIVE!
🚨 Before AI models are handed autonomy, one question matters more than any accuracy score: Do they know when to STOP and hand over to a human?
⚠️ A confident wrong diagnosis is far more dangerous than an honest “I don’t know.” Yet most models are bad at admitting the latter!
🚀 We release five RadLE 2.0 Scores: Confidence Weighted, Reliability, Accuracy, Safety and Handover Readiness and we find that models from @OpenAI@AnthropicAI@MetaAI@GoogleDeepMind@xAI@nvidia@Alibaba_Qwen@MistralAI@MiniMax_AI all score very differently as they optimize for different metrics!
🚨But most importantly, NONE of the Models have been able to reach the average human expert baseline!
⚡️A thread on what we found and which models aced our metrics! Link to the leaderboard and technical report at the end of the thread!
but if you need a message in your dm every time to start moving, maybe you should rethink how badly you want it
stable futures are built by those willing to move before certainty arrives
stability does not come from certainty
it comes from being ready for uncertainty, even when your certainty and conviction are at their strongest
they all ask me what should we do to thrive in this future so uncertain
i do not have one answer but one thing i am sure of is that uncertainty is often bullish on those who have nothing to lose
Grok 4.5 takes #2 spot on our medical Pathology benchmark 🔥
Impressive results on clinical interpretation, seems that @SpaceXAI is getting serious about medical reasoning capabilities.