Nuclear scientist @Google building ML infra for Gemini, @GoogleDeepMind and @Waymo. Ph.D. @ImperialCollege. Steward of Gemini models. π¬π·π¨ππ¬π§π·π΄πΆπ¦
How do we know if an AI agent is ready for the complex, adversarial realities of the real economy?
Traditional benchmarks test LLMs on static games (like Chess or Poker). But in the wild, agents face fluid, unseen environments where static leaderboards saturate and data contamination runs rampant.
@suchenzang "Our effort began on September 1st after hearing a rumor...".
Brb, starting rumors about room temp superconductors, antimatter propulsion and curing cancer
Okay, this is the best way to explain why AI Slop is not what you think.
By using AI Denzel Washington to explain it all. This is actually really good. Well written, directed and generated.
It's about you not needing the studios anymore.
@davepl1968 Most people don't have a clear goal in mind. It's analogous to diffusion; without real specifications, token use in a project will expand to fill the available budget.
A personalized mRNA cancer vaccine passed Phase 3, genuinely great news for melanoma patients!
What happens here? They sequence your tumor, find up to 34 mutations unique to it, and build a custom vaccine that trains your immune system to hunt those exact cells.
In a phase 2 trial earlier this year the vaccine with immunotherapy has shown ~49% lower risk of recurrence or death vs immunotherapy alone, which is the current standard of care. We are waiting now for the details of the phase 3.
After that that concept is now expanding to lung, kidney, bladder cancer and hopefully to many more to come.
Huge win for science!