Excited to share our latest work: REOrder. Optimizing patch order per task can lead to large accuracy gains, with improvements up to 13% on real-world data. Check it out!
Ever wondered if the way we feed image patches to vision models is the best way? The standard row-by-row scan isn't always optimal! Modern long-sequence transformers can be surprisingly sensitive to patch order. We developed REOrder to find better, task-specific patch sequences.
If you are interested to read more about my connectomes are necessary but not sufficient to understand function of nervous system, please read this X-article. This is one of my fav topic to discuss being an experienced electrophysiologist :)
https://t.co/iVFStfvcSG
@danrobinson Totally agree! It’s the same thing that happened with Eon in March, imo.
Waiting to verify with the code but just seems like a nothing burger
@evnsnclr@OpenAI Cool demo, but people are overinterpreting it.
Running the connectome does not mean it is generating fly-like behavior. Eon’s demo had the same issue. The behavior largely came from NeuroMechFly’s locomotion controllers. There’s no evidence the connectome itself was necessary.
@NioDiehard@evnsnclr@OpenAI The connectome gives you the nervous system’s structure. Who connects to whom and synapse counts as a rough proxy for strength. It doesn’t give you the actual neural dynamics or task-specific activity patterns. So there’s no reason it should produce useful robot-arm manipulation.
@evnsnclr@OpenAI Cool demo, but people are overinterpreting it.
Running the connectome does not mean it is generating fly-like behavior. Eon’s demo had the same issue. The behavior largely came from NeuroMechFly’s locomotion controllers. There’s no evidence the connectome itself was necessary.
Highly performant open weights frontier models such as Kimi are a competitive threat to OpenAI & Anthropic, but probably for everyone else these are a win. Hope more US entities will release top quality open weights models as well. Government regulation of AI models to prevent public harm could be done equally for proprietary or open weight models. Classic arguments in favor of open source software apply to AI models too.
1/ Progress in robot locomotion scaled with simulation, but touch was left behind. Our work, Tactile Genesis, unlocks sim for dexterous manipulation. Using sim to ablate tactile types and models, we can quickly converge to better tactile hardware and force-informed policies.
BREAKING: @AOC just introduced the AI Data Center Moratorium Act in the House.
The bill would ban the construction of data centers until Congress addresses the economic, environmental, and safety impacts of AI.
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees.
The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance.
Access to all other Claude models is not affected.
We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible.
Read our full statement: https://t.co/bwn0sximKZ