@fanf666@Builtin_Pb In fact, we've already completed the migration, but haven't released it yet to maintain consistency with the existing leaderboard. We'll seriously reconsider the release as part of this round of updates.
The main reasons we initially chose Isaac over MuJoCo were its better developer experience, stronger visual capabilities, and more mature ecosystem. However, with the help of coding agents, developer-friendliness may no longer be as important as it used to be. We're also actively migrating to the Newton physics engine and developing more comprehensive physics solvers.
@andylizf Thanks for the community’s attention and feedback! We’ll address these issues and release an updated version of RoboDojo Verified within the next 1–2 weeks. Feel free to share any further suggestions!
@HaoruXue Thanks for the community’s attention and feedback! We’ll address these issues and release an updated version of RoboDojo Verified within the next 1–2 weeks. Feel free to share any further suggestions!
Honored to see RoboDojo included in Anthropic's official evaluation of Claude Fable 5.2!
Is the Bitter Lesson coming for robotics?
General-purpose foundation models are improving incredibly fast (or maybe our benchmark just isn't challenging enough 😅).
For robotics companies, efficiency might be the real moat.
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do.
On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do.
On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
Scale up testing for complex robot manipulation. 🤖
RoboDojo is now available on NVIDIA Isaac Lab-Arena, bringing challenging bimanual tasks like precision insertion, folding, tool use, and multi-step manipulation to scalable evaluation in simulation.
💡Our view: RSI is a systems engineering problem, not just a model problem.
Progress depends on the environment a research agent works in: what resources it can call, what it can change, and how it runs experiments. That environment should reflect real production workflows and be easy for agents to use.
At @Evolvent_AI, we built RSIGym around Everything as a Service. Agents can call established research services and iterate on data, training settings, and harness code.
We also introduce RSI-Index to measure how well frontier agents jointly improve a target model’s weights and harness. Across 6 research agents and 5 benchmarks, Opus 5 leads at 0.4809. 🧵
We’re releasing the code, experiment configurations, research trajectories, and evaluation logs. Try your own improvement methods with RSIGym.
🌐 Website: https://t.co/vXiqt3YUN5
💻 GitHub: https://t.co/chjL41y9OH
📄 arXiv: https://t.co/UpDi0y6fIV
What about dis-assembling?
Excited to share some results (more coming next week!) deploying pi0.7 on a AI hardware dis-assembling task partnering with @physical_int. The robot autonomously removes retaining bars, riser boards, and fans with only 1.5 hours of post-train.
🔥 Liber-0 Preview is now #1 on RoboDojo, with a 30.74 overall score.
It performs strongly across long-horizon execution, precision, memory, and generalization — and is the only one 👀 above GPT-6 Astra overall.
But the part I find most interesting is this:
RoboDojo is a gripper benchmark.
Liber-0 is built on a bet that human experience is the largest source of embodied intelligence — and that the real challenge is transferring that intelligence efficiently across embodiments.
A gripper is much more constrained than a human hand.
Yet after adaptation, that human-derived intelligence still transfers well enough to lead the benchmark.
That’s a pretty interesting signal.
This gripper benchmark is simply an early test of whether the intelligence transfers.
So far, it does.
https://t.co/l1okElpe5e
We put GPT-6 Astra in the RoboDojo. 🥋🤖
The RoboDojo Team conducted a comprehensive evaluation of GPT-6 Astra as an embodied agent, including:
• RoboDojo Sim & Real, compared with GPT-5.5 and DeepSeek-Flash
• Humanoid high-level control
• Dexterous piano playing with RoboPianist 🎹
• A systematic study of in-context learning (ICL)
Our key takeaway:
GPT-6 Astra demonstrates remarkably strong semantic and spatial understanding, together with impressive in-context adaptation.
At the same time, physical commonsense remains a clear bottleneck — revealing an important gap between understanding the world and truly reasoning about its physics.
Full report & demos:
https://t.co/EwLGoPxWqr
@_wenbozhang (project lead), @wenhaocha1, @frankzydou, @JinWeiyang18434, @YutaoOuyang, @minifullcapsule, @x_h_ucb, @YutaoOuyang, @YueChen614