Ben Duffy

Building robots which can see through walls. And humanoids.
Co-founder at and

[Ben Duffy @benduffyMMM]

Releasing:

Johnny the humanoid vs. the socks

https://t.co/OoYWnLSNQy

[Ben Duffy @benduffyMMM]

Claude Opus 4.7 likes:
Phases, tasks, gates, stages, rungs

[Ben Duffy @benduffyMMM]

https://t.co/ghLgKRPZlV

[Ben Duffy @benduffyMMM]

A year ago, I asked all LLMs back then (claude 3.7 + grok 3 + deepseek v3 + gemini 2.5 + deep research) to predict the next 5 years of progress and partially to assess the plausability of the AI 2027 report.

One thing the report got is that all the labs are focusing on recursive improvement e.g. with Codex 5.3 helping created Chat Gpt 5.4 and so on i.e. "closing the loop".

Anyway, this year, new prompt and new models. Getting more quantitative and then will ask chatgpt 5.4 to summarise all answers and compare. Getting a bit meta to ask multiple AI agents to predict future progress of AI and compare previous forecasts. Grok is supposed to be optimised on forecasting accuracy!

Summary from ChatGPT of below answers from 5.4, gemini, grok and claude 4.6 sonnet:

[Ben Duffy @benduffyMMM]

Right, starting now, for shits and giggles, I will ask the top ~5 models every year on April 6th to:

"predict the next 5 years of AI and AGI progress"

Then we can compare over the years:
1. How right/wrong this forecast report got it

/th

[Ben Duffy @benduffyMMM]

https://t.co/rmSsBTtmPk

[Ben Duffy @benduffyMMM]

I love talking to mini AGIs about what a true AGI will be like

[Ben Duffy @benduffyMMM]

@karpathy Why not just make all the agents click through websites? I thought computer use is "almost there" shown by claude chrome extension and ChatGPT agent? Of course first step is to give them permissions. Redesigning everything for text in and text out isn't the dream of digital AGI.

[Ben Duffy @benduffyMMM]

I love robots

But sometimes they don't love me... 🥲

[Ben Duffy @benduffyMMM]

Humanoids. Built in our own image...
THE HUBRIS!!!
I love it!

[Ben Duffy @benduffyMMM]

Software development has changed so rapidly, even over last month... Gonna listen to their book.
https://t.co/9COonDEPhL

[Ben Duffy @benduffyMMM]

omg, we live in the future, claude is taking control of my browser to add my dishwasher and 15 other items as ads in ebay (kleinanzeigen) and facebook marketplace.

[Ben Duffy @benduffyMMM]

Missed this one. 2026/2027 is gonna be the year of AI and science combined.

[Ben Duffy @benduffyMMM]

Cursor's composer-1 frontier LLM is super fast and accurate highly underated!

[Andrej Karpathy @karpathy]

The first 100% autonomous coast-to-coast drive on Tesla FSD V14.2! 2 days 20 hours, 2732 miles, zero interventions.

This one is special because the coast-to-coast drive was a major goal for the autopilot team from the start. A lot of hours were spent in marathon clip review sessions late into the night looking over interventions as we attempted legs of the drive over time - triaging, categorizing, planning out all the projects to close the gap and bring the number of interventions to zero.

Amazing to see the system actually get there and huge congrats to the team!

[Ben Duffy @benduffyMMM]

@abhitwt Ok, on it

[Chris Offner @chrisoffner3d]

Paper naming conventions are reaching a climax.

[Ben Duffy @benduffyMMM]

@yacineMTB Research is ongoing. Cool.

[Ben Duffy @benduffyMMM]

@yacineMTB For RL research full mujoco suite for musculoskeletal motor control:
https://t.co/D4uG3CKiXi

[Ben Duffy @benduffyMMM]

https://t.co/frOVYVrbg5

[Thomas Miconi @ThomasMiconi]

I'd like to look back at the two mega-papers on Minecraft RL that just came out, from @OpenAI and @nvidia.

They both rely on diabolically clever ideas... but in completely different directions.

[Ben Duffy @benduffyMMM]

Somehow missed this. Always love Minecraft/open-ended papers!

Voyager paper blew my mind, but used code-gen on the Mineflayer API! 2022 pixel-to-action papers below are similar but used fine tuning. But this is with only offline data! I think very relevant for robotics.