🤖Can robots play Texas Hold’em? 🤔
We introduce DexHoldem, a real-world benchmark for dexterous manipulation and embodied agents.
After fine-tuning leading VLAs and pairing them with frontier agents, we found:
Robots can move the chips — sometimes.
Agents can read the table state — sometimes.
Unfortunately, poker requires both to happen correctly in the same hand.
So no, robots are not ready to take your money at the casino — yet.
More below 👇
If what the reviewer, area chair, meta review and program chair do is just feeding all (or even all) information into AI, what is the point of my submitting the manuscript to the meeting?
Then I congratulate neurips on becoming the first thing in the world to achieve RSI!
#Neurips2026 #RSI
Let’s put them side by side. 👀
Right: A month ago, GPT-5.6 Sol barely managed to complete the two-disk task—even with a whole toolbox of helpers.
Left: GPT-6 made it halfway through the five-disk task, using only rendered camera images and robot joint angles as observations.
Why only halfway? You’ll have to ask Astra why it’s so hungry for tokens. 😂
We’re releasing a repo soon with our latest experiments on LLMs + harnesses directly controlling robot arms and dexterous hand across several simulation environments.
Once it’s public, bring your own LLM and harness and give it a spin! We’d love to see what you build—and how far you get before the tokens run out. 🤖
Stay tuned, and happy experimenting!
If Tibo could help me get some reset, the release would be even faster! @thsottiaux
For me, learning how to do something is more important than make something work. Academia is the place for students to learn, not the place to work for supervisors’s ridiculous requirements.
Inspired by recent thoughts from senior researchers whom I deeply respect (e.g. @JitendraMalikCV@Michael_J_Black@Ken_Goldberg@phillip_isola), I wrote down some thoughts as a junior researcher too.
The recent Astra demos in dexterous manipulation are truly impressive. But they also raise two questions that I don’t think academia has good answers to yet:
- How should credit be assigned when an agent synthesizes many prior works into a new research result?
- How can academia attract and retain talents when so much of its incentive structure relies on credit?
I reflect on these questions in more detail in a blog post. Curious to hear what others think, and debates are very welcome!
https://t.co/52qCV6CPMY
Evolving dexterity with GPT-6 Astra 🖐️
Been trying Astra recently. Its zero-shot dexterous manipulation is already quite surprising. More interesting is seeing it learn and improve through simulation training, from pen spinning and Rubik's Cube to hammer use.
The real goal would be to evolve this dexterity in the real world.
https://t.co/GZjQTsklYc
29hours, GPT6, only vision input and perception state, 38 times trying, rotating the pocket cube one time.
Something interesting is GPT6 tried to access more information in simulator but detected by itself and killed.
The recent attempt in agentic robotics has inspired me.
1. The grasping task usually has a good effect, because the grasping itself is closer to the processing of static scenes (including dexterous hand grasping!)
2. Collisions and avoiding collisions are difficult for LLM, and it is difficult to solve by yourself without human help (humans have some mobile experience to prevent collisions)
3. At present, dexterity operation is still the territory of imitation learning and reinforcement learning, but who knows how long it will last?
Final question, in addition to collecting data, what skills do you currently master within five years cannot be replaced by LLM?
Thanks Pei Zhou for the interesting demo. Thanks @alex_kai2020@Lixuan_thu for communicating and helping.