Introducing FLUX-mimic, a next-generation Video-Action Model for general purpose dexterity, developed in partnership with @bfl_ai.
Late last year we published mimic-video and introduced Video-Action Models (VAM): a new family of robotics foundation models built on top of video generation models. We showed that robot control reduces to visual prediction, and that robot capability is downstream of improvements in video modeling accuracy. The obvious implication was that advances in the video modeling frontier would directly translate to increased capabilities in end-to-end robot learning.
FLUX-mimic is that thesis at frontier scale: We've applied our VAM architecture to the strongest video backbone available today, FLUX 3 from Black Forest Labs, and trained it on data from our own robots and wearables. General-purpose dexterity, running on a single GPU on premises.
Because the model already understands world dynamics, it needs far fewer demonstrations to learn a new task. This is game-changing for our mission to deploy robots to factory floors, where industrial robot data is scarce and expensive to collect.
We're now testing and deploying FLUX-mimic with manufacturing leaders like @Audi, on complex, multi-step manipulation long considered impossible for conventional automation.
🚀 LingBot-VA 2.0 is here!
After half a year of teamwork, we're thrilled to release LingBot-VA 2.0 — a native video-action foundation model for generalizable robot control.
Unlike prior world-action models that retrofit generic video generators for robot control, LingBot-VA 2.0 is natively pretrained from scratch as a video-action foundation model.
Three key insights:
🌍 Native Video-Action Pretraining for learning world knowledge that enables strong generalization.
🧩 Semantic Visual-Action Tokenizer for more accurate action prediction with robust prompt following
⚡ Foresight Reasoning enables the robot to think ahead while acting, delivering continuous, responsive control without interrupting execution.
It runs in real time on consumer-grade GPUs, supports up to 150 Hz control, and generalizes to unseen tasks.
👇 Demos below
NVIDIA just open-sourced a model that takes broken, blurry 3D scans and rebuilds them clean from any angle..
It's called ArtiFixer. It uses video diffusion to generate the camera angles you never captured, then reconstructs the scene from the generated frames.
→ 70x faster than anything
→ Finishes in 1 to 4 steps
→ Beats SOTA by 3dB
→ Works from just text prompts
100% Open Source.
🚨 Forget LIDAR.
The Robbyant team just dropped a streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences.
One single camera. Runs in real time. Open-source.
Entirely end-to-end.
NO iterative optimization tricks and no post-processing cleanup steps!
It outperforms both existing streaming approaches and several offline methods.
100% Free and open-source.
Repo, paper and model weights in 🧵↓
A senior Google engineer just dropped a 19-page PDF on "Loop Engineering" for LLM and agentic systems.
Act → Observe → Learn → Repeat
• Act: the LLM proposes a code transformation (tile this loop, parallelize that one).
• Observe: a compiler runs it and reports back - is it valid? faster? slower? by how much?
• Learn: the LLM reads that feedback and adjusts its next move.
• Repeat until it stops finding improvements.
The agent gets smarter purely from grounded feedback inside its own context window.
This 19-page PDF totally changed the way I’m building agentic systems today.
Read it now, then explore the article below.
Teaching our open humanoid @ROBOTIS AI Sapiens to dance! 🤖💃
We extracted 3D motion from raw 2D video (no MoCap device!) and trained it in NVIDIA Isaac Sim. Thanks to high-precision DYNAMIXEL-Q, we achieved an ultra-low Sim2Real gap for fluid movement!
- Video: https://t.co/XAGbiB9IZZ
Introducing Cosmos 3: Our latest frontier model for Physical AI
Cosmos 3 is the world’s first fully open omnimodel with native vision reasoning, world and action generation.
Today we’re releasing Super (32B) and Nano (8B) variants.
No wonder they say teleoperation is dead
Peking University’s DAGroup released HumanNet, a massive 1 million hour dataset of human-centric videos that turns everyday internet footage into gold for embodied AI.
It’s got first-person and third-person views, super detailed actions, object interactions, tool use, and long sequences of real behavior. Everything’s cleaned up and annotated with 3D poses, SLAM tracks, and robot-ready labels.
The crazy part is,Training on just 1,000 hours of their first-person videos performs as well as (or even slightly better than) 100 hours of actual robot teleop data on downstream tasks.
Basically, human videos can now stand in for expensive robot data. Scaling laws for robotics just got a whole lot more realistic.
Human priors + smart curation = the future of world models.
🚨 ULTIMA HORA: Alguien acaba de conectar Claude directamente a Blender.
Ahora puedes construir modelos 3D complejos y geometrías avanzadas escribiendo solo un prompt de texto.
Sin código. Sin experiencia en 3D.
Your robot doesn’t need a policy anymore.
It can just write its own.
Coding Agents for Robotics:
Instead of training fixed models, robots become agents that:
• call perception and control APIs
• write code to solve tasks
• execute, observe, and improve in loops
This is a shift from “learning policies”
to programming behavior in real time.
And it works across robot arms, humanoids, and mobile systems.
What they built is deeper than it looks:
• full agentic toolkit (vision, depth, IK, grasping, navigation)
• CaP-Gym with 187 real manipulation tasks
• CaP-Bench benchmarking 12 frontier models
• CaP-Agent0 solving tasks without task-specific tuning
• CaP-RL boosting a 7B model from 20% → 72% in 50 iterations
Policies like VLAs become just another API call.
Which means:
You don’t train for every task anymore.
You let the agent figure it out on the fly.
From static policies to agentic systems that adapt in real environments.
Thanks for sharing, @DrJimFan !
Explore:
📍Project: https://t.co/6pHRqU2arI
Code: https://t.co/KQs840XU8A
Paper: https://t.co/2K0q6pnAOo
——
Weekly robotics and AI insights.
Subscribe free: https://t.co/9Nm01QUcw3