What makes egocentric video data critical for robot learning?
Frontier robotics and world-model research demands massive volumes of first-person video showing natural human behavior in diverse real-world environments.
Egocentric video data captures the world from the perspective of the actor performing a task, providing the visual grounding that embodied AI models need to connect perception with action. Unlike third-person footage, first-person video preserves the spatial relationships between hands, tools, and objects as they appear during manipulation. #PhysicalAI
Introducing the Global Researcher Map 🌎
We mapped every AI researcher into a visual landscape you can explore
Search your favorite authors, topics, or institutions, and see who’s behind the work
Simply mixing raw, in-the-wild human videos into robot training actually hurts policy performance. The fundamental problem is that humans and robots move in fundamentally different ways.
EgoWAM closes this embodiment gap by focusing on world representations instead of raw motions👍🏻
Motion-centric representations and strong visual pretraining each tackle different parts of this gap.
Egocentric human data is abundant, but human motion is not always positive supervision for robot policy due to embodiment gaps. Naive BC co-training can HURT performance ☹️.
🌟Our key finding in **EgoWAM**: the state-prediction branch of a World Action Model effectively bridges this embodiment gap, enabling robot performance to scale with diverse **in-the-wild** human data.
💡The key question then becomes: what world representation transfers best across embodiments?
👇����Let’s take a deep dive into it:
🌐 https://t.co/VnhUs8CFKf
🧵[1/]
@BaoyuLi6 Nice work!
Naive BC co-training on raw human motions backfiring due to embodiment mismatch is a super important gotcha. Looking forward to the code & data drop.
Every video passes through an automated quality pipeline that detects issues and removes non-compliant frames before delivery.
- Hand detection & visibility scoring
- Auto-removal of frames without hand presence
- Corrupt frame and dropout detection
- Low-light & excessive motion filtering
- Audio quality flags
- Privacy compliance verification
The primary bottleneck for robots in real-world settings, particularly homes, is not hardware, but high-quality, diverse human action data.
Traditionally, training robots required engineers to manually teleoperate arms in labs. This approach was costly, slow, and produced limited, poorly generalizable data.
Hydrobotics offers a superior solution. We use iPhone motion sensors to crowdsource authentic videos of everyday human tasks such as washing dishes, walking, and folding clothes. Our AI-powered quality validation pipeline then converts these into structured action sequences containing speed, trajectory, acceleration, and force data—rich "motion textbooks" that robots can directly learn from.
By reducing collection costs by dozens of times while delivering 50-70% gross margins, we provide scalable, high-fidelity data far beyond traditional methods. Hydrobotics is building the essential action data infrastructure to accelerate embodied AI from lab prototypes to practical deployment.
#Hydrobotics #PhysicalAI
The best measure of a summit is not what happens on stage. It is what the room says walking out.
The word we heard most today was energy. From founders, from investors, from operators, from researchers. A room full of the people building Physical AI, in the same building, all agreeing on the same thing. The category is no longer waiting to arrive. It is here, it is moving fast, and it is the most interesting thing in technology right now.
Thank you to everyone who brought that energy into Station F today. This is why we built MACHINA.
MACHINA Summit, Europe's Leading Physical AI Event.
#MACHINA2026 #PhysicalAI
What if robots could remember and learn from their own fastest success, even when it came from a “lucky” trial?
People often treat efficiency as something to optimize after success. Our new work, Temporal Self-Imitation Learning (TSIL), takes a different view: fastest success itself can be a useful training signal in reinforcement learning.
TSIL turns rare fast successes discovered during interaction into two learning signals: adaptive temporal targets that encourage faster completion in a self-paced way, and fast-success self-imitation that helps preserve efficient behaviors before they are forgotten.
Across 15 challenging long-horizon manipulation tasks, TSIL improves learning efficiency, task-completion efficiency, and training stability. If training your robot policy feels like endless tuning, give TSIL a shot😄!
Grateful to my advisor @Boyuan__Chen for the guidance and support on this work.
- Paper: https://t.co/YbHr1woHSy
- Project page: https://t.co/WjtOCuAxwk
- GitHub: https://t.co/7RQalRMvJq
What happens when robot world models learn from human experience at scale? 🤔
DreamDojo from NVIDIA Research is a generalist robot world model pretrained on 44K hours of egocentric human videos and then post-trained on robot data to generalize across new objects and environments.
After distillation, it runs at 10 FPS for live teleoperation, policy evaluation, and model-based planning.
Read the ICML paper to learn more 📄 https://t.co/9uzF8PY5MH
.@NVIDIARobotics has just released a fine-tuned GR00T N1.7 robot policy on Hugging Face. It was trained on the LIBERO benchmark for Panda robot arm manipulation tasks.
Robotics is hitting a wall that larger models alone cannot climb.
Physical AI cannot scale on videos alone, and these papers show why.
@ManycoreTech research team’s #ECCV2026 accepted paper SPEAR turns Unreal Engine from a visual simulator into a programmable robotics training system.
Its big step is exposing 14K UE functions to Python while rendering 1080p frames at 73fps. Gives you scriptable worlds, agents, cameras, materials, labels, and deterministic scene execution.
#Simulation #EmbodiedAI #SpatialIntelligence