https://t.co/cqYb3N9e85
ACP yourself.
Video 1: vault, climbing, jumping, get up,
Video 2: sit
Video 3: ultra-hard standing on vaulting wall
PC & Phone both supported.
(more scenes still under construction)
This is one of the most promising depth encoders I’ve seen, demonstrating a remarkable ability to even enable segmentation directly from depth. Excited to see the many future works that build upon this encoder!
#Robotics#foundation#models#learning#vision#research
Vision foundation models like DINO and SigLip now power much of robot learning.
But they are built for RGB. What about depth?
Introducing DeFM: a foundation model for depth images, built for robotics.
🌐 https://t.co/KzloKyRZyF
Weights, code, and demo are out today 🧵
Trained the FPM + locomotion policy inside a world model, SuperMimic-style, on my 4070 Super. Far from perfect, the force assistance curriculum didn't carry over, but sparse terrain success surprised me. Not sure about deploying such a policy, but the direction is very promising.
Vision foundation models like DINO and SigLip now power much of robot learning.
But they are built for RGB. What about depth?
Introducing DeFM: a foundation model for depth images, built for robotics.
🌐 https://t.co/KzloKyRZyF
Weights, code, and demo are out today 🧵