What is the best way to learn behaviors from videos? By modeling point trajectories, our method, ATM, helps robots learn even from videos of humans and other robots 🤝
Grateful to have worked with amazing collaborators; check it out below!
What state representation should robots have? 🤖 I’m thrilled to present an Any-point Trajectory Model (ATM), which models physical motions from videos without additional assumptions and shows significant positive transfer from cross-embodiment human and robot videos! 🧵👇
the six love languages are words of affirmation, quality time, gift giving, acts of service, physical touch, and..
..machine learning. this year ML valentines have a new home on the internet <3
I spent the past month reimplementing DeepMind’s Genie 3 world model from scratch
Ended up making TinyWorlds, a 3M parameter world model capable of generating playable game environments
demo below + everything I learned in thread (full repo at the end)👇🏼
Your bimanual manipulators might need a Robot Neck 🤖🦒
Introducing Vision in Action: Learning Active Perception from Human Demonstrations
ViA learns task-specific, active perceptual strategies—such as searching, tracking, and focusing—directly from human demos, enabling robust visuomotor policies under visual occlusions. 🧵👇
Introducing ✨Latent Diffusion Planning✨ (LDP)! We explore how to use expert, suboptimal, & action-free data. To do so, we learn a diffusion-based *planner* that forecasts latent states, and an *inverse-dynamics model* that extracts actions.
w/ @_oleh@DorsaSadigh@chelseabfinn
Today, we're releasing a new paper – One-Minute Video Generation with Test-Time Training.
We add TTT layers to a pre-trained Transformer and fine-tune it to generate one-minute Tom and Jerry cartoons with strong temporal consistency.
Every video below is produced directly by the model in a single shot, without editing, stitching, or post-processing. Every story is newly created.
Demos: https://t.co/BSHsucizoG
Paper: https://t.co/agJKUAExpz
A simple idea to build the @UCBerkeley startup alumni network has grown beyond my wildest dreams into #AccelScholars, a tight-knit community of the most ambitious, talented, kind-hearted people, whose individual stories we’ve been fortunate to support for the past eight years
Time to democratize humanoid robots!
Introducing ToddlerBot, a low-cost ($6K), open-source humanoid for robotics and AI research.
Watch two ToddlerBots seamlessly chain their loco-manipulation skills to collaborate in tidying up after a toy session.
https://t.co/tIrAUCbzNz
Can robots leverage their entire body to sense and interact with their environment, rather than just relying on a centralized camera and end-effector?
Introducing RoboPanoptes, a robot system that achieves whole-body dexterity through whole-body vision.
https://t.co/encmRFhxM0
Update on @suchirbalaji
We hired private investigator and did second autopsy to throw light on cause of death. Private autopsy doesn’t confirm cause of death stated by police.
Suchir’s apartment was ransacked , sign of struggle in the bathroom and looks like some one hit him in bathroom based on blood spots.
It’s a cold blooded mu*d*r declared by authorities as suicide.
Lobbying in SF city doesn’t stop us from getting justices.
We demand FBi investigation
@elonmusk@VivekGRamaswamy@GavinNewsom@MEA
Can robots acquire real-world manipulation skills without real-world robot training data?
Introducing Im2Flow2Act:
— a framework that leverages object flow to bridge human video and simulation data, enabling scalable skill acquisition.
Project Website: https://t.co/SgrLC8iLAs
Can my robot cook my food, rearrange my dresser, tidy my messy table and do so much more without ANY demos or real-world training data?
Introducing ManipGen: A generalist agent for manipulation that can solve long-horizon robotics tasks entirely zero shot, from text input!
1/N
Can robots learn to manipulate with both care and precision? Introducing Adaptive Compliance Policy, a framework to dynamically adjust robot compliance both spatially and temporally for given manipulation tasks from human demonstrations. Full detail at https://t.co/fVsG4jq0T6
We recently launched https://t.co/mshIJSnIYu as a community-driven effort to pool UMI-related data together. 🦾
If you are using a UMI-like system, please consider adding your data here. 🤩🤝
No dataset is too small; small data WILL add up!📈