Teleoperation is usually used to control robots. We present DITTO-X, a framework that works both ways:
ποΈβ‘οΈπ€ In forward teleoperation, you can control diverse dexterous hands with force and haptic feedback.
π€β‘οΈποΈ In reverse teleoperation, the robot moves your hand to match its own state while an autonomous policy runs, so you can intervene fluently whenever it goes wrong.
Why does this matter? Taking over a dexterous hand mid-task is hard. Any mismatch between your hand pose and the robot state can cause an unstable grasp and make the robot drop the object. With reverse teleoperation, every takeover starts from the robot's own state, and these smooth interventions become DAgger data that make our policy more robust each round.
Find more information at:
π https://t.co/pUunM8u15L
π https://t.co/tVBEuJ8Z3I
co-led with @jbps_2001.