Excited to share T-Rex: Tactile-Reactive Dexterous Manipulation ๐ฆ๐ค
Touch is fundamental to human dexterity, yet most Vision-Language-Action (VLA) models either ignore tactile feedback or lack the ability to react to high-frequency contact signals.
In this work, we tackle both the data and architectural challenges of tactile-reactive dexterous manipulation.
๐ฆ A 100-hour tactile-synchronized dexterous manipulation dataset with 7,700+ trajectories, 22 motor primitives, and 200+ everyday objects.
๐ฆ A tactile-reactive MoT architecture with spatial-temporal tactile encoding and asynchronous high-frequency tactile refinement.
๐ฆ A scalable training recipe combining 22,889 hours of human egocentric pretraining with tactile-grounded robot mid-training.
Across 12 real-world contact-rich manipulation tasks, T-Rex achieves over 30% higher average success rate than the strongest baseline.
We are fully open-sourcing the dataset, models, teleoperation stack, training code, and inference pipeline.
๐ Project: https://t.co/AiHKRR8YXU
๐ Paper: https://t.co/mXY2UNLlqc
๐ป Code: https://t.co/7skCxUtwKC
๐ค Dataset: https://t.co/uNwW8dcRZL
๐งต Thread โ
Excited to share T-Rex: Tactile-Reactive Dexterous Manipulation ๐ฆ๐ค
Touch is fundamental to human dexterity, yet most Vision-Language-Action (VLA) models either ignore tactile feedback or lack the ability to react to high-frequency contact signals.
In this work, we tackle both the data and architectural challenges of tactile-reactive dexterous manipulation.
๐ฆ A 100-hour tactile-synchronized dexterous manipulation dataset with 7,700+ trajectories, 22 motor primitives, and 200+ everyday objects.
๐ฆ A tactile-reactive MoT architecture with spatial-temporal tactile encoding and asynchronous high-frequency tactile refinement.
๐ฆ A scalable training recipe combining 22,889 hours of human egocentric pretraining with tactile-grounded robot mid-training.
Across 12 real-world contact-rich manipulation tasks, T-Rex achieves over 30% higher average success rate than the strongest baseline.
We are fully open-sourcing the dataset, models, teleoperation stack, training code, and inference pipeline.
๐ Project: https://t.co/AiHKRR8YXU
๐ Paper: https://t.co/mXY2UNLlqc
๐ป Code: https://t.co/7skCxUtwKC
๐ค Dataset: https://t.co/uNwW8dcRZL
๐งต Thread โ
As an historic reference this is what happens when high capacity deep models with the right architecture hits a domain where data is available and legacy methods were stuck for decades @CVPR KeyNote
@DJ_CURFEW If your best engineers are spending time reviewing other people's code, then this is inherently an inefficient bottleneck. These engineers can review their agent's code much faster than reviewing human code.
==> why?
@garrytan Not the west. America.
Italy food industry is still primarily family run. So itโs Spain and to some extent Italy - likely Greece.
No wonder the service and quality, and also the prices, itโs better in all directions all at once (not a compromise).
@ns123abc They just lost all cofounders. Nobody care about this they are fourth in the US over 4 contenders and likely behind a bunch of Chinese and French teams that have 1/100 capital. Nobody cares