@Yunsong_Zhou It's really great to see the progress of simulation in manipulation. I want to ask if sim1 has tactile or force simulation? This is very important for fine granted and flexible operation learning.
We're bullish that tactile AI will unlock dexterous manipulation in robotics. At NVIDIA GTC, our VP of Research Xuezhou Zhu will present how leverages tactile AI and CraftNet, our tactile-enabled VLA architecture, to accelerate robot training and real-world deployments.
This presentation will cover:
• How high-DoF dexterous hands perform complex manipulation.
• Generating physically realistic training data via reinforcement learning in simulation in NVIDIA Issac Sim.
• Bridging the Sim-to-Real gap with real hardware validation.
Watch the full presentation: https://t.co/B4xOWpzEWb
Meet with Sharpa at GTC Booth #1838, Hall 3
#NVIDIAGTC @NVIDIARobotics
𝗔𝗳𝘁𝗲𝗿 𝟭𝟬+ 𝘆𝗲𝗮𝗿𝘀 𝗶𝗻 𝗿𝗼𝗯𝗼𝘁 𝗹𝗲𝗮𝗿𝗻𝗶𝗻𝗴, from my PhD at Imperial to Berkeley to building the Dyson Robot Learning Lab, one frustration kept hitting me:
𝗪𝗵𝘆 𝗱𝗼 𝗜 𝗵𝗮𝘃𝗲 𝘁𝗼 𝗿𝗲𝗯𝘂𝗶𝗹𝗱 𝘁𝗵𝗲 𝘀𝗮𝗺𝗲 𝗶𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗼𝘃𝗲𝗿 𝗮𝗻𝗱 𝗼𝘃𝗲𝗿 𝗮𝗴𝗮𝗶𝗻?
𝗧𝗵𝗲 𝗽𝗮𝘁𝘁𝗲𝗿𝗻 𝗜 𝗸𝗲𝗽𝘁 𝘀𝗲𝗲𝗶𝗻𝗴:
• New robotics team starts
• Spends 6 months building data collection pipeline
• Spends another 3 months debugging synchronization issues
• Finally starts collecting task-specific data
• Realizes their infrastructure choices limit their flexibility
• Starts over
𝗧𝗵𝗶𝘀 𝗶𝘀 𝘁𝗵𝗲 𝘄𝗵𝗼𝗹𝗲 𝗽𝗼𝗶𝗻𝘁 𝗼𝗳 𝗿𝗼𝗯𝗼𝘁 𝗹𝗲𝗮𝗿𝗻𝗶𝗻𝗴: Robot learning is fundamentally data-driven. Whether you're picking strawberries or assembling electronics, the core infrastructure needs are identical. That's actually why I was so interested in pursuing data-driven robotics over a decade ago.
𝗬𝗼𝘂 𝗮𝗹𝘄𝗮𝘆𝘀 𝗻𝗲𝗲𝗱:
• Multi-sensor data synchronization across different frequencies
• Flexible storage that works with future algorithms
• Visualization tools to understand your data
• The ability to experiment with different temporal resolutions
• Robust logging that captures everything you might need later
The trend towards AI in robotics is growing, with robots needing to process and analyze large amounts of sensor data to manage variability and unpredictability in real environments.
𝗕𝘂𝘁 𝗲𝘃𝗲𝗿𝘆 𝘁𝗲𝗮𝗺 𝗯𝘂𝗶𝗹𝗱𝘀 𝘁𝗵𝗶𝘀 𝗳𝗿𝗼𝗺 𝘀𝗰𝗿𝗮𝘁𝗰𝗵. Imagine if every web developer had to build their own database, web server, and deployment pipeline before writing their first line of application code.
𝗧𝗵𝗶𝘀 𝗶𝘀 𝘄𝗵���� 𝗜 𝗳𝗼𝘂𝗻𝗱𝗲𝗱 𝗡𝗲𝘂𝗿𝗮𝗰𝗼𝗿𝗲.
Instead of every robotics team spending months on infrastructure, we provide the common tools that let you go from "I have a robot" to "I'm shipping intelligent robot behaviors" in days, not months.
𝗧𝗵𝗲 𝗿𝗲𝗮𝗹 𝗶𝗻𝗻𝗼𝘃𝗮𝘁𝗶𝗼𝗻 𝗶𝗻 𝗿𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝘄𝗼𝗻'𝘁 𝗰𝗼𝗺𝗲 𝗳𝗿𝗼𝗺 𝗲𝘃𝗲𝗿𝘆𝗼𝗻𝗲 𝗿𝗲𝗯𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝘁𝗵𝗲 𝘀𝗮𝗺𝗲 𝗽𝗹𝘂𝗺𝗯𝗶𝗻𝗴. 𝗜𝘁'𝗹𝗹 𝗰𝗼𝗺𝗲 𝗳𝗿𝗼𝗺 𝘁𝗲𝗮𝗺𝘀 𝘄𝗵𝗼 𝗰𝗮𝗻 𝗳𝗼𝗰𝘂𝘀 𝗲𝗻𝘁𝗶𝗿𝗲𝗹𝘆 𝗼𝗻 𝘄𝗵𝗮𝘁 𝗺𝗮𝗸𝗲𝘀 𝘁𝗵𝗲𝗶𝗿 𝗮𝗽𝗽𝗹𝗶𝗰𝗮𝘁𝗶𝗼𝗻 𝘂𝗻𝗶𝗾𝘂𝗲.
Robot learning shouldn't be bottlenecked by infrastructure. It should be bottlenecked by creativity.
What's the longest you've spent building infrastructure before getting to the actual robotics problem you wanted to solve?
Most imitation learning policies break when the camera moves or the robot changes.
NOT THIS ONE 👇
[📍 Bookmark for later ]
A new 3D scene representation encoder, tackles this by enabling zero-shot generalization to unseen embodiments and viewpoints…
And it works with any IL algorithm.
The trick?
•Use a 2D foundation model to extract semantic features
•Lift them into 3D space for localization (not semantics)
•Condition the IL policy on this spatially grounded vector
Across 93 simulated and 6 real tasks, Adapt3R:
✅ Maintains IL performance on LIBERO & MimicGen benchmarks
✅ Outperforms DP3 and 3D Diffuser Actor in most settings
✅ Holds >80% success on LIBERO even with large camera rotations
Thanks for sharing this, @animesh_garg & @albertwilcoxiii!
📍Paper: https://t.co/WYf9volUWd
Website: https://t.co/iLnqJEg6ES
Code: https://t.co/wryyQLHuCC
The first universal 3D robot viewer for the browser… load URDF, MJCF, or USD in seconds.
No installs. No setup.
Developer Victor Oldensand has built Mechaverse, a universal 3D robotics viewer that works on desktop and even mobile (if your phone is strong enough).
No installs. No setup. Just drag and drop your robot model.
Mechaverse merges and improves the work of several open-source projects, including:
✅ Mujoco_wasm (MuJoCo in the browser)
✅ USD-viewer (OpenUSD)
✅ URDF-loaders
… into one clean, cross-platform tool.
💻 Try it here: https://t.co/P8lPDBJltm
Built in just 4 days, it supports URDF, MJCF, and OpenUSD formats via Three.js, with rendering powered by WebAssembly.
Perfect for quickly inspecting robot models or scenes without heavyweight desktop software.