(1/3)
πExcited to announce Simulatelyπ€, a go-to toolkit for robotics researchers navigating diverse simulators!
π» Github: https://t.co/GlNWqtBtHc
π Website: https://t.co/i73EkUQbqw
Letβs level up our robotics research with Simulately!
#Robotics#Simulators#ResearchTool
#SimulatelyPapers | July 03, 2025
π AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulation π https://t.co/sGPHf77I9T
π RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluation π https://t.co/dDZgv08zdP
π Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations π https://t.co/iwfB2LfSEs
π DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover π https://t.co/ZEfpsHpHP0
π SAM4D: Segment Anything in Camera and LiDAR Streams π https://t.co/u1EPZzrEn1
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | June 26, 2025
π DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policy π https://t.co/v3wtjn17mR | [Project](https://t.co/HGhcBeRojS)
π FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulation π https://t.co/yAezwm7lG0 | [Project](https://t.co/NvGucgPNdT)
π RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation π https://t.co/hK7a71GpCc
π RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies π https://t.co/R80fSufg08
π Learning Accurate Whole-body Throwing with High-frequency Residual Policy and Pullback Tube Acceleration π https://t.co/jyFBdmMIB3
π Dex1B: Learning with 1B Demonstrations for Dexterous Manipulation π https://t.co/nwL3rnjpjf | [Project](https://t.co/9D0A998yE9)
π Vision in Action: Learning Active Perception from Human Demonstrations π https://t.co/02Emx67fDA
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | June 26, 2025
π DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policy π https://t.co/v3wtjn17mR | [Project](https://t.co/HGhcBeRojS)
π FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulation π https://t.co/yAezwm7lG0 | [Project](https://t.co/NvGucgPNdT)
π RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation π https://t.co/hK7a71GpCc
π RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies π https://t.co/R80fSufg08
π Learning Accurate Whole-body Throwing with High-frequency Residual Policy and Pullback Tube Acceleration π https://t.co/jyFBdmMIB3
π Dex1B: Learning with 1B Demonstrations for Dexterous Manipulation π https://t.co/nwL3rnjpjf | [Project](https://t.co/9D0A998yE9)
π Vision in Action: Learning Active Perception from Human Demonstrations π https://t.co/02Emx67fDA
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | June 18, 2025
π ClutterDexGrasp: A Sim-to-Real System for General Dexterous Grasping in Cluttered Scenes π https://t.co/ysi3Lqiwnu | [Project](https://t.co/V6OIG0QkEI.)
π Tactile Beyond Pixels: Multisensory Touch Representations for Robot Manipulation π https://t.co/HDjlys2JYC
π GMT: General Motion Tracking for Humanoid Whole-Body Control π https://t.co/X739r3qJkx | [Project](https://t.co/HTedIwkSFx.)
π RL from Physical Feedback: Aligning Large Motion Models with Humanoid Control π https://t.co/m1JVHBqRHE
π From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots π https://t.co/ujJDvXF1l8
π KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills π https://t.co/gzgWHjffCL | [Project](https://t.co/jfCNmr0f2Q.)
π LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction π https://t.co/7q1OjpD2mo
π Prompting with the Future: Open-World Model Predictive Control with Interactive Digital Twins π https://t.co/Y5SOcnP1RR
π Touch begins where vision ends: Generalizable policies for contact-rich manipulation π https://t.co/VOYZgqjzDS | [Project](https://t.co/56gdGY7NY3.)
π Construction of a Multiple-DOF Under-actuated Gripper with Force-Sensing via Deep Learning π https://t.co/Qeb6R3H7cs
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | June 03, 2025
π FreeTacMan: Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulation π https://t.co/0zNf1cZmAO
π Feel the Force: Contact-Driven Learning from Humans π https://t.co/3aUYQW8y3P | [Project](https://t.co/NyEVI3v02j.)
π Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Control π https://t.co/YyivLo1LOw
π SR3D: Unleashing Single-view 3D Reconstruction for Transparent and Specular Object Grasping π https://t.co/iThXIZpvzh
π DexMachina: Functional Retargeting for Bimanual Dexterous Manipulation π https://t.co/k45vhrPlDn | [Project](https://t.co/Tq52zAum9B)
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | May 29, 2025
π DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulation π https://t.co/0QwdpHKcLM
π SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning π https://t.co/L0tc9Ht48P | [Project](https://t.co/fEoli6PwHS)
π LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents π https://t.co/TMD5N1IrH7
π FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control π https://t.co/TMBJ0wMayZ
π Learning Generalizable Robot Policy with Human Demonstration Video as a Prompt π https://t.co/Otb1bWLZ89
π Learning Unified Force and Position Control for Legged Loco-Manipulation π https://t.co/bCiyruZVMR
π Hume: Introducing System-2 Thinking in Visual-Language-Action Model π https://t.co/tdH6nSVTQm
π CLAMP: Crowdsourcing a LArge-scale in-the-wild haptic dataset with an open-source device for Multimodal robot Perception π https://t.co/KNT2SkGaKo | [Project](https://t.co/zYgleu2ShT)
π MaskedManipulator: Versatile Whole-Body Control for Loco-Manipulation π https://t.co/HS1H3J0kOI
π Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance π https://t.co/gYSxqPtsYT
π ManiFeel: Benchmarking and Understanding Visuotactile Manipulation Policy Learning π https://t.co/cEeYXHRQZW | [Project](https://t.co/dEanxRhHYM)
π EgoZero: Robot Learning from Smart Glasses π https://t.co/9wQUHnaUJh | [Project](https://t.co/OYA6IvH26s.)
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | May 25, 2025
π EasyInsert: A Data-Efficient and Generalizable Insertion Policy π https://t.co/EkMOunwRiH
π FLARE: Robot Learning with Implicit World Modeling π https://t.co/S6649Vw3jl
π FLARE: Robot Learning with Implicit World Modeling π https://t.co/S6649Vw3jl
π LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation π https://t.co/8RUiZUY2uL
π H2R: A Human-to-Robot Data Augmentation for Robot Pre-training from Videos π https://t.co/TnIwXEQw7k
π OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoning π https://t.co/FfMIY8q4R1
π Emergent Active Perception and Dexterity of Simulated Humanoids from Visual Reinforcement Learning π https://t.co/VnxzvLWm18
π DreamGen: Unlocking Generalization in Robot Learning through Neural Trajectories π https://t.co/9QcuIcR4ZC
π TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation π https://t.co/2dVIcoby3W
π GraspMolmo: Generalizable Task-Oriented Grasping via Large-Scale Synthetic Data Generation π https://t.co/8MPKGyxysL | [Project](https://t.co/ZtOWoEaQaV.)
π TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigation π https://t.co/rJXxjalQsv | [Project](https://t.co/OzVPZkuN07)
π Infinigen-Sim: Procedural Generation of Articulated Simulation Assets π https://t.co/pSBJlQnept
π DexGarmentLab: Dexterous Garment Manipulation Environment with Generalizable Policy π https://t.co/x00x7Ulpfl | [Project](https://t.co/toGl98zRAY.)
Find more daily insights here: https://t.co/nXJyIf98xf
#SimulatelyPapers | May 07, 2025
π MetaScenes: Towards Automated Replica Creation for Real-world 3D Scans π https://t.co/DZhLvV1O3b | [Project](https://t.co/5Fmvrefmnz.)
π TWIST: Teleoperated Whole-Body Imitation System π https://t.co/WdyrbaGtsR | [Project](https://t.co/mP9dpJie9y)
π GENMO: A GENeralist Model for Human MOtion π https://t.co/k2HErgIWGy
π IK Seed Generator for Dual-Arm Human-like Physicality Robot with Mobile Base π https://t.co/Vyzl4e4iK2
π Towards Autonomous Micromobility through Scalable Urban Simulation π https://t.co/pxAaxGokld
Find more daily insights here: https://t.co/nXJyIf9GmN
#SimulatelyPapers | April 20, 2025
π UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Control π https://t.co/7E1EiXbvCq
π Practical Insights on Grasp Strategies for Mobile Manipulation in the Wild π https://t.co/QdkuHH1D3E
π A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation π https://t.co/o0fJBhHDQo
π B*: Efficient and Optimal Base Placement for Fixed-Base Manipulators π https://t.co/U9GPJGGRXi
π RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins π https://t.co/IjDEf28gtQ
Find more daily insights here: https://t.co/nXJyIf9GmN
In my past research experience, finding or developing an appropriate simulation environment, dataset, and benchmark has always been a challenge. Missing features, limited support, or unexpected bugs often occupied my days and nights. Moreover, current simulation platforms are relatively fragmentedβmaking it challenging to replicate the success of the RT-X dataset in unifying community efforts.
Introducing RoboVerse, we provide a unified platform, dataset, and benchmark for scalable and generalizable robot learning. We hope to build a shared foundation to combine the community efforts. RoboVerse includes:
MetaSim: We carefully designed a configuration system and a universal interface to align current robotic simulators. With MetaSim, you can use any simulator with the same codeβbringing together the communityβs diverse efforts under one framework!
RoboVerse Dataset and Benchmark: We unify popular simulation environments and benchmarks into a single cohesive system and introduce the RoboVerse datasetβa large-scale, high-quality synthetic dataset. Additionally, we propose a standardized benchmark across both imitation learning and reinforcement learning.
A cool feature enabled by our unified framework: Hybrid Simulation! You can now integrate physics engines and renderers from different simulatorsβe.g., using MuJoCo precise physics with Isaac photorealistic rendering. This not only elevates simulation fidelity but also significantly enhances real-world transfer performance across complex robotic applications.
Hopefully, our teamβs efforts could serve the robotic community to thrive vibrantly in the years to come.
RoboVerse is open-sourcedπ₯³!!!
Project Page: https://t.co/IJR1iuEW1L
Documentation: https://t.co/7Ff4uhbJR0
Github Repo: https://t.co/iLRpjSNokQ
Paper: https://t.co/LUMJrd6i5I
#SimulatelyPapers | March 27, 2025
π Gemini Robotics: Bringing AI into the Physical World π https://t.co/NneKfdvxMF
π MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation π https://t.co/9GfMfYwE2B
π OpenLex3D: A New Evaluation Benchmark for Open-Vocabulary 3D Scene Representations π https://t.co/dO7MAyFqfB | [Project](https://t.co/IoLtbt6hln.)
π G-DexGrasp: Generalizable Dexterous Grasping Synthesis Via Part-Aware Prior Retrieval and Prior-Assisted Generation π https://t.co/pNYGStcG2a | [Project](https://t.co/OfspEbuG5P)
π SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulation π https://t.co/SFOnYlJaf2
π Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy π https://t.co/wnkiZJQWpI | [Project](https://t.co/TaAsuogaqm.)
π Visuo-Tactile Object Pose Estimation for a Multi-Finger Robot Hand with Low-Resolution In-Hand Tactile Sensing π https://t.co/GNSKSErhEB
π Any6D: Model-free 6D Pose Estimation of Novel Objects π https://t.co/MaJFBNE6yK | [Project](https://t.co/lkoHnBq9yh)
π RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generation π https://t.co/Oz0O7pIGz8
π Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving π https://t.co/i10oqeA3vT
Find more daily insights here: https://t.co/nXJyIf9GmN