CMU Intelligent Autonomous Manipulation Lab

We are robotics researchers @CMU_Robotics investigating how to enable robots to acquire then generalize manipulation skills.

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

🤖We are introducing Grounded Task Axes (GTA) — a zero-shot skill transfer framework that enables robots to perform multi-step manipulation tasks on novel objects by generalizing modular controllers grounded through visual foundation models.

✅ No training, no demo, no finetuning — just zero-shot
🔧 Modular task-axis controllers
🎯 Grounded via visual foundation models
🧠 Generalizes across tools & objects
🥄🍳☕🔩 Scraping, pouring, screwing, insertion

Find more about our paper:
🌐 https://t.co/JPCDMbrBZo
📄 https://t.co/Pg3edtnf8e

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

Big congratulations to Mark for getting the RAL paper accepted! Check out the website and video to discover how to autonomously insert sensors into corn stalks and monitor nutrient levels throughout the growing season.

[Mark Moonyoung Lee @make_your_maark]

How can we use AI & robotics for agriculture? 🤖🌽

We present Towards Autonomous Crop Monitoring - accepted into 𝐑𝐀𝐋𝟐𝟎𝟐𝟒! Robot inserts sensors in corn stalks to monitor plant nutrients.

See paper, additional documentation at
https://t.co/5qm2rGpAD7

🧵👇 (1/7)

[Tao Chen @taochenshh]

🏆 Congrats to the award winners at the Dexterous Manipulation Workshop at #RSS2024!
📜 Best Paper: Zilin Si, @firephinx, @fzeyneptemel, @Oliver_Kroemer, @iamlab_cmu
🎙️ Best Presentation: @kenny__shaw, @deepakpathak
#RSS2024, #DexterousManipulation

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

We are at @ICRA2024! We will present our paper “Estimating Material Properties of Interacting Objects Using Sum-GP-UCB” at Conference Center Room-313 starting 16:30

[Shivam Vats @ShivaamVats]

I had a wonderful time visiting @GTrobotics to present my work on "Planning What to Learn". Thank you @MatthewGombolay for inviting. @core_robotics is doing fantastic inter-disciplinary work on robot skill learning, multi-agent RL and HRI.

Slides @ https://t.co/Tlwn4o7BDh

[Oliver Kroemer @Oliver_Kroemer]

Congratulations to DR. Mohit Sharma (@m0hitsharma) on successfully completing your Ph.D. thesis on Representation Reuse for Learning Robust Robot Manipulations!

It has been such a pleasure to be your advisor of the last years. @CMU_Robotics

[Mark Moonyoung Lee @make_your_maark]

How can we use AI & robotics for sustainable agriculture? 🤖🌽

We present Towards Autonomous Crop Monitoring - inserting sensors in corn stalks to monitor plant nutrient over the growth cycle.

See paper, additional documentation at
https://t.co/5qm2rGpAD7

🧵👇 (1/7)

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

This is happening now at poster #2!

[Shivam Vats @ShivaamVats]

Come visit our poster tomorrow @corl_conf on causal skill learning for manipulation!

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

DELTAHANDS is a synergistic dexterous hand framework that uses soft Delta robots. Delta hands are low-cost, easy to build & control, and highly configurable for dexterous manipulation. Check out our paper (https://t.co/CAjnTGR32z) or site (https://t.co/Lgtu5apMK7) for more info!

[Shivam Vats @ShivaamVats]

Come visit our poster tomorrow @corl_conf on causal skill learning for manipulation!

[Tabitha Edith Lee @TabulaRobot]

Curious how causality can help learn interpretable and robust skills for manipulation?
Please visit our work on SCALE tomorrow (Nov 9) at CoRL Poster Session 5 at 2:45pm ET!
A thread 🧵 (1/4) #CoRL2023
Website: https://t.co/LuB8Wv8UJT
@corl_conf @CMU_Robotics @iamlab_cmu

[Saumya Saxena @saxena_saumya]

If you are at #CoRL2023 @corl_conf, come chat with us at our poster at the LangRob@CoRL2023 Workshop or on Nov 8, 5:00PM ET @Poster 4

Website: https://t.co/gKkG3IfSx3
Paper: https://t.co/TgmVActepk

[Saumya Saxena @saxena_saumya]

How can we leverage large pretrained VLMs for precise and dynamic manipulation tasks in real time?

Presenting MResT🤖 framework for real-time control using sensing at various spatial and temporal resolutions

Come say hi @corl_conf #CoRL2023 Today @ LangRob and Nov. 8 poster 4

[CMU Intelligent Autonomous Manipulation Lab @iamlab_cmu]

@make_your_maark @CMU_Robotics @AII4RA @farm_ng_inc @SCSatCMU @JmpBell Great work! Looking forward to seeing the video.

[Mark Moonyoung Lee @make_your_maark]

Have you wondered how robotics & AI could be used in agriculture 🌽🤖?

Last week, we deployed our robot in Iowa to insert micro-sensors into stalks to monitor crop health. Stay-tuned for the highlight video of our robot in action! @CMU_Robotics @AII4RA @farm_ng_inc @SCSatCMU

[Jacky Liang @jackyliang42]

Super happy to share Code as Policies received the Outstanding Paper Award in Robot Learning #ICRA2023 @ieee_ras_icra !!

Big thank yous to my collaborators @wenlong_huang
@xf1280
@sippeyxp @hausman_k @brian_ichter @peteflorence @andyzengtweets y'all rock 🎉🎉

[Sarvesh Patil @servo97]

Hello all,
I'm very excited to present my work on "Linear Delta Arrays for Compliant Dexterous Distributed Manipulation" that I worked on during my Masters in Robotics at @CMU_Robotics tomorrow at @ieee_ras_icra Pod 44 at 9 - 10:40 AM British Summer Time!

[Mohit Sharma @m0hitsharma]

🤖🦾 Recent research shows that pretrained vision representations (PVRs) can be useful for robot manipulation tasks.

Do these PVRs scale to complex manipulations? In our #ICLR paper we explore this and uncover some fascinating findings @iclr_conf

arxiv: https://t.co/V2pcGY7c3v

[ARM Lab at University of Michigan @umicharmlab]

How do you adapt dynamics models to new scenarios? @PeterMitrano, in collab. with @alex_lagrassa and @OliverKroemer, shows that the key is to FOCUS on where source and target dynamics are similar. This does better than learning on all the data! https://t.co/j788lXwsaV #ICRA2023