We asked a VLA-powered robot to “open top drawer” and “could you open the top drawer, please?”: identical commands, yet yields a 60% performance difference 🤯🤯
How can we scalably red-team robots with such diverse and realistic user instructions? 🤔
Learn more! 🧵 [1/11]
We show how LLM prompts can be algorithmically generated for diverse human-like coordination and communication. Super excited about its implications for scenario generation and training better embodied assistants in the future!
One of the biggest challenges in designing agents/robots that collaborate effectively with humans is the lack of diverse human data—large scale collection is hard!
Introducing PLAN-QD: a framework that algorithmically generates diverse, human-like agents.
👇 Learn more! [1/9]
One of the biggest challenges in designing agents/robots that collaborate effectively with humans is the lack of diverse human data—large scale collection is hard!
Introducing PLAN-QD: a framework that algorithmically generates diverse, human-like agents.
👇 Learn more! [1/9]
Ecstatic to announce the release of @pyribs 0.7.1! The absolute highlight of this release is the QDHF (Quality Diversity through Human Feedback) tutorial contributed by @li_ding_! The tutorial is available here and runs on Google Colab in ~1 hour:
https://t.co/QBJDkKzJQs
Excited to announce the release of @pyribs v0.7.0! Pyribs v0.7.0 greatly improves the flexibility of our archives and adds a number of new algorithmic features 🧵
If you are at CORL, don't miss @vbhatt_cs's oral presentation on Nov 9, from 1:45 to 2:45 pm, about surrogate-assisted generation of HRI scenarios using quality diversity!
Excited to share a new paper “Arbitrarily Scalable Environment Generators via Neural Cellular Automata” with @tehqin17, @vbhatt_cs, @snikolaidis19, @JiaoyangLi9, accepted to #NeurIPS2023!
Paper:https://t.co/i61aYiDJz2
Website:https://t.co/dyTcCgJkYh
Code:https://t.co/G2KlzO3dNh
Our work on HRI scenario generation has been accepted at #CoRL 2023 for an oral presentation! Huge thanks to the reviewers and the area chairs for the detailed feedback, and I am excited to share this work with the robotics community at @corl_conf .
Very happy to see environment generation applied to warehouse design. Layouts can be generated for any given robot planning algorithm, so you only need to move the shelves to benefit from this method!
Excited to share a new paper “Multi-Robot Coordination and Layout Design for Automated Warehousing” with @tehqin17, @vbhatt_cs, @snikolaidis19, @JiaoyangLi9, accepted as a full paper in @IJCAIconf!
arXiv: https://t.co/0mD0tfTxQq
Code: https://t.co/HdgNEUAEKA
We are extending the submission deadline for the EGG workshop (https://t.co/lhTWp7of0K) to 25 May 2023 (AoE). It is a hybrid conference, and we encourage submissions from virtually attending authors as well.
Submission link: https://t.co/Bq33wRLzFr
We are excited to announce the first workshop on Environment Generation for Generalizable Robots (EGG) at #RSS2023 (https://t.co/QDUtyWWxPC)! Consider submitting if you are working in any area relevant to environment generation for robotics. Submissions due on May 17, 2023, AoE.
We hope the proposed algorithms will be a valuable tool to test HRI systems before conducting user studies or deploying them in the real world. Feel free to reach out with questions and comments!
arXiv: https://t.co/3iKKCGYWEB [7/7]
Finally, we show that the failure scenarios found by our algorithms are not artifacts of simulation, and can be replicated in the real world. We observe incorrect goal predictions and near collisions that cause the robot to reset, lengthening the task completion time. [6/7]
We are excited to announce the first workshop on Environment Generation for Generalizable Robots (EGG) at #RSS2023 (https://t.co/QDUtyWWxPC)! Consider submitting if you are working in any area relevant to environment generation for robotics. Submissions due on May 17, 2023, AoE.