Robots are going to operate in human environments and need to re-plan in their presence.
This is one of the last projects I supported during my time at FAIR and combines many ingredients close to my heart — large-scale simulation, sim2real transfer, human-AI coordination via mixed reality.
Kudos to the team!
Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities
By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people.
Details and code ➡️ https://t.co/Jn5HZLuhj4