Do you know how to make a dumpling🥟? Our robot🤖does!
Introducing RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools.
Project website: https://t.co/KmR86pIChS
Here we show how RoboCook makes a dumpling under external human perturbation. Thread🧵👇
We show how we can fit acoustic models of objects from real world audio of impact sounds, even from audio taken from ASMR YouTube videos. Robots can use our models to separate sound sources of impacts between multiple objects, then identify distinct properties of each object.
Our paper on DiffImpact was just accepted as an oral at CoRL 2021! https://t.co/p9MnWI6SKz
Thank you to the reviewers, and a wonderful interdisciplinary team @NeginHeravi, Mark Rau, @RuohanGao1, @jiajunwu_cs, Doug James, and @leto__jean
@NeginHeravi@RuohanGao1@jiajunwu_cs@leto__jean We introduce physics-based differentiable models of impact sounds and show that AI agents and robots can use them to perform some powerful reasoning and prediction tasks, all on real world audio data