This is an ape ("Kanzi") playing Minecraft! A fascinating experiment on non-human biological neural networks 🙉
I've been teaching AI to play Minecraft for too long. There're so many similar techniques that the ape trainers used:
- In-context reinforcement learning: Kanzi gets a fruit or peanut whenever he hits a marked milestone in the game, incentivizing him to follow the in-game guides.
- RLHF: Kanzi doesn't understand much language, but he can see the trainers cheering him on, and he occasionally cheers them back! That gives him a strong signal that he's on the right track.
- Imitation learning: the trainers show Kanzi just 1 demonstration of how to do a task, and he immediately grasps the concepts. It's much more efficient than using rewards alone.
- Curriculum learning: they start with very simple environments to gradually teach Kanzi the controls. At the end, Kanzi is able to navigate complex caves, mazes, and the Nether.
It also amazes me how strong the ape's vision system is. Kanzi never saw Minecraft in his life, and for sure his ancestors didn't either. Yet he rapidly adapts to Minecraft's texture and physics, which are dramatically different from the natural world.
This level of generalization is far beyond what our most powerful vision models can do today. We are right in the thick of Moravec's paradox again: our best AIs are approaching human level on understanding language, but far behind animals on parsing pixels.
From YouTube channel "ChrisDaCow": https://t.co/AREU1q1QVm
Researchers are from the Ape Initiative, a non-profit org.
Great project! Bjørn maybe the next iteration should have a camera lens and describe the photo with a paragraph! - love the web app with Noddl as well!
Introducing – Paragraphica! 📡📷
A camera that takes photos using location data. It describes the place you are at and then converts it into an AI-generated "photo".
See more here: https://t.co/Oh2BZuhRcf
or try to take your own photo here: https://t.co/w9UFjckiF2
“A remote pilot could potentially be identified by their style of operation of a drone in a similar way for identifying a person through gait analysis” @zubairbaigPerth#drones#CyberCon2022
Total cost of ownership of developing scalable, secure, evidence based AI solutions is high, if you are trying to do it yourself says @DeakinA2I2’s @leonardhoon#CyberCon2022