Introducing GEN-1.5, a one-shot learner.
It can learn new tasks in a few seconds. Show it what to do, and it generalizes.
This capability emerged from pretraining on physical data at scale, as a step towards our mission of building general intelligence for the physical world.
Our CEO Pete Florence on The Generalist podcast, talking all things robots and how we're building for the physical world.
@mariogabriele@thegeneralistco
Listen to the whole conversation - link in the comments below
Other tasks our models can do:
https://t.co/j2vm6S45UN
Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB
How many pucks could a puck bot pack if a puck bot could pack pucks? ๐
12 hockey pucks is a tight fit in this container โ watch the model fix the arrangement when pucks get stuck or misplaced.
GEN-1.5 doesn't just puck around. Read more about it in our blog post and sign up for the waitlist in the comments below.
Other tasks our models can do:
https://t.co/jZSISLwrGL
Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB
GEN-1.5 puts together a kit of cosmetics, then puts together another kit, then another kit, then another...
We're expanding access to GEN-1.5
Sign up to get in line
https://t.co/kaM93SJkXM
GEN-1.5 packs a bottle into a box, then packs another bottle into a box, then another bottle, then another one, then another...
Read more about GEN-1.5 in our blog post in the comments below.
Other tasks our models can do:
https://t.co/jZSISLwrGL
Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB
Other tasks our models can do:
https://t.co/jZSISLwrGL
Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB
Robot puts a ring on it
GEN-1.5 puts an O-ring on a hydraulic rod gland, then takes the ring off, then puts the ring back on, then takes the ring off, then ring on, ring off, ring on...
Read more about GEN-1.5 in our blog post in the comments below.
@JagdeepBhatia8 Other tasks our models can do:
https://t.co/jZSISLwrGL
Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB
A simple example of physical prompt steerability: same environment, different prompts, different behaviors.
Thanks @JagdeepBhatia8 for the suggestion.
Read more about GEN-1.5 in our blog post in the comments below.
Physical prompting is an elegant idea!
One request for the @GeneralistAI team: can we see an example of *physical prompt steerability*, where different prompts induce distinct behavior in the *same* environment?
I'm curious whether GEN-1.5 is listening to the physical prompt or simply executing the most likely action sequence for the scene under its pretraining prior.
We've reduced the time it takes to go from physical prompt โ robot behavior.
The faster anyone can teach a robot to do something new, the easier it becomes to scale physical work.
Read more about GEN-1.5 in our blog post in the comments below.
Last week @willknight came by and got a preview of one-shot prompting and we had some fun improvisational moments with the robot. Thanks Will for helping capture the moment.
Good question thanks Ani. Here's a video that gives a sense of the answer here about the effect of prompting:
- in the first part, the model is just babbling with no prompt in context
- at the end, we add a prompt for taking money out of a pouch (generalizing to the wallet)
We started planning yesterdayโs @generalistai GEN-1.5 announcement about 3 weeks ago. Two weeks ago, already feeling whiplash from new results, I asked ChatGPT to create this image to share in our internal meme channel.