Generalist

Generalist is an AI robotics company building general intelligence for the physical world and making it useful to everyone.

[Generalist @GeneralistAI]

Introducing GEN-1.5, a one-shot learner.

It can learn new tasks in a few seconds. Show it what to do, and it generalizes.

This capability emerged from pretraining on physical data at scale, as a step towards our mission of building general intelligence for the physical world.

[Mario Gabriele @mariogabriele]

.@GeneralistAI CEO @peteflorence has been watching robot arms make the same kind of mistake: halfway through a task, they meander off to the side in a way they shouldn’t.

With a weak base model, he said, fixing it feels like playing Whac-A-Mole; every failure you patch makes room for the next one.

But that has changed as the base models have gotten stronger. Now, Pete recalled, you only have to give a “very small amount of guidance” on what not to do, and “it just won’t do it again.”

[Generalist @GeneralistAI]

full ep : https://t.co/b18Ne9XECq

[Generalist @GeneralistAI]

Our CEO Pete Florence on The Generalist podcast, talking all things robots and how we're building for the physical world.

@mariogabriele @thegeneralistco

Listen to the whole conversation - link in the comments below

[Generalist @GeneralistAI]

Other tasks our models can do:

https://t.co/j2vm6S45UN

Read more about GEN-1.5, our latest foundation model for the physical world:

https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

How many pucks could a puck bot pack if a puck bot could pack pucks? 🏒

12 hockey pucks is a tight fit in this container – watch the model fix the arrangement when pucks get stuck or misplaced.

GEN-1.5 doesn't just puck around. Read more about it in our blog post and sign up for the waitlist in the comments below.

[Generalist @GeneralistAI]

Other tasks our models can do:
https://t.co/jZSISLwrGL

Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

GEN-1.5 puts together a kit of cosmetics, then puts together another kit, then another kit, then another...

We're expanding access to GEN-1.5
Sign up to get in line
https://t.co/kaM93SJkXM

[Generalist @GeneralistAI]

We're expanding access to GEN-1.5

Sign up to get in line
https://t.co/kaM93SJkXM

[Generalist @GeneralistAI]

Read more about GEN-1.5, our latest foundation model for the physical world: https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

GEN-1.5 packs a bottle into a box, then packs another bottle into a box, then another bottle, then another one, then another...

Read more about GEN-1.5 in our blog post in the comments below.

[Generalist @GeneralistAI]

Other tasks our models can do:
https://t.co/jZSISLwrGL

Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

Other tasks our models can do:
https://t.co/jZSISLwrGL

Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

Robot puts a ring on it

GEN-1.5 puts an O-ring on a hydraulic rod gland, then takes the ring off, then puts the ring back on, then takes the ring off, then ring on, ring off, ring on...

Read more about GEN-1.5 in our blog post in the comments below.

[Generalist @GeneralistAI]

@JagdeepBhatia8 Other tasks our models can do:
https://t.co/jZSISLwrGL

Read more about GEN-1.5, our latest foundation model for the physical world:
https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

A simple example of physical prompt steerability: same environment, different prompts, different behaviors.

Thanks @JagdeepBhatia8 for the suggestion.

Read more about GEN-1.5 in our blog post in the comments below.

[Jagdeep Bhatia @JagdeepBhatia8]

Physical prompting is an elegant idea!

One request for the @GeneralistAI team: can we see an example of *physical prompt steerability*, where different prompts induce distinct behavior in the *same* environment?

I'm curious whether GEN-1.5 is listening to the physical prompt or simply executing the most likely action sequence for the scene under its pretraining prior.

[Generalist @GeneralistAI]

Read more about GEN-1.5, our latest foundation model for the physical world: https://t.co/doHGZMm7qB

[Generalist @GeneralistAI]

We've reduced the time it takes to go from physical prompt → robot behavior.

The faster anyone can teach a robot to do something new, the easier it becomes to scale physical work.

Read more about GEN-1.5 in our blog post in the comments below.

[Pete Florence @peteflorence]

Last week @willknight came by and got a preview of one-shot prompting and we had some fun improvisational moments with the robot. Thanks Will for helping capture the moment.

[Pete Florence @peteflorence]

Good question thanks Ani. Here's a video that gives a sense of the answer here about the effect of prompting:

- in the first part, the model is just babbling with no prompt in context
- at the end, we add a prompt for taking money out of a pouch (generalizing to the wallet)

[Ben Barry @benbarry]

We started planning yesterday’s @generalistai GEN-1.5 announcement about 3 weeks ago. Two weeks ago, already feeling whiplash from new results, I asked ChatGPT to create this image to share in our internal meme channel.