the @Shiraz_AI team (@MozaffarMojtaba and @realnavida) are hyper focused on deployment at scale for physical AI solutions.
great team to work with and join!
We’re looking for exceptional talent interested in tackling some of the toughest challenges in physical AI: making robots adapt quickly and getting them ready for deployment in fast-changing environments! If that sounds like you, find me in CoRL or message me.
18 brilliant folks building the future of robotics, all around one dinner table.
For SF Tech Week, we brought together friends from frontier AI labs, industry, and startups, from researchers advancing RL in simulation to founders building the next generation of robotics companies.
An evening of fascinating conversations, fresh perspectives, and plenty of laughs.
If you are building in Physical AI, drop me a message. We would love to have you at the next dinner!
@Luckyballa - Skild AI
@Stone_Tao - Physical Intelligence
@RaresAmbrus - Walden Robotics
@un1c0rnioz - 1x
@charleswongzx - Bifrost AI
@IanGlow - Zeromatter
@brandon1 - Hebbian Robotics
@immonicax - Dyna Robotics
@massiviola01 - Bedrock Robotics
@realnavida - Shiraz AI
@bhavashok - Stealth
Tiantian Li - Meta
Mikhail Balakhno - OpenAI
Yatharth Ahuja - General Motors
Wallace Lim - Physical Intelligence
Pranav Deshmane - John Deere
In-Context Learning Results Hint at a “GPT Moment” for Robotics
For general-purpose robots to be useful and economical, you need to be able to teach them new skills on the fly. And now we can see how this will work, with in-context long horizon video demonstrations shown by companies like Generalist, Skild, Rhoda, Rhoda, and RobbyAnt.
The idea is simple: prompt with a demonstration, mixed video and proprioception information. Language isn't enough -- it doesn't specify the problem well enough. And it's starting to really work.
more in blog post
@EzMhypeL @Shiraz_AI Great question! You can think of the example as a prompt that we provide to the robot. So yes a human will then evaluate the robot behavior given the prompt (example), and you can do this instantly becuase we are not retraining / fine-tuning the model.
Everyone in robotics is waiting for the ChatGPT moment but … missing the most important part of the ChatGPT playbook.
So we left Boston Dynamics and Amazon Robotics to fix that, and start @Shiraz_AI to build robots that learn on the job.
When GPT-3 was released, it couldn’t do every task out of the box. But you could show it a few examples in the prompt, and it adapted on the spot.
We’re bringing that to robotics.
Show our robot a task once, and it adapts on the spot.
That’s exactly what our manufacturing customers need, especially when production lines change every week and traditional automation can’t keep up. And we’re already deploying it with our first customers.
Have a factory that’s difficult to automate? We’d love to talk.
@_k_sridhar@Shiraz_AI Thanks @_k_sridhar! Yes totally, we think in-context learning will open new markets and will also have important implications on steerability.
@hamudinaanaa@theworldlabs I would say an easy pipeline that can go from videos of our lab setup, to a simulation that respects the visuals and physics of the workspace.
@mario_bollini Thanks Mario!! Yes totally, being able to adapt to a new workflow is a necessary condition we see for our customers and for delivering value at scale.
Everyone in robotics is waiting for the ChatGPT moment but … missing the most important part of the ChatGPT playbook.
So we left Boston Dynamics and Amazon Robotics to fix that, and start @Shiraz_AI to build robots that learn on the job.
When GPT-3 was released, it couldn’t do every task out of the box. But you could show it a few examples in the prompt, and it adapted on the spot.
We’re bringing that to robotics.
Show our robot a task once, and it adapts on the spot.
That’s exactly what our manufacturing customers need, especially when production lines change every week and traditional automation can’t keep up. And we’re already deploying it with our first customers.
Have a factory that’s difficult to automate? We’d love to talk.