I put Astra and Fable 5.2 head to head to see if they could zero-shot an excavator task.
Both have only visual reference of the machine's state and can give a sequence of movement commands to the excavator (ex. move boom for n seconds).
Surprisingly, one model prevailed and contributed to solving society's waste problem.
Heavy machines are effectively robots.
This is all robot data.
@ActorLabs has a massive deployed fleet of machinery across the US that allows us to see thousands of tasks being performed by operators.
We're looking for roles at @ActorLabs
If you're interested in deploying foundational robotics models to machines the size of buildings, contact me
https://t.co/vHWj7gjQRy
At Actor we hosted a hackathon where we gave people real excavators / unorthodox embodiments and 36 hours to make them autonomous. Thanks to members at @physical_int for collaborating!
We at @ActorLabs are collaborating with @physical_int to host act-athon, a physical ai hackathon on September 25-27 in Mountain View, CA. The premise: we provide you an embodiment, and your job is to make it think and act.
Applications are here: https://t.co/k5sjNR4zMA
I'm excited to announce @ActorLabs's newest embodiment: a front loader. These perform massive amounts of task cycles across construction, quarries, and mining. We now are performing these fully autonomously (and without an operator). Our models can generalize to a new site with only a few hours of data. This is only the floor of capability.
We love what we do. Our excavators are also learning to love what we do. Now, we're ready to deploy and want to teach your machines too.
We're always in need of more data to improve our models. If you have machines, let us know. It takes us 10 minutes to install our hardware.
We've raised a $4m seed round at Actor
Here's a glimpse of what our deployed robotic models can do in the real world :)
Grateful to be backed by incredible investors from Eniac Ventures, Hyperion, Hummingbird Ventures, 2048 Ventures, Nova Global, and angels from Vanderbilt and the valley!