David Chen

GM Robotics @LiveKit. Building the realtime platform for Physical AI. Previously @Agtonomy, @skycatch, @twitter.

[David Chen @chenosaurus]

@dreamlabs_ai Dream-1 is a beast. Strobing lights don't bother it at all. Running @livekit Portal on some @makermodsai metal arms.

https://t.co/Bo5x1H5zeA

[David Chen @chenosaurus]

@grantg07 Very cool! Happy to sponsor you guys for connectivity & realtime streaming infra.

[David Chen @chenosaurus]

@chr1sa @Yamato7xiu @chr1sa it’s doable, we’re working on enabling just that at ultra low latency. See https://t.co/Bo5x1H5zeA. We have many customers doing this in real world deployments.

[David Chen @chenosaurus]

@saba_khalilnaji 👀 purple @lightberry!

[Isaac Sin @IsaacSin12]

We're hosting another Physical AI Hack this weekend, November 7–8 at @fdotinc in San Francisco.

This time, we're partnering with @dreamlabs_ai and their new world action model, Dream-1, which can do tasks zero-shot. @livekit @nvidia @huggingface @dimensionalos @enact_labs are joining us too.

@livekit is the real-time layer: connect your robot to human operators and cloud models with ultra low latency, then give it a voice agent so you can talk to it. You'll get LiveKit credits for real-time streaming and voice agents.

Other technical partners: @_lightcompany @mirdainsystems @SGhashghaei @spcxstarship

Prizes:

1st place: $2,000 + a Metal Arm + credits
2nd place: $1000 + a Maker Arm + credits
3rd place: $500 + a Reachy Mini + credits

Sign Up: https://t.co/g6eZJvJNNY

There are two tracks:

Hill climb (New Track):
This is a new format where everyone works to improve the model's accuracy on the same task. We'll announce the task soon and provide the props. You'll climb the leaderboard through fine-tuning, DAgger and a System 2 agent harness around Dream-1, using LiveKit and Dimensional OS.

Creative (Zero shot):
Build the most creative project you can with Dream-1, LiveKit and Dimensional OS.

[David Chen @chenosaurus]

@PranayGupt97167 @J10ngl1Z @parjanyapp @Deepans36819800 This is wild 🤯

[David Chen @chenosaurus]

@vascodegraaff @microagi Congrats @vascodegraaff !!

[David Chen @chenosaurus]

@pham_blnh Did you buy a welding rig as well?

[David Chen @chenosaurus]

@Noblehotep @SirPatStew @twitter @pandemona Occasionally celebrities visited the Twitter office. At the time we had just launched Vine, a 6s video app. @SirPatStew visited and we made a fun video using the app. I forget who came up with the idea, but it became legendary.

[David Chen @chenosaurus]

RIP @SirPatStew, thanks for all the Star Trek TNG growing up.

Once upon a time, when I worked at @twitter, I was asked if I wanted to be in a Vine the company was making. Turns out it was none other than Captain Jean-Luc Picard...

[David Chen @chenosaurus]

@heero_yuy2 @SirPatStew @twitter @pandemona Long before

[David Chen @chenosaurus]

@bigchaz @SirPatStew @twitter @pandemona Yesss! Legendary!

[David Chen @chenosaurus]

@AnneliesGamble Yes!

[David Chen @chenosaurus]

This is gonna be a really good robotics hackathon. High quality hardware from @makermodsai + Dream-1 from @dreamlabs_ai + voice interface & orchestration with @livekit Agents will be a killer combo.

[Ryan Chan @Ryan_Resolution]

We're hosting a huge Physical AI hackathon.

We’ve run robotics hackathons before but this one is different:
Bimanual Metal Arm and Maker Arm Stations
Fine Tune Dream-1, this is not another ACT competition
New Hill Climb leaderboard format

Two tracks: push your robot up the live eval leaderboard. Or build the creative, most useful robot application you can think of.

Partnering with @dreamlabs_ai @livekit @huggingface @nvidia @_lightcompany @mirdainsystems

November 7–8. San Francisco.
Co-hosted with Founders Inc @fdotinc

Come build with us: https://t.co/hWMG8hF5hl

[David Chen @chenosaurus]

@_joe_harris_ Monarch is no more

[David Chen @chenosaurus]

Ok, @elonmusk delivered. New brain for an 8 year old car.

[David Chen @chenosaurus]

@owengretzinger @_devp @boardyai Nice work. @boardyai has been impressive.

[Asimov @asimovinc]

We're open-sourcing Menlo SDK so you can build your own applications for a humanoid robot.

The SDK connects your code to Asimov 1, letting you control its movements and read its state. With the full source available, you can build on the existing foundation and adapt it to what your project needs.

You can use it to replay a motion, control the robot through a VR headset, or run your trained policy on real hardware.

We're also open-sourcing Asimov Edge, the software that runs on the robot, checks incoming commands, and manages control between your application, a gamepad and other controllers.

- SDK: https://t.co/VFUa2jyjAQ
- Docs: https://t.co/9TnF0pVpTl
- Order yours: https://t.co/EpDIsLhxvj

Keep going.

[LiveKit @livekit]

Voice agents get built three ways: cascaded (STT, LLM, TTS), turn-based speech-to-speech, and full-duplex, where the model listens and talks at the same time.

All three now run on LiveKit Inference: GPT-Live and GPT Realtime from @OpenAI, @grok Voice Think Fast from @xai, and Gemini Live from @GoogleDeepMind. One LiveKit Cloud key, one bill.

[David Chen @chenosaurus]

@IsaacSin12 @Ryan_Resolution @makermodsai Nice! Love seeing more people building robots you can talk to!