Zijun Cui

[jiagengliu @jiagengliu02]

🚀 Introducing 𝐀𝐮𝐭𝐨𝐀𝐠𝐞𝐧𝐭𝟎: An 𝐀𝐠𝐞𝐧𝐭𝐢𝐜 𝐑𝐮𝐧𝐭𝐢𝐦𝐞 for Safe Closed-Loop Driving!

Most autonomous driving research focuses on optimizing E2E driving policies. However, in long-tail, 𝐥𝐚𝐫𝐠𝐞𝐥𝐲 𝐮𝐧𝐯𝐞𝐫𝐢𝐟𝐢𝐚𝐛𝐥𝐞 driving environments, stronger policies alone cannot ensure 𝐬𝐚𝐟𝐞 𝐚𝐧𝐝 𝐫𝐨𝐛𝐮𝐬𝐭 𝐜𝐥𝐨𝐬𝐞𝐝-𝐥𝐨𝐨𝐩 𝐞𝐱𝐞𝐜𝐮𝐭𝐢𝐨𝐧.

In 𝐀𝐮𝐭𝐨𝐀𝐠𝐞𝐧𝐭𝟎, we reformulate traditional runtime monitoring as an 𝐚𝐠𝐞𝐧𝐭𝐢𝐜 𝐫𝐮𝐧𝐭𝐢𝐦𝐞 𝐡𝐚𝐫𝐧𝐞𝐬𝐬 that reasons about 𝐰𝐡𝐞𝐧 𝐭𝐨 𝐢𝐧𝐭𝐞𝐫𝐯𝐞𝐧𝐞 and 𝐡𝐨𝐰 𝐭𝐨 𝐫𝐞𝐜𝐨𝐯𝐞𝐫, leveraging two key capabilities:

1️⃣ 𝐒𝐜𝐞𝐧𝐞 𝐂𝐨𝐧𝐭𝐞𝐱𝐭 𝐑𝐞𝐟𝐢𝐧𝐞𝐦𝐞𝐧𝐭 — Leveraging VLM reasoning to refine critical scene context missed by nominal policies, enabling reliable action verification and triggering interventions when nominal policies fail.

2️⃣ 𝐀𝐠𝐞𝐧𝐭𝐢𝐜 𝐑𝐞𝐜𝐨𝐯𝐞𝐫𝐲 𝐋𝐨𝐨𝐩 — Leveraging VLM-guided stochastic optimization to iteratively propose, verify, and refine explainable recovery policies through verifier feedback.

📊 𝐒𝐭𝐫𝐨𝐧𝐠 𝐜𝐥𝐨𝐬𝐞𝐝-𝐥𝐨𝐨𝐩 𝐠𝐚𝐢𝐧𝐬! 𝐀𝐮𝐭𝐨𝐀𝐠𝐞𝐧𝐭𝟎 consistently improves representative E2E driving policies on 𝐅𝐚𝐢𝐥𝟐𝐃𝐫𝐢𝐯𝐞 (up to +37.0 SR) and 𝐍𝐚𝐯𝐒𝐚𝐟𝐞-∞ (up to +32.8 SR), without policy retraining.

Our results highlight 𝐚𝐠𝐞𝐧𝐭𝐢𝐜 𝐫𝐮𝐧𝐭𝐢𝐦𝐞 𝐚𝐬 𝐚 𝐜𝐨𝐦𝐩𝐥𝐞𝐦𝐞𝐧𝐭𝐚𝐫𝐲 𝐝𝐢𝐫𝐞𝐜𝐭𝐢𝐨𝐧 𝐭𝐨 𝐬𝐜𝐚𝐥𝐢𝐧𝐠 𝐄𝟐𝐄 𝐝𝐫𝐢𝐯𝐢𝐧𝐠 𝐩𝐨𝐥𝐢𝐜𝐢𝐞𝐬.

🎉 Huge congrats to the amazing team: @jiagengliu02 , @sethzhao506 , @Zewei__Zhou , Alejandro Huerta, Aidan Bayer-Calvert, Yuxin Bao, @DarthUtopian , Robert Spataru, @zijun_cui02 , @yining_hong , @zhoubolei , and Jiaqi Ma!

🛠️ Everything is open-sourced!

🌐 Project: https://t.co/N7KMJZndiQ
⭐ Code: https://t.co/VXTVXlNeRA
📄 Paper: https://t.co/AdbYhXU2Em

#AgenticAI #AutonomousDriving #EndToEndDriving #PhysicalAI

[Sir Meemsalot @Meme0rable]

Google team after seeing Gemini hacked three companies

[Max @maxxrubin_]

So Astra is able to identify sounds from mel spectrograms

zero-shot.

I don't think we've scratched the surface of what this model can do (and this is light reasoning btw)

[Zijun Cui @zijun_cui02]

@Ozzny_CS2 jimmy

[Zijun Cui @zijun_cui02]

@claudeai Who asked?

[HLTV.org @HLTVorg]

Historic run from @FalconsEsport 🏆😤

[Zijun Cui @zijun_cui02]

@omar_anwari_ @FaZeEsports @Twistzz wtf is this pic

[Zijun Cui @zijun_cui02]

@alkyds0 true