Marco Pavone

Prof @Stanford, Distinguished Research Scientist and AV research lead @nvidia. PhD from @MITAeroAstro. Robotics, autonomous systems, AI. Opinions are my own.

[Marco Pavone @drmapavone]

Excited to share the latest expansion of the @nvidia #Alpamayo open platform for reasoning-based autonomous vehicles.

Since its launch earlier this year, Alpamayo has seen rapid adoption across industry and academia, with its reasoning models surpassing 400,000 downloads and earning a #COMPUTEX 2026 Best Choice Award.

As announced by Jensen Huang during his #COMPUTEX keynote, we are now introducing several major additions designed to accelerate the development of next-generation AV systems (more details here: https://t.co/Xg0LYaEd9H):

🚗 Alpamayo 2 Super — a new 32B-parameter driving foundation model with:
• Full 360° surround-view perception
• Advanced reasoning capabilities and chain-of-causation outputs
• Meta-actions such as lane changes, yielding, and stopping
• Reasoning auto-labeling and visual grounding for scalable data annotation
• State-of-the-art performance across reasoning, prediction, and alignment tasks

🔄 AlpaGym — an open-source framework for closed-loop reinforcement learning, enabling AV models to learn from the consequences of their actions in simulation and helping bridge the gap between training and real-world deployment.

📊 New Open Benchmarks — including challenges for closed-loop driving and long-tail reasoning to help the community measure progress and drive innovation.

🛠️ Alpamayo Recipes — a centralized repository of end-to-end workflows covering supervised fine-tuning, reinforcement learning, quantization, and model customization.

Reasoning models and closed-loop training are becoming foundational technologies for autonomous systems. Our goal is to provide the open tools, models, infrastructure, and benchmarks needed to accelerate progress across the entire AV ecosystem.

A huge thank you to the many researchers, engineers, and community members whose feedback helped shape this release.

Resources:
• Overview of the latest Alpamayo release (note: some components will be released over the coming weeks): https://t.co/Xg0LYaEd9H
• @nvidia announcement: https://t.co/zWC2rbDK2W

#AutonomousVehicles #PhysicalAI #Robotics #AI #MachineLearning #ReinforcementLearning #OpenSource #NVIDIA #Alpamayo

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

We’ve just released the #Alpamayo Chain-of-Causation (CoC) Autolabeling Pipeline — a feature that has been highly requested by the community!

The pipeline automatically derives:
🔹 Meta-actions: high-level categorical descriptions of ego motion
🔹 Chain-of-causation labels: causal links between scene factors and the ego vehicle’s intended behavior

Autolabeling pipeline: https://t.co/2mrnj47WzK

Learn more about the Alpamayo open platform: https://t.co/P0nuqkwBab

We’re excited to see what the community builds with it, and we hope this tool will help accelerate research in the rapidly growing area of #reasoning models for #Physical #AI.

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

Thrilled to personally invite you to the @nvidia #Alpamayo Summit at #CVPR!
I’ll be opening the event with a talk titled “The ChatGPT Moment for Autonomous Driving” — exploring how reasoning AI is reshaping the entire autonomy stack and accelerating the path toward scalable, safe Level 4 autonomous driving.

📍 June 4, 2026
📍 Le Méridien Denver Downtown (Grove Ballroom)
🕞 3:30 PM — Networking + Snacks
🕓 4:00 PM — Program Begins

We’ll cover:
• Open datasets
• New reasoning models
• AlpaSim
• Safety frameworks
• And much more

Join the waitlist here → https://t.co/0cRwoxEPZm

The event is currently sold out, but you can still join the waitlist.

@NVIDIADRIVE @NVIDIAAI

[NVIDIA DRIVE @NVIDIADRIVE]

Autonomous vehicle technology is advancing at an unprecedented pace.

Marco Pavone (@drmapavone), Senior Director of Autonomous Vehicle Research at NVIDIA, breaks down how AI is enabling developers to completely rethink how autonomous systems are built.

📺 Watch the full video: https://t.co/zluWPYmSv1

[Marco Pavone @drmapavone]

🚗🏆 Breaking news: @nvidia #Alpamayo open platform has been named the winner of a COMPUTEX TAIPEI 2026 Best Choice Award in the Vehicle Technology & Smart Cockpit category, recognizing Alpamayo as one of the year’s major breakthroughs in automotive and Physical AI technology!

Announcements:
- https://t.co/OWJ0W65iNU
- https://t.co/g9rYpPDYEJ

I’m incredibly proud of the team behind the Alpamayo open platform — Wenjie Luo @yan_wang_9 @iamborisi and the entire NVIDIA Autonomous Vehicle Research Group — and deeply grateful for the contributions from the NVIDIA AV production team Xinzhou Wu Sarah Tariq and many other researchers and developers across NVIDIA. This achievement was truly a collective team effort.👏

To get started with Alpamayo:
— https://t.co/EmY9IRNXHZ
— https://t.co/P0nuqkwBab

And stay tuned — we’ll have several exciting announcements in the coming weeks.

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

Introducing FRAX: Fast Robot Kinematics and Dynamics in #JAX — to be presented at the 2026 IEEE International Conference on Robotics and Automation (ICRA) Frontiers of Optimization for Robotics (FOR) Workshop.

FRAX delivers extremely fast (low-microsecond) execution for common inverse-kinematic and inverse-dynamic control workloads, with a pure Python codebase that can achieve up to 5× faster performance than MuJoCo or Pinocchio Python bindings in several settings.

At the same time, FRAX is fully differentiable and seamlessly compatible with CPU, GPU, and TPU execution through #JAX — enabling scalable workflows spanning robotics, control, planning, and machine learning.

Our broader goal is to help bridge the gap between modern AI tooling and robotics computation, making it easier to develop scalable #Physical #AI systems.

This also makes FRAX a great complement to CBFPY (https://t.co/o1UrsnE01b), our package for robot safety and control barrier functions.

Kudos to @danielpmorton for leading this effort.

If you’ll be at ICRA, reach out! The FOR Workshop is on Monday, June 1, and we’ll have a poster there.

💻 GitHub: https://t.co/epQUbFLGdo
📄 Paper: https://t.co/qWvrvBuRVO

#Robotics #PhysicalAI #JAX #DifferentiablePhysics #MachineLearning #AutonomousSystems #GPU #Simulation #ICRA

[Marco Pavone @drmapavone]

Excited to announce the launch of the Stanford Sustainable Mobility Center, where I’ll be serving as inaugural co-director.

Housed within Stanford Precourt Institute for Energy, the center brings together @Stanford’s strengths — from energy systems to AI and autonomy — alongside industry and government collaboration to accelerate real-world mobility solutions at scale.

🔗 Overview of the center:
https://t.co/DzrnBhLsOt

The center traces its origins to the Center for Automotive Research at Stanford (CARS), which I had the pleasure of directing for several years.

🚗🚢✈️ If you are interested in rethinking how people and goods move across land, sea, and air, I’d love to connect!

@StanfordEng @StanfordASL

[Marco Pavone @drmapavone]

A central challenge in #physical #AI is data scarcity: vision-language-action (#VLA) models are fundamentally limited by the availability of high-quality robotics demonstrations.

In our recent work, we introduce R&B-EnCoRe (https://t.co/S34vtBELE1), a framework that enables models to self-bootstrap embodied #reasoning by leveraging synthetic visuo-textual data together with limited embodiment-specific experience. In essence, R&B-EnCoRe allows models to learn how to reason in an embodied setting.

Our approach treats reasoning as a latent variable and uses self-supervised refinement to learn reasoning strategies that are directly predictive of successful control—without human annotations, reward engineering, or external verifiers.

We validate the approach across a range of embodiments—including manipulation, navigation, and autonomous driving—and across model scales from 1B to 30B parameters, observing consistent improvements:
💪 +28% task success in real-world manipulation
🦿 +101% score in legged locomotion navigation
🚗 −21% collision rate in autonomous driving

Overall, this work highlights a promising direction: aligning internet-scale priors with embodiment-specific data to enable scalable, self-improving physical intelligence.

Kudos to an amazing team: Milan Ganai Katie Luo @JonasFrey96 Clark Barrett

🌐 Website: https://t.co/aEABZ3WbwO
📄 Paper: https://t.co/S34vtBELE1

[Marco Pavone @drmapavone]

Excitingly, @nvidia #Alpamayo 1.5 is now available within Autoware: https://t.co/WQ2h7dktTa

Grateful to @ShinpeiKato and the rest of the TIER IV team for helping democratize the development of AV solutions. I look forward to seeing #Alpamayo’s adoption continue to grow!

As Jensen said, “Everything that moves will be autonomous.” Together, we are making big strides toward this vision!

More about Alpamayo 1.5: https://t.co/P0nuqkwBab

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

Ψ₀ (https://t.co/4DPHr6nWuv) is an open foundation model for universal humanoid loco-manipulation—and, more broadly, one of the first and most comprehensive ecosystems for developing humanoid vision-language-action models trained from egocentric data. It advances the state of the art in performance while shedding light on key aspects of model development, including how to effectively structure the training process.

📄 Paper: https://t.co/EANcgLCKSs

Kudos to @yuewang314 for spearheading such an impactful effort—excited to be part of this collaboration!

[Yue Wang @yuewang314]

Introducing Ψ₀ (https://t.co/qqH1PiIJS8) — an open foundation model for universal humanoid loco-manipulation.

🏆 Outperforms GR00T N1.6 by 40%+ overall success rate
📉 Uses only ~10% of the pre-training data
📦 Fully open-source: model, data, code, and deployment pipeline

1/10

[Marco Pavone @drmapavone]

Jensen today announced Alpamayo 1.5 at #NVIDIAGTC!

#Alpamayo 1.5 is a major update to Alpamayo 1—@nvidia’s open 10B-parameter chain-of-thought reasoning VLA model, first introduced at #CES. Built on the #Cosmos-Reason2 VLM backbone and post-trained with RL, it adds support for navigation guidance, flexible multi-camera setups, configurable camera parameters, and user question answering. The result is an interactive, steerable reasoning engine for the AV community. We’re also releasing post-training scripts to help researchers and developers adapt the model.

Additionally, we’ve significantly expanded the Alpamayo open platform across data and simulation, including releasing highly requested reasoning labels for the PhysicalAI Autonomous Vehicles dataset (https://t.co/fD9eUcndya), as well as our chain-of-causation auto-labeling pipeline.

🔎 Learn more about Alpamayo 1.5 and the latest extensions to the Alpamayo open platform:
https://t.co/P0nuqkwBab (please note that most of the links will become active in the next few days.)

Happy building—and stay tuned for more in the coming months!

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

What does it take to build autonomous vehicles that can reason about the world they drive in?

Tomorrow at #NVIDIAGTC, Patrick Liu and I will take a deep dive into the #Alpamayo #reasoning model family—a family of reasoning-based vision–language–action (#VLA) models that form a core component of the Alpamayo open platform (https://t.co/EmY9IRNXHZ).

We’ll cover three main topics:
- How reasoning-based VLA models like Alpamayo 1 are designed and built
- What it takes to bring Alpamayo 1 to production, including some of our latest results
- Several exciting announcements about the expansion of the Alpamayo open platform

If you're working on autonomous driving, robotics, or foundation models for physical AI, this session will offer a look at where the field is heading.

Session details:
📅 Monday, Mar 16 | 3:00 PM PDT
📍 #NVIDIAGTC 2026
🔗 https://t.co/ZJk5GGIbFV

Looking forward to seeing many of you there.

@NVIDIADRIVE @NVIDIAAI

[Marco Pavone @drmapavone]

Excited to share CoVer-VLA — a contrastive verifier and hierarchical test-time scaling framework that bridges the intention–action gap in generalist robot policies.

We show that allocating compute to reasoning and verification at deployment can be more effective than scaling policy training alone.

🌐 Website: https://t.co/ywvBUaIPKA
📄 Paper: https://t.co/jetSvow0Kp
🤗 Models: https://t.co/6ogJRdhPTL
💻 Code: https://t.co/k1A6piOlyJ

Work led by @jackyk02, in collaboration with @Azaliamirh and @chelseabfinn

[Marco Pavone @drmapavone]

@nvidia #Alpamayo 1 has now surpassed 100,000 downloads! 🚀

Since its announcement at #CES, Alpamayo 1 has been adopted across a wide range of use cases — and it’s been incredibly exciting to see the community put it to work in so many creative and impactful ways.

Curious to learn more about Alpamayo 1 — and the latest extensions to the Alpamayo ecosystem that we’ll be unveiling at #NVIDIAGTC?

Join my talk at NVIDIA GTC 2026: “From Research to Production: How Alpamayo Accelerates Autonomous Vehicle Development”

📅 Monday, March 16 | 3:00 PM PDT
📍 San Jose, CA
🔗 https://t.co/13GIrZAu3A

Looking forward to connecting with many of you there.

#NVIDIAGTC #AutonomousVehicles #AI #Robotics @NVIDIAAI @NVIDIADRIVE

[NVIDIA DRIVE @NVIDIADRIVE]

Alpamayo 1 is now @huggingface’s top-downloaded robotics model with 100K downloads and counting. 🎉

It helps researchers and autonomous-driving practitioners develop and evaluate vision-language-action models for complex autonomous-driving scenarios, especially rare long-tail events.

🔗 Get started with Alpamayo 1 today: https://t.co/QUrhHkZMbF
🎥 Watch the deep-dive: https://t.co/sxceaDLIjc

[Marco Pavone @drmapavone]

Deep dive on @NVIDIA Alpamayo 1 (reasoning-based model for AVs) is now up. Watch the full recording: https://t.co/5Vd1XAkyH0

@NVIDIADRIVE @NVIDIAAI

[NVIDIA DRIVE @NVIDIADRIVE]

💨 How fast can an autonomous vehicle think?

With Alpamayo 1, NVIDIA's 10B-parameter chain-of-thought reasoning model, the distilled version can reason in real time.

Hear Marco Pavone (@drmapavone), Yan Wang, Yurong You, and Wenhao Ding from our AV Research team break down Alpamayo 1 and what's next for reasoning in autonomous driving.

🔁 Watch the replay: https://t.co/q3YcMjoFsn

[Marco Pavone @drmapavone]

Reminder - Join me and my collaborators for a *live* discussion on @nvidia Alpamayo 1 (https://t.co/9nI9L08LJJ), a reasoning-based vision–language–action (VLA) model for autonomous driving.

🎥 Livestream: Inside NVIDIA Alpamayo 1: Making Autonomous Vehicles Reason
🗓 February 11
⏰ 9:00am PST
📍 Watch here: https://t.co/WJkK2AaTkF

[Marco Pavone @drmapavone]

Join me and my collaborators for a *live* discussion on @nvidia Alpamayo 1 (https://t.co/9nI9L08LJJ), a reasoning-based vision–language–action (VLA) model for autonomous driving.

🎥 Livestream: Inside NVIDIA Alpamayo 1: Making Autonomous Vehicles Reason
🗓 February 11
⏰ 9:00am PST
📍 Watch here: https://t.co/WJkK2AaTkF

As NVIDIA CEO Jensen Huang put it:
“The ChatGPT moment for physical AI is here — when machines begin to understand, reason, and act in the real world. Robotaxis are among the first to benefit. Alpamayo brings reasoning to autonomous vehicles, allowing them to think through rare scenarios, drive safely in complex environments, and explain their driving decisions — it’s the foundation for safe, scalable autonomy.”

During the livestream, we’ll cover:
- How #reasoning-based #VLA models like #Alpamayo 1 are designed and built
- Applications ranging from end-to-end #autonomy to reasoning-driven auto-labeling
- Key opportunities and challenges in developing reasoning models for #Physical #AI

I’ll be joined by core Alpamayo 1 developers @yan_wang_9 @YurongYou @wenhaoding95, and we’ll take questions live from the community.

📖 Ahead of time, you might enjoy this overview of the Alpamayo ecosystem:
https://t.co/EmY9IRNXHZ

And if you’re attending @NVIDIAGTC (March 16–19) and would like to meet some of the Alpamayo team in person, you can use my employee code for 25% off your conference pass:
https://t.co/Qd3JkaMBIK

Hope to see you at the livestream!

@NVIDIAAI @NVIDIADRIVE

[Marco Pavone @drmapavone]

Join me and my collaborators for a *live* discussion on @nvidia Alpamayo 1 (https://t.co/9nI9L08LJJ), a reasoning-based vision–language–action (VLA) model for autonomous driving.

🎥 Livestream: Inside NVIDIA Alpamayo 1: Making Autonomous Vehicles Reason
🗓 February 11
⏰ 9:00am PST
📍 Watch here: https://t.co/WJkK2AaTkF

As NVIDIA CEO Jensen Huang put it:
“The ChatGPT moment for physical AI is here — when machines begin to understand, reason, and act in the real world. Robotaxis are among the first to benefit. Alpamayo brings reasoning to autonomous vehicles, allowing them to think through rare scenarios, drive safely in complex environments, and explain their driving decisions — it’s the foundation for safe, scalable autonomy.”

During the livestream, we’ll cover:
- How #reasoning-based #VLA models like #Alpamayo 1 are designed and built
- Applications ranging from end-to-end #autonomy to reasoning-driven auto-labeling
- Key opportunities and challenges in developing reasoning models for #Physical #AI

I’ll be joined by core Alpamayo 1 developers @yan_wang_9 @YurongYou @wenhaoding95, and we’ll take questions live from the community.

📖 Ahead of time, you might enjoy this overview of the Alpamayo ecosystem:
https://t.co/EmY9IRNXHZ

And if you’re attending @NVIDIAGTC (March 16–19) and would like to meet some of the Alpamayo team in person, you can use my employee code for 25% off your conference pass:
https://t.co/Qd3JkaMBIK

Hope to see you at the livestream!

@NVIDIAAI @NVIDIADRIVE

[NVIDIA DRIVE @NVIDIADRIVE]

Open models. Open datasets. Safer AVs.

@drmapavone and Ed Schmerling explain how NVIDIA’s Alpamayo ecosystem uses multi-sensor data, reasoning models, and tools to advance safe autonomous driving.

Watch the livestream 👉 https://t.co/noYXXFlGUh