Introducing Magenta RealTime, our open weights live music model!
Like Lyria RealTime, this model provides the user continuous control of the musical flow 🌊.
We will be sharing some of our favorite ways to extend these models over the next few weeks. Can't wait to see what you do!
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: https://t.co/SofwwmWlxC
👀 Blog post: https://t.co/QTypsxNHvK
🧵 below
This makes me happy😄 Experiencing Google’s Magenta RealTime. Their latest creation.
It’s a very cool way of interacting with a music model in real time and steering it exactly where you want it to go.
#googlemagenta#magentarealtime2#machinelearning#musicmagic
I' m so addicted to @GoogleMagenta RealTime 2 🎹
so to justify playing with it 24/7 I ported the real-time apps to @huggingface Spaces 🤗 (and ported the entire lib to pytorch/transformers too)
Play live in real time on
https://t.co/5JSl6KCNnU
Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!
Introducing Magenta RealTime 2, a new open model musicians can play as an instrument!
Run low-latency, live music synthesis natively on your MacBook using MIDI, text, and audio. 🎶
We love seeing Google’s open model ecosystem grow!
Finally, you can truly *play* the model as an instrument, letting you decide how much control you want and how much you want it to riff along with you.
AND open weights AND runs on your machine for ultra-low latency.
Hope you enjoy it!
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.
MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.
Open weights. Open source inference engine. Suite of apps and plugins.
Hear what it can do and try it out for yourself below 🧵
I'm so proud of the team for this work. Live, Local, Open, MRT2 is just a lot of fun, and is an AI Instrument puts the person back at the center of making music.
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.
MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.
Open weights. Open source inference engine. Suite of apps and plugins.
Hear what it can do and try it out for yourself below 🧵
We've got a new model coming out next week! We've been having a lot of fun playing with it, and I hope you will too♥️
We'll be celebrating by presenting at the AI Music Summit at Berklee and helping teams at the hackathon afterwards build some wild new musical instruments 🎸
I just can't bring myself to vaugepost, feels too 2025 cringe. So.....
We've got a new live music model coming out soon!
If you live in NYC, come check out it out in person and watch the amazing @eardrummer_man do a live interactive performance with it!
https://t.co/7Qb1LELJEl
Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶
Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026.
We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license.
💾 Get it here: https://t.co/ocgW8KQpHz
Our short film Dear Upstairs Neighbors is previewing at @sundancefest. 🎬
It’s a story about noisy neighbors, but behind the scenes, it’s about solving a huge challenge in generative AI: control.
Developed by Pixar alumni, an Academy Award winner, researchers, and engineers, here’s how it came together. 🎨
Trying to predict the outrages of autocrats is hopeless because their superpower is to generate constant shocks to dominate the environment. But what’s happening in Minnesota is method, not madness. Trump wants violence, to radicalize & divide, to create pretext for crackdowns.