Google Magenta Project

Magenta is a research project exploring the role of machine learning in the process of creating art and music.

[Google Magenta Project @GoogleMagenta]

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.

MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.

Open weights. Open source inference engine. Suite of apps and plugins.

Hear what it can do and try it out for yourself below 🧵

[Google Magenta Project @GoogleMagenta]

@mlopezaudio That would be great. It requires a moderately powerful GPU so we just started with apple silicon because it comes included and many musicians use macbooks.

[Google Magenta Project @GoogleMagenta]

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.

MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.

Open weights. Open source inference engine. Suite of apps and plugins.

Hear what it can do and try it out for yourself below 🧵

[Jesse Engel @jesseengel]

Had one of those "Oh, I'm living in the future" moments yesterday.

Flying on the airplane. No internet.

Playing music with hand gestures controlling a realtime LLM running locally on my laptop

Person next to me thinking I'm crazy... all the while I'm having a great time 😅

[Google Magenta Project @GoogleMagenta]

Classy!

[Noah Constant @noahconst]

@GoogleMagenta We had so much fun building MRT2.  Proud to see it go live.  Here's a chord steering example.  Name that tune anyone?

[Ilaria Manco @Ilaria__Manco]

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

[Google Magenta Project @GoogleMagenta]

@android_stern That's actually next up on the list 😁

[yotam mann @yotammann]

This year marks the 10 year anniversary of Magenta! We’re releasing Magenta RealTime 2, which draws from so many of the ideas that the group has been pursuing over the past 10 years: interactive, genre-bending, open-source tools by and for musicians

[Google Magenta Project @GoogleMagenta]

Putting people at the center of the creative process has always been at the core of the Magenta project, and we think MRT2 continues in this tradition of interactive, genre-bending, open tools by and for musicians.

It’s been a labor of love for all the contributors and collaborators who have made this project happen. We’ve had a lot of fun with it, and we hope you do too ♥️.

@antoine_caillon, @iansimon, @Ilaria__Manco, @eardrummer_man, @georgealways, @chrisdonahuey, @DoItRealTime, @noahconst, @yotammann, @ada_rob, @JulianSlzr, @hellothisiscass, @lancelotbla, @KehangHan, @jesseengel

[Google Magenta Project @GoogleMagenta]

Look out for some quick followups we have planned, such as finetuning on your own data, and new performance tools (like at the top of the this post @eardrummer_man).

Build your own: https://t.co/hR6WYTrnMW

[Kyle McDonald @kcimc]

@huangcza @iansimon @notwaldorf tiny labor of love to revive an old model ♡ https://t.co/3p8JirkIyL