Vivek Kumar

Sr. Manager, Foundational Research @GoogleDeepMind
🦋 @v1vekkumar.bsky.social
Ex @Dolby & @Broadcom
Talks and Investments 👉🏽

[Vivek Kumar @vivek_kumar]

Music model you can actually play like a real instrument!

Running locally with basically zero latency is massive 🚀Huge congrats to the @GoogleMagenta team! .🎶

[Google Magenta Project @GoogleMagenta]

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.

MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.

Open weights. Open source inference engine. Suite of apps and plugins.

Hear what it can do and try it out for yourself below 🧵

[Vivek Kumar @vivek_kumar]

SO cool! I Turning your digital life into a cartoon !!

Massive props to the DreamBeans team for such amazing work! 🚀

[Google Labs @GoogleLabs]

🚨 NEW EXPERIMENT 🚨

Dreambeans is a new, experimental mobile app that uses Personal Intelligence to connect to your Google apps. Every day, it delivers collections of personalized stories, surfacing things you might otherwise miss, alongside topics that are relevant to you, to help you dive deeper into the things you care about most.

Available starting today for eligible US-based Google AI Ultra users (+18), with an open waitlist found on our website below!

Learn more at https://t.co/jCdAzMHvOD

[Vivek Kumar @vivek_kumar]

@esthercrawford This is so amazing! with AI is a whole different ballgame. Enjoy the ride!

Looking forward to what you are building this time 🚀

[Demis Hassabis @demishassabis]

Not bad at all… 😀🚀

[Andy Masley @AndyMasley]

@MorePerfectUS This thing carries enough people to fill 10 full ride shares but it only provides one job. These eliminate 9 jobs each and the tech industry is trying to push them on my city

[Jason Baldridge @jasonbaldridge]

ProducerAI is now Google Flow Music, and it supports editing as well as generation! See this post for details.

[Vivek Kumar @vivek_kumar]

Google Flow Music - editing and generation both 🚀🚀🚀

[Google Flow Music @googleflowmusic]

1/ A new era, a new name, and a new feature drop. 🚀

ProducerAI is officially "Google Flow Music"! We're still the same team, with the same mission: building tools that push the boundaries of human creativity.

To kick off this new chapter, we're launching new capabilities to give you more control over your tracks.

Let's dive in: 🧵👇

[Demis Hassabis @demishassabis]

@Steve_Yegge Maybe tell your buddy to do some actual work and to stop spreading absolute nonsense. This post is completely false and just pure clickbait.

[Vivek Kumar @vivek_kumar]

Congratulations @jesseengel and @GoogleDeepMind magenta team 🚀
Opensourcing realtime lyria plugin is going to expand the artistic posibilities for musicians and creators looking to deepen their relationships with music using AI. Can't wait to see what people build 🎹✨

[Jesse Engel @jesseengel]

Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶

Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026.

We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license.

💾 Get it here: https://t.co/ocgW8KQpHz

[Vivek Kumar @vivek_kumar]

https://t.co/Zku9dXqti7

[Vivek Kumar @vivek_kumar]

Our Sound Team at @GoogleDeepMind is hiring full-time Research Scientists in Mountain View &amp; Cambridge, MA.

​(listing below👇)

[Zoubin Ghahramani @ZoubinGhahrama1]

Last night at #Sundance, we previewed Dear Upstairs Neighbors, an animated short film co-created by world-leading artists and our researchers.

This is true AI-empowered co-creation prioritising artist control: using custom AI workflows to turn hand-drawn storyboards into a full film. Read how we did it: https://t.co/BqvhvmDFff

[Vivek Kumar @vivek_kumar]

Blown away by what my colleagues have created here! 🤯.
This level of innovation is exactly why I joined @GoogleDeepMind

[Google DeepMind @GoogleDeepMind]

Our short film Dear Upstairs Neighbors is previewing at @sundancefest. 🎬

It’s a story about noisy neighbors, but behind the scenes, it’s about solving a huge challenge in generative AI: control.

Developed by Pixar alumni, an Academy Award winner, researchers, and engineers, here’s how it came together. 🎨

[Vivek Kumar @vivek_kumar]

In San Diego this week for @NeurIPSConf Hit me up if you want to chat about anything Audio/GenAI🎙️

Hard to believe it's been nearly a decade since my first one in 2016. The scale is completely different now. 🤯 #NeurIPS2025

[Vivek Kumar @vivek_kumar]

@tydsh Crazy times indeed ! Appreciate your frank leadership, even in the midst of all this.

[Awni Hannun @awnihannun]

I always thought the decline in fundamental AI research funding would happen because AI didn’t generate enough value to be worth the cost.

But it seems like it’s happening because it generated too much value. And the race to capture that value is taking priority.

Just remembering that a lot of this started in curiosity driven industry research labs.

[Vivek Kumar @vivek_kumar]

Fantastic team effort. 🎉

A huge thank you to the authors for their incredible work! 👏

Dan Ellis, @edfonseca_ @HakanErdoganPhD,
@DrJohnHershey, Ron J. Weiss, Kevin Wilson, @ScottTWisdom, Aren Jansen, @ChannningMoore &amp; Manoj Plakal

@GoogleDeepMind

[Vivek Kumar @vivek_kumar]

Excited to share our work from Sound Understanding team at @GoogleDeepMind!

Ever wanted to remove a single cough from a recording or make a faint doorbell louder? Recomposer makes editing complex audio scenes possible!

Paper: https://t.co/bd6lx5b938

#AudioEditing #GenerativeAI

[Eduardo Fonseca @edfonseca_]

🔊New paper! Recomposer allows editing sound events within complex scenes based on textual descriptions and event roll representations. And we discuss the details that matter!

Work led by Dan Ellis w/ a bunch of Sound Understanding folks @GoogleDeepMind
https://t.co/J6F57BqSMn

[Vivek Kumar @vivek_kumar]

Recomposer uses "event roll" (a visual timeline of sounds) and simple text commands to guide edits. - giving precise control to delete, insert, or enhance specific sound events, like "enhance the Door sound from 1.5-2.0s."

An intuitive way to "recompose" a sound scene.

[Vivek Kumar @vivek_kumar]

@KrisBennatti