Another iteration in p5xjs w/ #PianoGenie by Google Magenta Project Single bouncing ball triggers 8 blocks each block mapped to trigger 48 different possible notes #MadeWithMagenta

A short write-up of my latest piece for AI Ircam Forum @ircam #deeplearning #MachineLearning #ai #rnn #ddsp #newmusic Google Magenta Project forum.ircam.fr/article/detail…

Excited to share our collaboration with @vogler_voice, @carolinebuttet, and Google Arts&Culture on Musical Paint, exploring music creation through painting on sensorial canvases (powered by DDSP)! magenta.tensorflow.org/paint-with-mus…

MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling. Coming to an ICLR near you as an oral presentation! ⌨️ Blog: g.co/magenta/midi-d… 🎵 Examples: midi-ddsp.github.io ⏯ Colab: g.co/magenta/midi-d… 💻 Code: github.com/magenta/midi-d… 🧵 1/

DDSP-VST! Realtime Neural Audio Synthesis as an audio plugin. Excited to finally release this fun way to explore new sounds. 🔊 Plugin: g.co/magenta/ddsp-v… 🚂Train Models: g.co/magenta/train-… 🎮Discord: discord.gg/eyzhzMJMx5 📝Blog: magenta.tensorflow.org/ddsp-vst-blog 1/

Excited to share SingSong, a system which can generate instrumental accompaniments to pair with input vocals! 📄arxiv.org/abs/2301.12662 🔊g.co/magenta/singso… Work co-led by myself, Antoine Caillon, and Adam Roberts as part of Google Magenta Project and the broader MusicLM project 🧵

*Taps mic* Is this thing on? 🎙️ We’re excited to introduce new features in Music AI Sandbox, a set of experimental tools for professional musicians. Powered by our latest model Lyria 2, they’re helping singer-songwriters like Isabella Kensington create their next masterpiece.

Interactive real-time, streaming music generation is something I’ve been looking forward to for quite a while. Lyria RealTime (Experimental) by Google DeepMind controlled via #TouchDesigner TouchDesigner #LOPs

Pleasantly surprised with how easy/fun it is to "vibe code" new musical experiences in AI Studio. I'm not much of a JS guy, but had Gemini help me make a "Kaoss Pad" emulator using the Lyria RealTime API to explore musical latent spaces in realtime.

Try it out and fork it here: bit.ly/3ZOp7KS Don't forget you can type in new prompts, Curious to see what else you can make :).

On the occasion of returning to Magenta's roots at Sónar+D, we're dusting off the blog to share news and insights about what we're working on at Google DeepMind on the Lyria Team. g.co/magenta/lyria-… Our latest post is about the Lyria RealTime API, providing access to

Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/github/magenta… 👀 Blog post: g.co/magenta/rt 🧵 below

🎸🥁🎹🎵 New open weights music model from Magenta for real-time generation. Excited to see what cool instruments you all can make with it 🙂

We’ve just released Magenta RealTime, an open-weights live music model that lets you craft sounds in real time by exploring the latent space through text and audio! 🤗 Model: huggingface.co/google/magenta…… 🧑‍💻Code: github.com/magenta/magent… 📝Blog post: magenta.withgoogle.com/magenta-realti…

such a joy to play with... g.co/magenta/prompt… (psychedelic djembe ftw)

P5.js is such a fun way to prototype new creative experiences, so I ported the "Genre Pad" using Lyria Realtime over to run in the P5.js web editor. Please fork and hack as you will 🎶♥️

New VST/AU Plugin! 🚨 Play with Lyria RealTime directly from inside your favorite DAW with “The Infinite Crate” 🎧🎶 Like other Lyria RT demos, you can mix together text prompts and other controls to steer the model in real-time. But now with a VST plugin you can feed audio

One of my favorite use cases for our new Lyria RealTime plug-in "Infinite Crate" is live jamming. While it can't listen to you (yet), it can act as a partner for improvisation, helping inspire new musical ideas. Here is Sidecar Tommy experimenting with it during early testing.

✨ made a realtime bhangra (punjabi folk music) × techno/breakcore fusion using @googlemagenta 's lyria vst plugin in ableton. the mix constantly shifts live between genres, visualized as a sliding gradient bar 📶

I'm enjoying Google's new AI Music VST... it's a great antidote to the "two song" approach taken by Suno and Udio. The interface puts me in a flow state, like fishing in a stream, more than "crate digging" per se. Outputs here reminded me of "Lemon of Pink" Jesse Engel