@GoogleMagenta

Magenta is a research project exploring the role of machine learning in the process of creating art and music.

 Mountain View, CA
g.co/magenta
Joined December 2017
  • Tweets109
  • Following25
  • Followers6K
14Media
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
22
92
34
497
114,595
Google Magenta Project retweeted
Google Flow Music
@googleflowmusicAug 28
Realtime Music Generation is live in Flow Music Spaces! 🚀 We're bringing the Lyria RealTime model into Spaces for instant audio creation. Your sound evolves with every move: swap a genre, tweak an instrument, and hear it come alive seconds later. Start by remixing our MusicFX DJ space, or ask the producer for something entirely different. Let us know what you create! 🎸 flowmusic.app/music-fx-dj
8
22
3
262
13,697
Unreal Engineでインタラクティブな音楽生成を可能とする Magenta Realtime 2 Plugin for UE をリリースしました！🎵 複数プロンプトの比率を動的に変えながらブレンドしたり、MIDI入力で楽器のように演奏したりできます。マップ上の移動に伴って楽曲が変化していく、などの使い方ができそう…🎹
1
6
1
19
4,483
Google Magenta Project retweeted
Linoy Tsaban
@linoy_tsabanJun 22
🔊my latest side quest: MotionJam Magenta RT 2 driven by hand gestures > realtime music generation, with hand motions guiding style morphing and leading notes This model is not getting the attention it deserves Try it out: huggingface.co/spaces/linoyt…
1
3
26
1,365
Google Magenta Project retweeted
Jordan Rudess
@JcrudessJun 8
The Craziest- Coolest most BIZARRE patch I’ve ever played!! @GoogleDeepMind #MagentaRealTime2 #MRT2 #GoogleMagenta #AIMusic #MusicAI
3
8
81
3,418
Google Magenta Project retweeted
Linoy Tsaban
@linoy_tsabanJun 9
🔊 Sound on Been exploring Image-to-Music prompt traveling with the new Magenta RealTime 2.0✨ here the idea was to use SigLIP against a vocab of music tags to bridge the two embeddings spaces and link the visuals to a MusicCoCa representation:
4
3
2
31
5,030
Google Magenta Project retweeted
ꜱᴇᴍɪʟʟᴀ ᴀ.ɪ.@semilla_aiJun 12
The big release: Magenta RealTime 2 from @GoogleMagenta @Ilaria__Manco @jesseengel An open-weights live music model you play like an instrument: ❉ steered by text, audio examples AND MIDI, injected every 40ms frame ❉ ships with apps + DAW plugin 🔗 magenta.withgoogle.com/mrt2
1
3
10
516
Google Magenta Project retweeted
baba@babakartoJun 7
ported Google's Magenta RealTime 2 to run locally on Windows with a consumer GPU @GoogleMagenta
1
3
15
1,146
Love to see the MaxMSP external in action ❤️
little-scale@littlescaleJun 6
Using LFOs to modulate language strength of continuous audio inference using Magenta Real Time 2 (Small), generated on an M5. My prompts are deliberately vague here. Sounds amazing and unsettling.
2
1
27
2,482
Google Magenta Project retweeted
dadabots
@dadabotsJun 6
Open models unite!
Jonathan Whitaker
@johnowhitakerJun 5
I made a looper where you can record midi or audio, and have magenta or stable audio respectively transform it with a prompt. Beatbox and turn that into drums? Check. Play some rough chords and get an orchestra? Check :) Had this app in my head for years!
1
2
33
3,092
Google Magenta Project retweeted
Shortwav Labs@shortwavlabsJun 5
Created a Fast API wrapper around @GoogleMagenta 's RT 2 model, alongside a nice React UI to test it out: github.com/shortwavlabs/mage… #ai #audio #realtime

GitHub - shortwavlabs/magenta-rt-api

Contribute to shortwavlabs/magenta-rt-api development by creating an account on GitHub.

github.com
1
5
661
Magenta... Confabulated!
matdryhurst
@matdryhurstJun 5
Mutating Magenta RT, lot of promise with this
1
3
17
2,836
MRT2 on @huggingface Spaces and pytorch/transformers! Now you can play the demos just from your browser (with a bit of extra latency) huggingface.co/spaces/magent… huggingface.co/spaces/magent…

Magenta RT Jam - a Hugging Face Space by magenta-community

Play notes to steer real-time music (PyTorch)

huggingface.co
apolinario (poli)
@multimodalartJun 5
I' m so addicted to @GoogleMagenta RealTime 2 🎹 so to justify playing with it 24/7 I ported the real-time apps to @huggingface Spaces 🤗 (and ported the entire lib to pytorch/transformers too) Play live in real time on huggingface.co/magenta-commu…
8
10
67
26,295
huggingface.co/magenta-commu…

magenta-community (Magenta Community)

MagentaRT in PyTorch and ONNX (Transformers.js)

huggingface.co
1
4
427
huggingface.co/magenta-commu…

magenta-community/magenta-realtime-2 · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co
1
5
328
Google Magenta Project retweeted
Jordi Pons@jordiponsdotmeJun 5
we'll all remember this month - stable audio 3 - magenta real time 2 - ableton sdk different ideas, different use cases building locally, for artists and hackers together forming the foundations of a new creative AI music stack hell yeah
5
6
1
93
3,727
Google Magenta Project retweeted
Jesse Engel@jesseengelJun 4
Had one of those "Oh, I'm living in the future" moments yesterday. Flying on the airplane. No internet. Playing music with hand gestures controlling a realtime LLM running locally on my laptop Person next to me thinking I'm crazy... all the while I'm having a great time 😅
14
21
6
202
24,434
Classy!
Noah Constant@noahconstJun 4
Replying to @GoogleMagenta
We had so much fun building MRT2.  Proud to see it go live.  Here's a chord steering example.  Name that tune anyone?
1
13
2,604
Google Magenta Project retweeted
Ilaria Manco@Ilaria__MancoJun 4
Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!
Google Magenta Project@GoogleMagentaJun 4
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
14
30
8
274
45,501
Google Magenta Project retweeted
yotam mann@yotammannJun 4
This year marks the 10 year anniversary of Magenta! We’re releasing Magenta RealTime 2, which draws from so many of the ideas that the group has been pursuing over the past 10 years: interactive, genre-bending, open-source tools by and for musicians
4
10
3
67
7,411
Look out for some quick followups we have planned, such as finetuning on your own data, and new performance tools (like at the top of the this post @eardrummer_man). Build your own: github.com/magenta/magenta-r…

GitHub - magenta/magenta-realtime: Magenta RealTime 2: An Open-Weights Live Music Model

Magenta RealTime 2: An Open-Weights Live Music Model - magenta/magenta-realtime

github.com
1
25
1,201
Putting people at the center of the creative process has always been at the core of the Magenta project, and we think MRT2 continues in this tradition of interactive, genre-bending, open tools by and for musicians. It’s been a labor of love for all the contributors and collaborators who have made this project happen. We’ve had a lot of fun with it, and we hope you do too ♥️. @antoine_caillon, @iansimon, @Ilaria__Manco, @eardrummer_man, @georgealways, @chrisdonahuey, @DoItRealTime, @noahconst, @yotammann, @ada_rob, @JulianSlzr, @hellothisiscass, @lancelotbla, @KehangHan, @jesseengel
1
2
31
1,455
Load more