Simple and Controllable Music Generation
paper page: https://t.co/yopvJvn18p
introduce MusicGen, a single Language Model (LM) that operates over several streams of compressed discrete music representation, i.e., tokens. Unlike prior work, MusicGen is comprised of a single-stage transformer LM together with efficient token interleaving patterns, which eliminates the need for cascading several models, e.g., hierarchically or upsampling. Following this approach, we demonstrate how MusicGen can generate high-quality samples, while being conditioned on textual description or melodic features, allowing better controls over the generated output. We conduct extensive empirical evaluation, considering both automatic and human studies, showing the proposed approach is superior to the evaluated baselines on a standard text-to-music benchmark. Through ablation studies, we shed light over the importance of each of the components comprising MusicGen.
We've just released MusicGen, and there is a @huggingface demo now, here is a thread about me playing with it just right now. https://t.co/kAE7mSMjrw
A 🧵👇
Super excited to share that today we release MusicGen: a simple and controllable music generation.
🤖 🎵 🔊
📜 Paper: https://t.co/9ALor2ziwj
🖥️ Code and models avail under: https://t.co/H66XKjppTJ.
🎵 Samples can be found here: https://t.co/5c5Ru3ebma
See more details👇
We present MusicGen: A simple and controllable music generation model. MusicGen can be prompted by both text and melody.
We release code (MIT) and models (CC-BY NC) for open research, reproducibility, and for the music community: https://t.co/OkYjL4xDN7
Pretrained LMs are fundamental in NLP. Can they benefit SpeechLMs?
We present TWIST, a SpeechLM training method using a textual LM warm-start. TWIST consistently outperforms cold-start baselines.
We also introduce the largest SpeechLM to date.
Paper: https://t.co/uNTttWx82e
1/n
@ishaycoen בגדול אני מסכים איתך... בקטן, הייתי מצפה מאותם שרים להודיע רשמית שלא ידבו או ינאמו על פוליטיקה בימים הללו ולהסביר למה חשוב שהם כן יגיעו לחזק ולאחד.... אולי אז יתקבלו בברכה.... עד אז מאמין שלא כי הם שותפים מלא מלא ל"רפורמה"
@EldadYaniv אתה דפוק אלדד... חבלז... הוא דווקא אמר שהזכות להפגין נגדו עומדת. ואיזו מחאה הוא מניע בדיוק? יש לך ראיות למשהו אקטיבי שהוא עושה בימים אלו או שאתה סתם ממציא שטויות?