Musings about music production, psychoacoustics, sound synthesis & anything else interesting, from the Centre 4 Digital Music's Audio Engineering research team.
🌟 Excited to Share Our Latest Work! 🎥🎶
Here we present Stable-V2A: Synthesis of Synchronized Sound Effects with Temporal and Semantic Controls
arxiv: https://t.co/zzqQtTQ3jy
web: https://t.co/WgM1SZPu7p
SyncFusion: Multimodal Onset-synchronized Video-To-Audio Foley Synthesis.
We use onsets extracted from silent videos and audio/text embeddings to condition a diffusion model for synchronized sound effects synthesis.
arxiv: https://t.co/AIANgRr7TE
web: https://t.co/riJsNyJjkE
This was work done during an internship @tapeitapp. A special thanks to my collaborator Thomas Walther and my advisor Josh Reiss (@IntelSoundEng). We will present this work at the upcoming AES Convention. Stop by if you are interested in controlling DSP with neural networks.
Fuzz is not just a type of distortion effect, here we show why and in our #ICASSP2023 paper we capture its long-range input dependencies. Works for compression too.
paper: https://t.co/iJDVR38k6x
web: https://t.co/nQQNkYKNp1
vst: https://t.co/K7UKy60iIG