Content not yet available

This lecture has no active video or poster.

technical paper

AAAI 2024

Vancouver , Canada

Music Style Transfer with Time-Varying Inversion of Diffusion Models

keywords:

cms: computational creativity,music style transfer, diffusion

With the development of diffusion models, text-guided image style transfer has demonstrated great controllable and high-quality results. However, the utilization of text for diverse music style transfer poses significant challenges, primarily due to the limited availability of matched audio-text datasets. Music, being an abstract and complex art form, exhibits variations and intricacies even within the same genre, thereby making accurate textual descriptions challenging. This paper presents a music style transfer approach that effectively captures musical attributes using minimal data. We introduce a novel time-varying textual inversion module to precisely capture mel-spectrogram features at different levels. During inference, we utilize a bias-reduced stylization technique to get stable results. Experimental results demonstrate that our method can transfer the style of specific instruments, as well as incorporate natural sounds to compose melodies. Samples and code are available at \url{https://lsfhuihuiff.github.io/MusicTI/}.

Downloads

SlidesPaper

Next from AAAI 2024

Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification
technical paper

Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification

AAAI 2024

+6Yunlong FengWanxiang CheBohan Li
Bohan Li and 8 other authors

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Lectures
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2023 Underline - All rights reserved