Personalized music systems usually rely on manual song annotations (tags) as a mechanism for querying and navigating large music collections. However, the manual annotation is a hard task given the large amount of music available nowadays. Automatic song annotation based on content analysis is a potential solution to this problem and has recently been gaining attention. In this work, we propose to extend the Stacking prediction framework to use Convolutional Neural Networks (CNNs) in order to improve music tag annotation task. In general, the Stacked prediction consists of a technique in which the output of the first stage of learning is used as input in the second stage. In our work we have tried two proposals of extension. The first one consists of using the weights learned by the CNN in the first stage of training as input in the second stage. In the second proposal, we use the autoencoder technique with the weights learned by CNN in the first stage to generate images 50% smaller than the ones used as input of the first stage. The weights and the images obtained in the first stage are used as input in the second stage. We evaluated our proposals with five different CNN models in three datasets well-known in the literature (FMA, MillionSong, and MagnaTagATune), obtaining interesting results.

Improving Musical Tag Annotation with Stacking and Convolutional Neural Networks

One of the goals of the music information retrieval (MIR) community is to research new methods and create new systems that can efficiently and effectively retrieve and recommend songs from large databases of music content. Despite the volume of research in the area, there is a lack of music databases to support these works, i.e. databases that comply with some quite desirable requirements for the development of researches, such as: a huge amount of music pieces, the audio signal availability and a great diversity of audio attributes. In order to contribute to the MIR community, we present Music4All, a new music database which contains metadata, tags, genre information, 30-seconds audio clips, lyrics, and so on. Additionally, we also exemplify some MIR tasks that may benefit from our database and compare it with other databases proposed in the literature. To request the Music4All database, send an e-mail to contact4music4all@gmail.com.

Marcos Domingues

3

SHORT BIO

Presentations

Improving Musical Tag Annotation with Stacking and Convolutional Neural Networks

Music4All: A New Music Database and its Applications

Speech and Audio Processing

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES