Tracking beats and microtiming in Afro-latin American music using conditional random fields and deep learning

Magdalena Fuentes, Lucas S. Maia, Martín Rocamora, Luiz W.P. Biscainho, Hélène C. Crayencour, Slim Essid, Juan P. Bello

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Events in music frequently exhibit small-scale temporal deviations (microtiming), with respect to the underlying regular metrical grid. In some cases, as in music from the Afro-Latin American tradition, such deviations appear systematically, disclosing their structural importance in rhythmic and stylistic configuration. In this work we explore the idea of automatically and jointly tracking beats and microtiming in timekeeper instruments of Afro-Latin American music, in particular Brazilian samba and Uruguayan candombe. To that end, we propose a language model based on conditional random fields that integrates beat and onset likelihoods as observations. We derive those activations using deep neural networks and evaluate its performance on manually annotated data using a scheme adapted to this task. We assess our approach in controlled conditions suitable for these timekeeper instruments, and study the microtiming profiles' dependency on genre and performer, illustrating promising aspects of this technique towards a more comprehensive understanding of these music traditions.

Original languageEnglish (US)
Title of host publicationProceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019
EditorsArthur Flexer, Geoffroy Peeters, Julian Urbano, Anja Volk
PublisherInternational Society for Music Information Retrieval
Pages251-258
Number of pages8
ISBN (Electronic)9781732729919
StatePublished - 2019
Event20th International Society for Music Information Retrieval Conference, ISMIR 2019 - Delft, Netherlands
Duration: Nov 4 2019Nov 8 2019

Publication series

NameProceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019

Conference

Conference20th International Society for Music Information Retrieval Conference, ISMIR 2019
CountryNetherlands
CityDelft
Period11/4/1911/8/19

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint Dive into the research topics of 'Tracking beats and microtiming in Afro-latin American music using conditional random fields and deep learning'. Together they form a unique fingerprint.

Cite this