Template-Based Vibrato Analysis of Music Signals

This is the accompanying website for the paper "Template-Based Vibrato Analysis of Music Signals".

Abstract

teaser

The automated analysis of vibrato in complex music signals is a highly challenging task. A common strategy is to proceed in a two-step fashion. First, a fundamental frequency (F0) trajectory for the musical voice that is likely to exhibit vibrato is estimated. In a second step, the trajectory is then analyzed with respect to periodic frequency modulations. As a major drawback, however, such a method cannot recover from errors made in the inherently difficult first step, which severely limits the performance during the second step. In this work, we present a novel vibrato analysis approach that avoids the first error-prone F0-estimation step. Our core idea is to perform the analysis directly on a signal's spectrogram representation where vibrato is evident in the form of characteristic spectro-temporal patterns. We detect and parameterize these patterns by locally comparing the spectrogram with a predefined set of vibrato templates. Our systematic experiments indicate that this approach is more robust than F0-based strategies.

Dataset

All audio files and annotations used in our paper: [.zip]

3.1 Evaluation: Vibrato Detection

Here you find all results of our vibrato detection experiment from Section 3.1.

Sound On Sound Demo - Mystery

Click the button in the middle to activate the player.

Mystery_MikeSenior_excerpt_mix_0dB

Giselle - You

Click the button in the middle to activate the player.

Giselle_You_excerpt_mix_0dB

Leaf - Full

Click the button in the middle to activate the player.

Leaf_Full_excerpt_mix_0dB

Phre The Eon - Everybody is Falling Apart

Click the button in the middle to activate the player.

PhreTheEon_EverybodysFallinApart_excerpt_mix_0dB

Secretariat - Borderline

Click the button in the middle to activate the player.

Secretariat_Borderline_excerpt_mix_0dB

Sunshine Garcia Band - For I Am The Moon

Click the button in the middle to activate the player.

SunshineGarciaBand_ForIAmTheMoon_excerpt_mix_0dB

Angela Thomas Wade - Milk Cow Blues

Click the button in the middle to activate the player.

AngelaThomasWade_MilkCowBlues_excerpt_mix_0dB

Triviul - Dorothy

Click the button in the middle to activate the player.

Triviul_Dorothy_excerpt_mix_0dB

Funny Valentines - Sleigh Ride

Click the button in the middle to activate the player.

FunnyValentines_SleighRide_excerpt_mix_0dB

3.2 Evaluation: Vibrato Analysis

Click the button in the middle to activate the player.

testSignal_vibratoAnalysis