Music Synchronization for RWC Music Database (Classical Music)

Introduction to Music Synchronization for RWC Music Database (Classical Music, RWC-MDB-C-2001)

On this web page, we supply MIDI-audio synchronization results obtained from the synchronization procedure described in [2]. Providing these results, our goal is to establish a platform for comparing and discussing various synchronization and alignment procedures. In general terms, music synchronization denotes a procedure which, for a given position in one representation of a piece of music, determines the corresponding position within another representation. Depending upon the respective data formats, one distinguishes between various synchronization tasks. For example, audio-audio synchronization refers to the task of time aligning two different audio recordings of a piece of music. These alignments can be used to jump freely between different interpretations, thus affording efficient and convenient audio browsing. The goal of MIDI-audio synchronization is to coordinate MIDI note events with audio data. The result can be regarded as an automated annotation of the audio recording with available MIDI data. For references, we refer to [1] [2] [3] [4].

To ensure the availability of necessary audio and MIDI data, we revert to the RWC (Real World Computing Music Database (RWC-MDB) . This database, which can be acquired by researchers at the RWC web page, is a copyright-cleared music database, see also [5]. The classical part of the RWC database contains an audio recording as well as a corresponding MIDI file for 61 pieces. Using the synchronization results based on [2], we modified each MIDI file to run synchronously to the corresponding audio recording. These modified MIDI files, which can be regarded as an annotation of the audio recordings by the MIDI note parameters, can now be obtained from this web page.

The Synchronization Results include the following data for each of the given 61 MIDI/audio pairs.

  • Synchronized MIDI files (Warped MIDI [mid])
  • MIDI annotations in form of synchronized MIDI event list (Annotation [csv])
  • Audio-MIDI warping path (WP [csv])
  • Sonification of first 60 seconds using a sinusoidal synthesis for the synchronized MIDI events (Sonification (sinusoidal) [mp3])
  • Sonification of first 60 seconds using a wavetable synthesis for the synchronized MIDI events (Sonification (wavetable) [mp3])

Note: Because of copyright issues, this web page contains the synchronization results and sonifications only for the first 60 seconds of each recording. If you would like to obtain the full results, please obtain them from the AIST Annotation Web Page. If you have not obtained the RWC Music Database yet, you cannot use the data on this web page for your research without obtaining the RWC Music Database.

Disclaimer: The MP3 files and MIDI files supplied on this site can be used only for listening/evaluation purposes. Unauthorized reuse, reproduction, and redistribution are prohibited.

For comments and feedback, please contact Meinard Müller and Sebastian Ewert.

Synchronization Results

The table contains the following data.

  • ID: Identifier for the piece similar to the RWC Piece No.
  • Composer: Name of composer.
  • Piece: Name and work number (opus etc.) of piece.
  • Duration (Audio): Duration of audio recording in seconds.
  • Duration (MIDI): Duration of MIDI version in seconds.
  • Pitch Diff: Estimated difference between the audio and the MIDI given in semitones. In our synchronization approach, we account for possible tuning difference between the audio and the reference MIDI file by considering various pitch filter bank implementations. For example, the number 0.25 indicates that the audio tends to be 0.25 semitones above the reference tuning given by the MIDI file.
  • MIDI Shift: Semitone shift applied to the MIDI file in the sonification to better match the audio. The MIDI shift number is the Pitch Diff number rounded to the next integer value.
  • WP:Warping path resulting from the MIDI-audio synchronization procedure. The warping path is given as list of pairs, where each pair consists of a an audio time position and a MIDI time position both given in seconds. The resolution is 20 milliseconds using a feature rate of 50 Hz and classical DTW with the standard step size conditions.
  • Annotation: Text file containing a comma separated valued list of MIDI events along with corresponding time positions in the audio version. Each row contains the MIDI time position in seconds, the MIDI time position in musical beats, the MIDI note number, the MIDI note duration in seconds, the MIDI velocity, the MIDI channel, as well as the corresponding time position (computed by the synchronization procedure) in the audio recording.
  • Warped MIDI: Temporally warped (and possibly pitch-corrected by MIDI Shift) MIDI running synchronously to the audio recording. Technically, we used tempo events in a first step to warp the MIDI on a beat level, and then, in a second step, minimally adjusted the tick times of the notes to allow for intra-beat micro corrections.
  • Sonification (sinusoidal): MP3 file of sonification of the first 60 seconds of the audio using a sinusoidal synthesis for the synchronized MIDI events.
  • Sonification (wavetable): MP3 file of sonification of the first 60 seconds of the audio using a wavetable synthesis for the synchronized MIDI events.

Note: The MIDI-audio alignment results were obtained using the state-of-the-art synchronization procedure described in [2]. No parameter tuning or manual postprocessing were applied to improve the final result. The results are not meant to be ground truth annotations and may contain synchronization errors and inaccuracies. In particular, boundary problems have not been dealt with in the current version so that synchronization inaccuracies may typically appear at the beginning and the end of the files.

Note: Because of copyright issues, this web page contains the synchronization results and sonifications only for the first 60 seconds of each recording. If you would like to obtain the full results, please obtain them from the AIST Annotation Web Page. If you have not obtained the RWC Music Database yet, you cannot use the data on this web page for your research without obtaining the RWC Music Database.

ID Composer Piece Duration
(Audio)
Duration
(MIDI)
Pitch
Diff
MIDI
Shift
WP Annotation Warped
MIDI
Sonification
(sinusoidal)
Sonification
(wavetable)
1 Haydn, Franz Joseph Symphony no.94 in G major, Hob.I-94 `The Surprise'. 1st mvmt. 504 503 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
2 Mozart, Wolfgang Amadeus Symphony no.40 in G minor, K.550. 1st mvmt. 460 464 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
3 Beethoven, Ludwig van Symphony no.5 in C minor, op.67. 1st mvmt. 436 465 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
4 Tchaikovsky, Pyotr Ilich Symphony no.6 in B minor, op.74 `Pathétique'. 4th mvmt. 593 578 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
5 Mozart, Wolfgang Amadeus Violin Concerto no.5 in A major, K.219. 1st mvmt. 606 606 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
6 Chopin, Frédéric François Piano Concerto no.1 in E minor, op.11. 2nd mvmt. 600 517 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
7 Bach, Johann Sebastian Brandenburg Concerto no.5 in D major, BWV.1050. 1st mvmt. 602 615 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
8 Mozart, Wolfgang Amadeus <Le Nozze di Figaro> (The Marriage of Figaro), K.492: Overture 255 248 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
9 Wagner, Richard <Tristan und Isolde>: Prelude and `Liebestod' 1082 1080 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
10 Strauss II, Johann `An der Schönen Blauen Donau' (Blue Danube Waltz), op.314 462 464 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
11 Bach, Johann Sebastian Passacaglia and Fugue in C minor, BWV.582 757 755 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
12 Bach, Johann Sebastian <The Musical Offering>, BWV.1079. `Ricercare à 6' 387 385 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
13 Mozart, Wolfgang Amadeus String Quartet no.19 in C major, K.465. 1st mvmt. 510 498 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
14 Beethoven, Ludwig van String Quartet no.14 in C# minor, op.131. 5th mvmt. 398 399 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
15 Borodin, Alexander String Quartet no.2 in D major. 3rd mvmt. 464 457 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
16 Mozart, Wolfgang Amadeus Clarinet Quintet in A major, K.581. 1st mvmt. 546 557 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
17 Brahms, Johannes Clarinet Quintet in B minor, op.115. 3rd mvmt. 297 293 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
18 Brahms, Johannes Horn Trio in Eb major, op.40. 2nd mvmt. 462 467 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
19 Beethoven, Ludwig van Piano Trio no.7 in Bb major, op.97 `Archduke'. 1st mvmt. 574 569 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
20 Brahms, Johannes Piano Trio no.1 in B major, op.8. 1st mvmt. 632 619 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
21 Schubert, Franz Peter Piano Quintet in A major, op.32/D.667 `Trout'. 4th mvmt. 491 468 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
22 Brahms, Johannes Hungarian Dance no.5 in F# minor 145 142 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
23a Ravel, Maurice Suite <Ma Mère l'Oye> (Mother Goose), 1. Pavane de la Belle au Bois Dormant 80 83 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
23b Ravel, Maurice Suite <Ma Mère l'Oye> (Mother Goose), 2. Petit Poucet 165 166 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
23c Ravel, Maurice Suite <Ma Mère l'Oye> (Mother Goose), 3. Laideronnette, Impératrice des Pagodes 205 200 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
23d Ravel, Maurice Suite <Ma Mère l'Oye> (Mother Goose), 4. Les Entretiens de la Belle et de la Bête 249 254 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
23e Ravel, Maurice Suite <Ma Mère l'Oye> (Mother Goose), 5. Le Jardin Féerique 170 174 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
24a Bach, Johann Sebastian <The Anna Magdalena Bach Notebooks>, 1. Menuet in G major 86 82 -1.00 -1 [csv] [csv] [mid] [mp3] [mp3]
24b Bach, Johann Sebastian <The Anna Magdalena Bach Notebooks>, 2. Menuet in G minor 89 83 -0.75 -1 [csv] [csv] [mid] [mp3] [mp3]
24c Bach, Johann Sebastian <The Anna Magdalena Bach Notebooks>, 8. Musette in D major 52 46 -0.75 -1 [csv] [csv] [mid] [mp3] [mp3]
25a Bach, Johann Sebastian The Well-Tempered Clavier, Book 1, no.1 in C major BWV.846. Prelude 124 121 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
25b Bach, Johann Sebastian The Well-Tempered Clavier, Book 1, no.1 in C major BWV.846. Fugue 132 133 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
25c Bach, Johann Sebastian The Well-Tempered Clavier, Book 1, no.2 in C minor BWV.847. Prelude 92 95 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
25d Bach, Johann Sebastian The Well-Tempered Clavier, Book 1, no.2 in C minor BWV.847. Fugue 115 119 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
26 Mozart, Wolfgang Amadeus Piano Sonata in A major, K.331/300i. 1st mvmt. 600 599 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
27 Mozart, Wolfgang Amadeus Variations on `Ah Vous Dirai-je Maman', K.265/300e 448 446 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
28 Beethoven, Ludwig van Piano Sonata no.23 in F minor, op.57 `Appasionata'. 1st mvmt. 590 583 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
29 Schumann, Roberto Alexander `Träumerei' from Suite <Kinderszenen>, op.15 145 149 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
30 Chopin, Frédéric François Nocturne no.2 in Eb major, op.9-2 243 242 0.33 0 [csv] [csv] [mid] [mp3] [mp3]
31 Chopin, Frédéric François Etude in E major, op.10-3 256 262 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
32 Chopin, Frédéric François Etude in F minor, op.25-2 110 106 -0.25 0 [csv] [csv] [mid] [mp3] [mp3]
33 Chopin, Frédéric François Polonaise no.6 in Ab major "Héroïque" op.53 405 403 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
34 Liszt, Franz `La Campanella' from <Grandes Études de Paganini> 309 311 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
35a Satie, Erik Three Gymnopédies no.1 229 198 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
35b Satie, Erik Three Gymnopédies no.2 181 181 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
35c Satie, Erik Three Gymnopédies no.3 166 164 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
36 Bach, Johann Sebastian 6 Sonatas and Partitas for Unaccompanied Violin no.6 (Partita no.3) in E major, BWV.1006. 3. Gavotte en Rondeau 212 174 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
37 Beethoven, Ludwig van Violin Sonata no.5 in F major, op.24 `Spring'. 3rd mvmt. 78 72 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
38 Paganini, Niccolò 24 Caprices, op.1 no.24 in A minor 321 307 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
39 Franck, César Violin Sonata in A major. 4th mvmt. 404 399 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
40 Massenet, Jules Meditation from <Thaïs> 306 297 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
41 Bach, Johann Sebastian Suite for Unaccompanied Cello no.1 in G major, BWV 1007. 1. Prelude 159 143 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
42 Saint-Saëns, Camille `Le Cygne' from Suite <Le Carnaval des Animaux> 152 166 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
43 Fauré, Gabriel Sicilienne op.78 250 241 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
44 Rimski-Korsakov, Nikolay `The Flight of the Bumble Bee' 64 61 0.33 0 [csv] [csv] [mid] [mp3] [mp3]
45 Handel, George Frideric Air `Ombra mai fu' (Largo) from <Serse> (Xerxes) 170 168 0.25 0 [csv] [csv] [mid] [mp3] [mp3]
46 Mozart, Wolfgang Amadeus Air 14 (Queen of the Night's Air) `Der Hölle Rache kocht in meinem Herzen' from <Die Zauberflöte> (The Magic Flute), K.620 189 184 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
47 Schubert, Franz Peter `Ständchen' (Serenade) from <Schwanengesang>, D.957 226 225 -0.33 0 [csv] [csv] [mid] [mp3] [mp3]
48 Schubert, Franz Peter `Der Lindenbaum' from <Winterreise>, op.89/D.911 266 255 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
49 Verdi, Giuseppe Air `La donna è mobile qual piuma al vento' from <Rigoletto> 132 133 0.00 0 [csv] [csv] [mid] [mp3] [mp3]
50 Bizet, Georges Micaela's Air `Je dis que rien ne m'épouvante' from <Carmen> 306 307 0.00 0 [csv] [csv] [mid] [mp3] [mp3]

References

  1. Meinard Müller
    Information Retrieval for Music and Motion
    Springer Verlag, ISBN: 3540740473, 2007. Details
    @book{Mueller07_InformationRetrieval_SPRINGER,
    author = {Meinard M\"{u}ller},
    title = {Information Retrieval for Music and Motion},
    type = {Monograph},
    year = {2007},
    isbn = {3540740473},
    publisher = {Springer Verlag}
    url-details = {http://www.springer.com/computer/database+management+%26+information+retrieval/book/978-3-540-74047-6}
    }
  2. Sebastian Ewert, Meinard Müller and Peter Grosche
    High Resolution Audio Synchronization Using Chroma Onset Features
    In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 1869—1872, 2009. PDF
    @inproceedings{EwertMG09_HighResAudioSync_ICASSP,
    author = {Sebastian Ewert and Meinard M{\"u}ller and Peter Grosche},
    title = {High Resolution Audio Synchronization Using Chroma Onset Features},
    booktitle = {Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
    address = {Taipei, Taiwan},
    month = apr,
    year = {2009},
    pages = {1869--1872},
    isbn = {978-1-4244-2354-5},
    issn = {1520-6149},
    url-pdf = {2009_EwertMuellerGrosche_HighResAudioSync_ICASSP.pdf}
    }
  3. Meinard Müller, Henning Mattes and Frank Kurth
    An Efficient Multiscale Approach to Audio Synchronization
    In Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR): 192—197, 2006. PDF
    @inproceedings{MuellerMK06_EfficientMultiscaleApproach_ISMIR,
    author = {Meinard M{\"u}ller and Henning Mattes and Frank Kurth},
    title = {An Efficient Multiscale Approach to Audio Synchronization},
    booktitle = {Proceedings of the 7th International Conference on Music Information Retrieval ({ISMIR})},
    address = {Victoria, Canada},
    month = oct,
    year = {2006},
    pages = {192--197},
    url-pdf = {2006_MuellerMattesKurth_MultiscaleAudioSynchronization_ISMIR.pdf}
    }
  4. Meinard Müller, Frank Kurth and Tido Röder
    Towards an Efficient Algorithm for Automatic Score-to-Audio Synchronization
    In Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR): 365—372, 2004. PDF
    @inproceedings{MuellerKR04_AutomaticScoreAudioSync_ISMIR,
    author = {Meinard M{\"u}ller and Frank Kurth and Tido R{\"o}der},
    title = {Towards an Efficient Algorithm for Automatic Score-to-Audio Synchronization},
    booktitle = {Proceedings of the 5th International Conference on Music Information Retrieval ({ISMIR})},
    address = {Barcelona, Spain},
    month = oct,
    year = {2004},
    pages = {365--372},
    url-pdf = {2004_MuellerKurthRoeder_ScoreAudioSynchronization_ISMIR.pdf}
    }
  5. Masataka Goto, Hiroki Hashiguchi, Takuichi Nishimura and Ryuichi Oka
    RWC Music Database: Popular, Classical and Jazz Music Databases
    In Proceedings of the International Conference on Music Information Retrieval (ISMIR), 2002. PDF
    @inproceedings{GotoHHNO02_ISMIR,
    author = {Masataka Goto and Hiroki Hashiguchi and Takuichi Nishimura and Ryuichi Oka},
    title = {{RWC} Music Database: Popular, Classical and Jazz Music Databases},
    booktitle = {Proceedings of the International Conference on Music Information Retrieval (ISMIR)},
    address = {Paris, France},
    year = {2002},
    url-pdf = {2002_GotoHNO_RWC_ISMIR.pdf}
    }
    ### Links
    * []()

Links