International Audio Laboratories Erlangen

Freischütz Digital: Paradigmatic Implementation of an Authentic Digital Edition Concept

Logo_BMBF Teaser_FreiDi Logo_FAU Logo_UniPaderborn Logo_UniFrankfurt Logo_HochschuleDetmold

The project Freischütz Digital—sponsored by the Bundesministerium für Bildung und Forschung [Federal Ministry of Education and Research] (BMBF)—was a joint project of the Goethe University Frankfurt, the International Audio Laboratories Erlangen, and University of Paderborn, the latter acting as overall coordinator. On this website, we summarize the project's main outcomes and provide links to project-related resources (data, demonstrators, websites) and publications.

Project Description

Freischütz Digital – Paradigmatic Implementation of an Authentic Digital Edition Concept

Teaser_FreiDi_multimodal

Weber's Freischütz, as an exemplary pilot project following the draft of a concept derived from Frans Wiering's Multidimensional Model of authentically digital music editions, was to provide a proof of concept to demonstrate the potential of an innovative editorial technology and to deal with new issues associated with it. Six work packages jointly worked out by four project partners focused on the work's graphic, logical, and acoustic (or performative) domains, emphasizing at the same time a comprehensive and detailed data contextualization and the formalized linkage concepts required for this. Using MEI, the music-encoding standard for a comprehensive work in Common Western Music Notation (CMN), for the first time and pairing it with a TEI encoding of the verbal text elements opened up completely new possibilities of processing, enriching, and reusing data. By exploring the opportunities for linking to and segmenting audio recordings, the project attempted to contribute to the solution of generic issues in the acoustic field; by demonstrating the potential of its innovative digital-edition model, it endeavored to promote discussion of future edition forms and to encourage further basic research through exemplary investigations of the variance aspect.

Hence, the project was less intended to produce finished results than to show a range of possibilities and to promote new types of access. Bound up with this is the fact that the presentation at hand does not reflect a state of equilibrium attained by the official end of the subsidy in October 2015, but is to be dynamically developed further insofar as this is achievable by means of appropriate work activities. Ultimately, the hope is that upgrades and refinements, or follow-up research on the now freely available data will be made possible in the future through strategic individual grants (also within the academic environment). In this sense, Freischütz Digital can be thought of, on the one hand, as documenting the completed BMBF project, but on the other, it is a still open platform whose instigators welcome feedback and ideas.

Projektbeschreibung

Freischütz Digital – Paradigmatische Umsetzung eines genuin digitalen Editionskonzepts

Teaser_FreiDi_multimodal

Im Anschluss an den Entwurf eines an Frans Wierings Multidimensional Model angelehnten Konzepts genuin digitaler Musikeditionen sollte am Beispiel von Webers Freischütz ein proof of concept sowohl für die Möglichkeiten neuartiger Editionsmethoden als auch damit verbundener neuer Fragestellungen geliefert werden. In den von vier Projektpartnern gemeinsam bearbeiteten sechs Arbeitspaketen standen die graphische, logische und die akustische (bzw. performative) Domäne des Werks im Zentrum. Zugleich wurde auf eine umfassende und detaillierte Kontextualisierung der Daten und die dafür notwendigen formalisierten Verknüpfungskonzepte Wert gelegt. Da erstmals der Musik-Codierungsstandard MEI für ein umfangreiches Werk der Common Western Notation angewendet und mit einer TEI-Codierung der Textanteile verbunden wurde, eröffneten sich für das Prozessieren, Anreichern und Wiederverwenden der Daten völlig neue Möglichkeiten. Mit der Exploration der Möglichkeiten zur Verknüpfung mit Audio-Aufnahmen und deren Segmentierung versuchte das Projekt im akustischen Bereich zur Lösung generischer Fragestellungen beizutragen, mit der Demonstration des Potentials seines neuartigen digitalen Editionsmodells die Diskussion über künftige Editionsformen zu befördern und mit exemplarischen Untersuchungen zum Aspekt der Varianz weitere Grundlagenforschungen anzuregen.

Das Projekt wollte also weniger fertige Ergebnisse vorlegen als Möglichkeiten aufzeigen und neue Zugangsformen befördern. Damit hängt zusammen, dass die vorliegende Präsentation nicht statisch einen mit dem offiziellen Ende der Förderung im Oktober 2015 erreichten Stand wiedergibt, sondern – soweit dies durch entsprechende Zuarbeiten umsetzbar ist – dynamisch weiterentwickelt wird. Letztlich ist zu hoffen, dass Erweiterungen und Verbesserungen oder auf den frei veröffentlichten Daten aufsetzende Anschlussforschungen künftig durch gezielte Einzelförderungen (auch im Umfeld akademischer Ausbildung) erfolgen können. In diesem Sinne versteht sich Freischütz Digital einerseits als Dokumentation des abgeschlossenen BMBF-Projekts, andererseits aber als weiterhin offene Plattform, deren Initiatoren sich über Rückmeldungen und Anregungen freuen.

Projected-Related Resources and Demonstrators

The following list provides an overview of the most important publicly accessible sources created in the FreiDi project:

Projected-Related Publications

The following publications reflect the main scientific contributions of the audio-related contributions carried out within the FreiDi project.

  1. Christian Dittmar, Bernhard Lehner, Thomas Prätzlich, Meinard Müller, and Gerhard Widmer
    Cross-Version Singing Voice Detection in Classical Opera Recordings
    In Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 618–624, 2015. PDF 
    @inproceedings{DittmarLPMW15_ISMIR,
author    = {Christian Dittmar and Bernhard Lehner and Thomas Pr{\"a}tzlich and Meinard M{\"u}ller and Gerhard Widmer},
title     = {Cross-Version Singing Voice Detection in Classical Opera Recordings},
booktitle = {Proceedings of the International Society for Music Information Retrieval Conference  ({ISMIR})},
address   = {M{\'a}laga, Spain},
year      = {2015},
pages     = {618--624},
url-pdf   = {2015_DittmarLPMW_SingingVoice_ISMIR.pdf}
}
  2. Christian Dittmar, Thomas Prätzlich, and Meinard Müller
    Towards Cross-Version Singing Voice Detection
    In Proceedings of the Deutsche Jahrestagung für Akustik (DAGA), 2015. PDF 
    @inproceedings{DittmarPM15_SingingVoiceDetection_DAGA,
author    = {Christian Dittmar and Thomas Pr{\"a}tzlich and Meinard M{\"u}ller},
title     = {Towards Cross-Version Singing Voice Detection},
booktitle = {Proceedings of the Deutsche Jahrestagung f{\"u}r Akustik (DAGA)},
address   = {N{\"u}rnberg, Germany},
year      = {2015},
url-pdf   = {2015_DittmarPM_SingingVoice_DAGA.pdf}
}
  3. Meinard Müller, Thomas Prätzlich, Benjamin Bohl, and Joachim Veit
    Freischütz Digital: A multimodal scenario for informed music processing
    In Proceedings of the International Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS): 1–4, 2013. PDF Details 
    @inproceedings{MuellerPBV13_FreischuetzDigital_WIAMIS,
author    = {Meinard M{\"u}ller and Thomas Pr{\"a}tzlich and Benjamin Bohl and Joachim Veit},
title     = {{F}reisch{\"u}tz {D}igital: {A} multimodal scenario for informed music processing},
booktitle = {Proceedings of the International Workshop on Image and Audio Analysis for Multimedia Interactive Services ({WIAMIS})},
address   = {Paris, France},
year      = {2013},
pages     = {1--4},
url-pdf   = {2013_MuellerPraetzlich_FreiDiAudio_WIAMIS.pdf},
url-details = {http://www.freischuetz-digital.de/}
}
  4. Meinard Müller, Thomas Prätzlich, and Christian Dittmar
    Freischütz Digital — When Computer Science Meets Musicology
    In Festschrift für Joachim Veit zum 60. Geburtstag: 551–573, 2016. PDF Details 
    @inproceedings{MuellerPD16_FreischuetzDigital_Veit,
author    = {Meinard M{\"u}ller and Thomas Pr{\"a}tzlich and Christian Dittmar},
title     = {{F}reisch{\"u}tz {D}igital -- {W}hen Computer Science Meets Musicology},
booktitle = {{F}estschrift f{\"u}r Joachim Veit zum 60. Geburtstag},
editor    = {Kristina Richts and Peter Stadler},
publisher = {{A}llitera},
address   = {M{\"u}nchen, Germany},
year      = {2016},
pages     = {551--573},
url-pdf   = {2016_MuellerPD_FreischuetzDigital_VeitFestschrift.pdf},
url-details = {http://www.freischuetz-digital.de/}
}
  5. Thomas Prätzlich, Rachel Bittner, Antoine Liutkus, and Meinard Müller
    Kernel Additive Modeling for Interference Reduction in Multi-channel Music Recordings
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 584–588, 2015. PDF Demo 
    @inproceedings{PraetzlichBLM15_InterferenceReduction_ICASSP,
author    = {Thomas Pr{\"a}tzlich and Rachel Bittner and Antoine Liutkus and Meinard M{\"u}ller},
title     = {Kernel Additive Modeling for Interference Reduction in Multi-channel Music Recordings},
booktitle  = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address  = {Brisbane, Australia},
year       = {2015},
pages    = {584--588},
url-pdf   = {2015_PraetzlichBittnerLiutkusMueller_KAMIR_ICASSP.pdf},
url-demo  ={https://www.audiolabs-erlangen.de/resources/MIR/2015-ICASSP-KAMIR/}
}
  6. Thomas Prätzlich, Jonathan Driedger, and Meinard Müller
    Memory-Restricted Multiscale Dynamic Time Warping
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 569–573, 2016. PDF 
    @inproceedings{PraetzlichDM16_MsDTW_ICASSP,
author    = {Thomas Pr{\"a}tzlich and Jonathan Driedger and Meinard M{\"u}ller},
title     = {Memory-Restricted Multiscale Dynamic Time Warping},
booktitle = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address   = {Shanghai, China},
year      = {2016},
pages     = {569--573},
url-pdf   = {2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf}
}
  7. Thomas Prätzlich and Meinard Müller
    Freischütz Digital: A case study for reference-based audio segmentation of operas
    In Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 589–594, 2013. PDF Details 
    @inproceedings{PraetzlichMueller13_FreischuetzSeg_ISMIR,
author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller},
title     = {{F}reisch{\"u}tz {D}igital: {A} case study for reference-based audio segmentation of operas},
booktitle = {Proceedings of the International Society for Music Information Retrieval Conference  ({ISMIR})},
address   = {Curitiba, Brazil},
year      = {2013},
pages     = {589--594},
url-pdf   = {2013_PraetzlichMueller_FreiDiMatching_ISMIR.pdf},
url-details = {http://www.freischuetz-digital.de/}
}
  8. Thomas Prätzlich and Meinard Müller
    Frame-Level Audio Segmentation for Abridged Musical Works
    In Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 307–312, 2014. PDF 
    @inproceedings{PraetzlichM14_AudioTrackSeg_ISMIR,
author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller },
title     = {Frame-Level Audio Segmentation for Abridged Musical Works},
booktitle = {Proceedings of the International Society for Music Information Retrieval Conference  ({ISMIR})},
address   = {Taipei, Taiwan},
year      = {2014},
pages     = {307--312},
url-pdf   = {2014_PraetzlichMueller_FreiDiPartialMatching_ISMIR.pdf}
}
  9. Thomas Prätzlich and Meinard Müller
    Triple-Based Analysis of Music Alignments Without the Need of Ground-Truth Annotations
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 266–270, 2016. PDF 
    @inproceedings{PraetzlichM16_Triple_ICASSP,
author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller},
title     = {Triple-Based Analysis of Music Alignments Without the Need of Ground-Truth Annotations},
booktitle = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address   = {Shanghai, China},
year      = {2016},
pages     = {266--270},
url-pdf   = {2016_PraetzlichMueller_SyncTripleEvaluation_ICASSP.pdf}
}
  10. Thomas Prätzlich, Meinard Müller, Benjamin W. Bohl, and Joachim Veit
    Freischütz Digital: Demos of audio-related contributions
    In Demos and Late Breaking News of the International Society for Music Information Retrieval Conference (ISMIR), 2015. PDF Details 
    @inproceedings{PraetzlichMBV15_FreiDi_ISMIR-LBD,
author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller and Benjamin W. Bohl and Joachim Veit},
title     = {{F}reisch{\"u}tz {D}igital: {D}emos of audio-related contributions},
booktitle = {Demos and Late Breaking News of the International Society for Music Information Retrieval Conference ({ISMIR})},
address   = {Mal{\'a}ga, Spain},
year      = {2015},
url-pdf   = {2015_PraetzlichMBV_FreiDi_ISMIR-LBD.pdf},
url-details = {http://freischuetz-digital.de/}
}
  11. Daniel Röwenstrunk, Thomas Prätzlich, Thomas Betzwieser, Meinard Müller, Gerd Szwillus, and Joachim Veit
    Das Gesamtkunstwerk Oper aus Datensicht — Aspekte des Umgangs mit einer heterogenen Datenlage im BMBF-Projekt Freischütz Digital''
    Datenbank-Spektrum, 15(1): 65–72, 2015. PDF Demo DOI 
    @article{RoewenstrunkPBMSV15_WeberOper_DBSK,
author    = {Daniel R{\"o}wenstrunk and Thomas Pr{\"a}tzlich and Thomas Betzwieser and Meinard M{\"u}ller and Gerd Szwillus and Joachim Veit},
title     = {{D}as {G}esamtkunstwerk {O}per aus {D}atensicht -- {A}spekte des {U}mgangs mit einer heterogenen {D}atenlage im {BMBF}-{P}rojekt ``{F}reisch{\"u}tz {D}igital''},
journal   = {Datenbank-Spektrum},
volume    = {15},
number    = {1},
pages     = {65--72},
year      = {2015},
doi       = {10.1007/s13222-015-0179-0},
url-pdf   = {2015_RoewenstrunkPBMSV_FreiDi_DatenbankSpektrum.pdf},
url-demo  = {http://freischuetz-digital.de/}
}

Projected-Related Ph.D. Thesis

  1. Thomas Prätzlich
    Freischütz Digital: Processing Audio Signals in Complex Music Scenarios
    PhD Thesis, Friedrich-Alexander-Universität Erlangen-Nürnberg, 2016. PDF Details 
    @phdthesis{Praetzlich16_FreischuetzDigital_PhD,
author      = {Thomas Pr{\"a}tzlich},
year        = {2016},
title       = {Freischütz Digital: Processing Audio Signals in Complex Music Scenarios},
school      = {Friedrich-Alexander-Universit{\"a}t Erlangen-N{\"u}rnberg},
url-details = {https://opus4.kobv.de/opus4-fau/frontdoor/index/index/year/2017/docId/7982},
url-pdf = {https://opus4.kobv.de/opus4-fau/files/7982/2016_Praetzlich_Thesis_PhD.pdf}
}