PipaSet and TEAS: A Multimodal Dataset and Annotation Platform for Automatic Music Transcription and Expressive Analysis dedicated to Chinese Traditional Plucked String Instrument Pipa - Sorbonne Université
Journal Articles (Review Article) IEEE Access Year : 2022

PipaSet and TEAS: A Multimodal Dataset and Annotation Platform for Automatic Music Transcription and Expressive Analysis dedicated to Chinese Traditional Plucked String Instrument Pipa

Yuancheng Wang
  • Function : Author
  • PersonId : 1218344
Yuyang Jing
  • Function : Author
  • PersonId : 1218345
Wei Wei
Dorian Cazau
  • Function : Author
  • PersonId : 1218347
Olivier Adam
Qiao Wang
  • Function : Author
  • PersonId : 1218348

Abstract

Music Information Retrieval (MIR) develop rapidly these years, Automatic Music Transcription (AMT) and Expressive Analysis is increasingly gaining momentum on both Western and non-eurogenic music. However, the annotated datasets for non-eurogenic instruments remain scarce on quantity and feature diversity so that general evaluations and data-driven models on various tasks cannot be well-explored. As one of the most popular traditional plucked string instruments in Asia barely analyzed in MIR community, pipa has lots of distinctive national and local characteristics mainly including 4 classes of sophisticated playing techniques greatly enhancing the music expressiveness. Our work aims to systematically clarify an efficient procedure for the multi-modal pipa dataset creation which consists of audio, musical notations and multi-view videos of Chinese traditional solos. The use of 4-track string vibration signals captured by optical sensors paves a path to high quality annotation. A Transcription and Expressiveness Annotation System (TEAS) is transparently implemented to ensure the scalability of dataset. Finally, a series of existent and new MIR tasks enabled by this dataset are enumerated to explore in the future.
Fichier principal
Vignette du fichier
PipaSet_IEEE_ACCESS.pdf (4.45 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03950855 , version 1 (22-01-2023)

Identifiers

Cite

Yuancheng Wang, Yuyang Jing, Wei Wei, Dorian Cazau, Olivier Adam, et al.. PipaSet and TEAS: A Multimodal Dataset and Annotation Platform for Automatic Music Transcription and Expressive Analysis dedicated to Chinese Traditional Plucked String Instrument Pipa. IEEE Access, 2022, 10, pp.113850-113864. ⟨10.1109/ACCESS.2022.3216282⟩. ⟨hal-03950855⟩
18 View
99 Download

Altmetric

Share

More