1 / 10

Report about polyphonic music transcription

Report about polyphonic music transcription. Enabling Access to Sound Archives through Integration, Enrichment and Retrieval. What is Automatic Music Transcription. Transcription. Play/Synthesis. Key technologies of polyphonic music transcription. Music onset detection

portia-carlson
Télécharger la présentation

Report about polyphonic music transcription

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Report about polyphonic music transcription Enabling Access to Sound Archives through Integration, Enrichment and Retrieval

  2. What is Automatic MusicTranscription Transcription Play/Synthesis

  3. Key technologies of polyphonic music transcription • Music onset detection • Polyphonic music transcription

  4. A particular time-frequency analysis tool: Resonator Time-frequency Image (RTFI) • Computation-efficient • implemented by the first-order complex resonator filter bank • development of multi-resolution fast implementation • A uniform Framework of TF analysis for music signal • unlike Cohen’s class and Affine class, RTFI is not limited to either constant-band or constant-Q • by simply setting several parameters, the RTFI can implement different TF analysis such as constant-band, constant-Q and ear-like TF analysis • a frequency-dependent time-frequency analysis

  5. Music Onset Detection • What is music onset detection • detection of the instant when a new event begins in acoustical signal • hard Onset (fast transition with big energy change) • soft Onset (slow transition with small energy change) • How human detect onset • energy change • pitch change • timbre change

  6. Onset detection method inEASAIER • Time-Frequency Processing: • incorporating psychoacoustics knowledge about loudness perception • making energy-change and pitch-change as clear as possible • Detection Algorithms: detecting onsets by both energy and pitch change clues

  7. Problems in Polyphonic Pitch Estimation • Harmonic components of different music notes may overlap • In-harmonic: some music instrument have inharmonic timbre

  8. Polyphonic Pitch Estimation Method in EASAIER 5 Steps: • Performing RTFI analysis • Extracting harmonic components • Making preliminary estimation of possible pitches • Cancelling the extra pitches by checking harmonic components ( simple timbre model) • Checking pitch candidates by spectral smoothing principle

  9. Compared with other state-of-art methodsMIREX 2007 Evaluation • Music onset detection • According to the overall performance, our method wins this contest • Polyphonic pitch estimation (Multiple-F0 estimation task) • our method performed third best in the submitted 16 methods. The performance differences between our method and the first and second best method are minor. • but most computationally efficient, about 10 time faster than the first best method, and 100 time faster than the second best method

  10. Future plan • To develop the method for note offset detection • To estimate the note duration time • To improve and evaluate the automation music transcription system • To apply the transcription system assisting the other functionalities such as content-based music retrieval

More Related