1 / 17

Convert Music Sheets to MIDI: An OCR Approach for Note Recognition

This project explores the challenging task of recognizing printed music sheets using computer vision techniques. Inspired by optical character recognition (OCR), it focuses on converting printed music into MIDI format. The process includes recognizing staves, detecting note heads, stems, and various musical symbols while ensuring accurate identification despite common misconceptions. Using structured steps, the project aims to automate music sheet analysis, ultimately linking note recognition to digital audio playback. Join me as I dive into this exciting intersection of technology and music!

hoai
Télécharger la présentation

Convert Music Sheets to MIDI: An OCR Approach for Note Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Note Sheet Reader Final Project by Eyal Ronel

  2. Let’s make a computer see • Already proved to be extremely difficult • …unless the domain is limited and restricted

  3. Black marks, white background Feasible! • Printed characters – widespread (OCR) • How about music sheets? ♫ • Voices recorded as music and played back • Music converted to MIDI and played back • MIDI converted to note sheets… • Does anyone convert note sheets to MIDI? • I will! 

  4. How do you recognize music? • Notes are black circles positioned on black horizontal lines • Note stems and bar lines are black vertical lines that cross black horizontal lines • Specific symbols: • One step at a time.

  5. Task List • Recognize staves • Find the minimal space between staff lines • Gather fives of lines conforming to said space • Find bar lines • Recognize round shapes roughly the height of space • Distinguish filled circles from empty ones • Detect stems protruding from circles • Detect dots to the right of circles • Detect other symbols: flat sign, sharp sign, rests, …

  6. Look for horizontal lines • Assuming the page is straight. • Look for lines that are at least 80% dark • Count fives with minimal distance and denote them staves. • Wipe ‘em out!

  7. How are we so far Not so bad.

  8. What now? Vertical lines! • Recognize staves • Find the minimal space between staff lines • Gather fives of lines conforming to said space • Find bar lines • Recognize round shapes roughly the height of space • Distinguish filled circles from empty ones • Detect stems protruding from circles • Detect dots to the right of circles • Detect other symbols: flat sign, sharp sign, rests, …

  9. Same principle • Just make sure you don’t recognize note stems as bar lines by mistake! Random misconceptions

  10. Mom, look! No lines!

  11. Recognize dark shapes

  12. Reference Note Heads • Filled note head • Empty note head • Whole note Can you find any of these here? → Red means “ignore as background”

  13. Handling notes • Find its stem • Find its position on the staff • Search for dots

  14. Announce its identity • A quarter note C!

  15. Lilypond does the rest Lilypond input

  16. Problems yet to be solved • Better note head recognition • Correct detection of tails • Handling sharps and flats, rests • And this is only the beginning…

  17. But hey, it was a nice experience Thank you for listening ♫

More Related