1 / 18

Electronic Conducting System

This project presents an innovative electronic conducting system that uses webcam tracking to interpret hand gestures for real-time musical control. Designed by Kenzo Abrahams and mentored by Diego Mushfield, the system allows conductors to manipulate music parameters, such as volume and tempo, simply by moving their hands. Key technologies include Haar classifiers for face detection, HSV color space conversions, and OpenCV for hand tracking. This facilitates dynamic interactions with music, enabling conductors to seamlessly interact with ensembles or orchestras in an engaging manner.

ginger-thornton
Télécharger la présentation

Electronic Conducting System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Electronic Conducting System By: Kenzo Abrahams Supervisor: MehrdadGhaziasgar Co-supervisor: James Connan Mentored by: Diego Mushfieldt

  2. Overview • Introduction • Design Decisions and System Changes • Implementation • Tools Used • Project Plan • Demo

  3. Introduction • Interactive Conducting System • Tracks hands using webcam • Real-time alterations depending on hand gestures • Change volume • Change tempo

  4. Design Decisions and System changes • Use Haar classifiers to detect the face • Dynamically check for skin colour • Track left hand only when needed

  5. Implementation • Detect face and block it out

  6. Implementation • Convert frame into HSV colour space

  7. Implementation • set hand as region of interest

  8. Implementation • HSV image split up into separate components

  9. Implementation • Create histogram of skin colour

  10. Implementation • Track the right hand (CAMshift)

  11. Implementation • Play music

  12. Implementation • Choose ensemble or entire orchestra

  13. Implementation • Track left hand

  14. Tools Used • Ubuntu 12.04 • Qt Creator with Qt 4.7 • OpenCV 2.4 • Rtcmix 4.0.1

  15. Demo • Demo Overview • Track right hand • Change the tempo of music • Track left hand • Decrease volume of symphony • Increase volume of one ensemble

  16. Project Plan

  17. References • O'Niel, D L. (2008). Music Theater Jobs. Available: http://www.ehow.com/list_6547349_music-theater-jobs.html. Last accessed 29th March 2012. • Bradski, G Kaehler, A. (2008). Getting to Know OpenCV. In: Loukides, M Learning OpenCV. United States of America: O’Reilly. p31-87. • Gibson, J. (2009). RTcmix Tutorial. Available: http://iub.edu/~emusic/509/rtcmixtut.htm. Last accessed 10th Sep 2012. • Nakra, T., Ivanov, Y., Smaragdis, P., Ault, C.: The USB Virtual Maestro: an Interactive Conducting System, p.250-255, NIME2009 (2009). • BORCHERS, J., HADJAKOS, A., AND M¨UHLH¨AUSER, M. MICON (2006) A music stand for interactive conducting. Proceedings of the 2006 conference on New interfaces for musical expression, p254–259. • Viola, P. Jones, M. (2001). Rapid Object Detection using a Boosted Cascade of Simple Features. Conference on computer vision and pattern matching 2001. • Lansky, A . (2005). An Open-Source, Digital Signal Processing and Sound Synthesis Language. Available: http://rtcmix.org/. Last accessed 27th May 2012. • Nokia. (2009). Qt. Available: http://qt.nokia.com/products. Last accessed 10th Sep 2012.

  18. Question and Answers

More Related