1 / 19

Electronic Conducting System

This project presents an innovative interactive conducting system allowing users to control music in real-time through hand gestures detected by a webcam. The system comprises three components: input acquisition via webcam, image processing to recognize hand movements, and music adjustments including volume and tempo alteration. Utilizing computer vision techniques, the system processes frames, performs skin segmentation, and tracks hand movements effectively. The user interface enables intuitive interaction, making it suitable for live performances and music education.

hayes
Télécharger la présentation

Electronic Conducting System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Electronic Conducting System Kenzo Abrahams Supervisor: MehrdadGhaziasgar Co-supervisor: James Connon Mentored by: Diego Mushfieldt

  2. Overview • Introduction • User Interface Specification • High Level Design • Low level Design • Demo

  3. Introduction • Interactive Conducting System • Tracks hands using webcam • Real-time alterations depending on hand gestures • Change volume • Change tempo

  4. User Interface Specification • Graphic User Interface (GUI) • User interacts using webcam and mouse

  5. User Interface Specification

  6. User Interface Specification

  7. User Interface Specification

  8. High Level Design • The solution can be broken up into 3 parts • Input • Image processing • Adjust music

  9. Low Level Design

  10. Low Level Design • Input • The frames need to be acquired from the webcam • cvQueryFrame(capture)

  11. Low Level Design • Image Processing • Convert copies of frames to HSV colour space • cvCvtColor(frame, img_hsv, CV_BGR2HSV)

  12. Low Level Design • Image Processing • Skin segmentation • Use of a predefined method • Detect if pixels in the rectangle fall within a certain range

  13. Low Level Design • Image Processing • Set hand as region of interest • cvSetImageROI(pHueImg, pHandRect )

  14. Low Level Design • Image Processing • Perform Camshift • cvCamShift( pProbImg, prevHandRect, cvTermCriteria( CV_TERMCRIT_EPS | CV_TERMCRIT_ITER, 10, 1 ), &components, &HandBox )

  15. Low Level Design • Adjust Music • Library RTcmix is used to produce the music • Can be imbedded into C++ code • load("WAVETABLE") • Wave = maketable("wave", 1000, "tri") • WAVETABLE(start time, duration, amp, frequency, pan, wave)

  16. Demo • Overview of demonstration • Track the right hand • Perform the gestures that are going to be used • Track the left hand • Perform simple gestures such as raising and lowering hand • Move each hand separately

  17. Project Plan

  18. References • O'Niel, D L. (2008). Music Theater Jobs. Available: http://www.ehow.com/list_6547349_music-theater-jobs.html. Last accessed 29th March 2012. • Bradski, G Kaehler, A. (2008). Getting to Know OpenCV. In: Loukides, M Learning OpenCV. United States of America: O’Reilly. pp31-87. • Ivanciuc, O. (2005). SVM - Support Vector Machines . Available: http://www.support-vector-machines.org/. Last accessed 29th March • Nakra, T., Ivanov, Y., Smaragdis, P., Ault, C. (2009). The USB Virtual Maestro: an Interactive Conducting System, pp.250-255, NIME2009 • Borchers, J., Hadjakos, A., M¨uhlh¨auser, M. (2006), MICON a music stand for interactive conducting. Proceedings of the 2006 conference on New interfaces for musical expression, pp254–259.

  19. Questions and Answers

More Related