1 / 16

Tailoring Tabletop Interfaces for Musical Control

Explore multitouch technology, intimate control of acoustic instruments, and interactive music systems through camera-based systems for musical interfaces.

anoush
Télécharger la présentation

Tailoring Tabletop Interfaces for Musical Control

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Trinity College Dublin Tailoring Tabletop Interfaces for Musical Control Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland

  2. Tailoring Tabletop Interfaces for Musical Control Proliferation of multitouchteechnology: • Smart phone/ iPod etc. • iPad/ Galaxy tab etc. • Microsoft Surface, Diamond Touch etc. • Bespoke multitouch tables. Smart phone/ iPod. Liam O’Sullivan, Trinity College Dublin.

  3. Tailoring Tabletop Interfaces for Musical Control Traditional/ acoustic musical instruments: • Direct manipulation of the sound producing mechanism -> feedback in multiple modes. • Tight input-output coupling -> fast system response. • Result: sense of intimate control. Liam O’Sullivan, Trinity College Dublin.

  4. Tailoring Tabletop Interfaces for Musical Control Computer-based interactive music system (IMS): • Control of complex musical output, timbre. • Interface detached from the sound generator. • Disrupts the player's perceived relationship with the system. Liam O’Sullivan, Trinity College Dublin.

  5. Tailoring Tabletop Interfaces for Musical Control Wessel et. al. - design goals for control intimacy: • Ease of use/ potential for virtuosity. • Highly reactive system. • Meaningful interactions. Liam O’Sullivan, Trinity College Dublin.

  6. Tailoring Tabletop Interfaces for Musical Control Related Work: • The reacTable: modular synthesis paradigm. • SurfaceMusic: traditional instrument interaction metaphors & physical models. Liam O’Sullivan, Trinity College Dublin.

  7. Tailoring Tabletop Interfaces for Musical Control Benefits of camera system for a musical interface: • Multitouch input- collaborative & bi-manual play, multiple gesture scales. • Simultaneous control of many parameters. • Superimposed feedback on control surface. Liam O’Sullivan, Trinity College Dublin.

  8. Tailoring Tabletop Interfaces for Musical Control Weaknesses with regard to intimate musical control: • Low temporal resolution/ high latency. • Poor strength-of-interaction detection. • GUI designs. Liam O’Sullivan, Trinity College Dublin.

  9. Tailoring Tabletop Interfaces for Musical Control Prototype 1: • twoHand: relates shapes to sound parameters. • Another camera-based system! Liam O’Sullivan, Trinity College Dublin.

  10. Tailoring Tabletop Interfaces for Musical Control Approach: • Examination of all functional stages of an IMS. • Sensing, Processing, Feedback. Liam O’Sullivan, Trinity College Dublin.

  11. Tailoring Tabletop Interfaces for Musical Control Acoustic sensing: sampling in 1 KHz range. Gesture recognition: capturing expressive intent. Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters. Virtual objects: qualities mapped to sound synthesis parameters. Sound synthesis: physical models. Liam O’Sullivan, Trinity College Dublin.

  12. Tailoring Tabletop Interfaces for Musical Control Diffraction and reflection of vibrational waves in plates- difficult to model. Liam O’Sullivan, Trinity College Dublin.

  13. Tailoring Tabletop Interfaces for Musical Control Abstract graphical controllers based on sound symbolism: Liam O’Sullivan, Trinity College Dublin.

  14. Tailoring Tabletop Interfaces for Musical Control Pilot user survey of audio-visual mappings: Liam O’Sullivan, Trinity College Dublin.

  15. Tailoring Tabletop Interfaces for Musical Control Automation of low level processes using fuzzy logic: Liam O’Sullivan, Trinity College Dublin.

  16. Tailoring Tabletop Interfaces for Musical Control Thank you! Talk to me at my poster! lmosulli@tcd.ie Liam O’Sullivan, Trinity College Dublin.

More Related