160 likes | 256 Vues
Explore multitouch technology, intimate control of acoustic instruments, and interactive music systems through camera-based systems for musical interfaces.
E N D
Trinity College Dublin Tailoring Tabletop Interfaces for Musical Control Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland
Tailoring Tabletop Interfaces for Musical Control Proliferation of multitouchteechnology: • Smart phone/ iPod etc. • iPad/ Galaxy tab etc. • Microsoft Surface, Diamond Touch etc. • Bespoke multitouch tables. Smart phone/ iPod. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Traditional/ acoustic musical instruments: • Direct manipulation of the sound producing mechanism -> feedback in multiple modes. • Tight input-output coupling -> fast system response. • Result: sense of intimate control. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Computer-based interactive music system (IMS): • Control of complex musical output, timbre. • Interface detached from the sound generator. • Disrupts the player's perceived relationship with the system. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Wessel et. al. - design goals for control intimacy: • Ease of use/ potential for virtuosity. • Highly reactive system. • Meaningful interactions. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Related Work: • The reacTable: modular synthesis paradigm. • SurfaceMusic: traditional instrument interaction metaphors & physical models. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Benefits of camera system for a musical interface: • Multitouch input- collaborative & bi-manual play, multiple gesture scales. • Simultaneous control of many parameters. • Superimposed feedback on control surface. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Weaknesses with regard to intimate musical control: • Low temporal resolution/ high latency. • Poor strength-of-interaction detection. • GUI designs. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Prototype 1: • twoHand: relates shapes to sound parameters. • Another camera-based system! Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Approach: • Examination of all functional stages of an IMS. • Sensing, Processing, Feedback. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Acoustic sensing: sampling in 1 KHz range. Gesture recognition: capturing expressive intent. Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters. Virtual objects: qualities mapped to sound synthesis parameters. Sound synthesis: physical models. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Diffraction and reflection of vibrational waves in plates- difficult to model. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Abstract graphical controllers based on sound symbolism: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Pilot user survey of audio-visual mappings: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Automation of low level processes using fuzzy logic: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Thank you! Talk to me at my poster! lmosulli@tcd.ie Liam O’Sullivan, Trinity College Dublin.