Research Roadmap of Multimodality 200 2 -2005

1. Research Roadmap of Multimodality2002-2005 Mobile, Human-Centered, and Intelligent Multimodal Interfaces Adequate Corpora for MM Research Multimodal Interface Toolkit Computational Models of Multimodality 2 Nov. 2001 Dagstuhl Seminar Fusion and Coordination in Multimodal Interaction edited by: W. Wahlster 2005 Standards for the Annotation of MM Training Corpora Multimodal Barge-In Mobile Multimodal Interaction Tools Multiparty MM Interaction Multimodal Toolkit for Universal Access Situated and Task- Specific MM Corpora Models of MM Mutual Disambiguation Collection of Hardest and Most Frequent/Relevant Phenomena Decision-theoretic, Symbolic and Hybrid Modules for MM Input Fusion XML-Encoded MM Human-Human and Human-Machine Corpora Models for Effective and Trustworthy MM HCI Plug- and Play Infrastructure Reusable Components for Multimodal Analysis and Generation Task- , Situation- and User- Aware Multimodal Interaction Corpora with Multimodal Artefacts and New Multi- modal Input Devices 2002 Markup Languages for Multimodal Dialogue Semantics Common Representation of Multimodal Content Examples of Added-Value of Multimodality Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Toolkits for Multimodal Systems

2. Research Roadmap of Multimodality2006-2010 Ecological Multimodal Interfaces Tailored and Adaptive MM Interaction 2 Nov. 2001 Dagstuhl Seminar Fusion and Coordination in Multimodal Interaction edited by: W. Wahlster 2010 Computational Models of the Acquisition of MM Communication Skills Incremental Feedback between Modalities during Generation Non-Intrusive & Invisible MM Input Sensors User‘s Theories of System‘s Multimodal Capabilities Testsuites and Benchmarks for Multimodal Interaction Multicultural Adaptation of Multimodal Presentations Parametrized Model of Multimodal Behaviour Multimodal Models of Engagement and Floor Management Resource-Bounded Multimodal Interaction Usability Evaluation Methods for MM System Multimodal Feedback and Grounding Multimodality in VR and AR Environments Demonstration of Performance Advances through Multimodal Interaction Models of MM Collaboration 2006 Non-Monotonic MM Input Interpretation Real-time Localization and Motion/Eye Tracking Technology Biologically-Inspired Intersensory Coordination Models Affective MM Communication Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Toolkits for Multimodal Systems

3. Research Roadmap of Multimodality2001-2010Enabling Technologies and Important Contributing Research Areas 2 Nov. 2001 Dagstuhl Seminar Fusion and Coordination in Multimodal Interaction edited by: W. Wahlster Multimodal Output Multimodal Input Multimodal Interaction l Sensor Technologies l Vision l Speech & Audio Technology l Biometrics l User Modelling l Cognitive Science l Discourse Theory l Ergonomics l Smart Graphics l Design Theory l Embodied Conversational Agents lSpeech Synthesis l Machine Learning l Formal Ontologies l PatternRecognition lPlanning