1 / 15

ReachMedia on-the-move interaction with everyday objects

This study explores innovative interaction methods that blend the virtual and physical environments. By examining the use of RFID, gestures, and smart devices, researchers aim to create a natural interface that frees hands and eyes while ensuring socially acceptable interactions. The approach involves utilizing multimodal input and output methods, such as audio and text, to enhance user experience. Demonstrated through interactive object manipulation, this research provides insights into achieving high accuracy in real-time classification, laying the groundwork for ambient intelligence and responsive interfaces that adapt to user needs.

barbie
Télécharger la présentation

ReachMedia on-the-move interaction with everyday objects

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ReachMedia on-the-move interaction with everyday objects Assaf Feldman, Pattie Maes, Sajid Sadi and Emmanuel Mugia The Media Laboratory Massachusetts Institute of Technology

  2. Question Can we merge the virtual world with the physical world?

  3. An Interface Problem Not enough pixels Too many clicks

  4. Requirements • Natural and seamless interaction • Hands and eyes free • Socially acceptable

  5. IO Input – RFID, Gestures,Keypad. Output –audio,text The smart phone as a general interface

  6. Touch based interaction with objects

  7. Gestures Slight flick for menu navigation Previous Next Select - Socially acceptable.

  8. Demo

  9. Objects ID • Gestural input: • Next • Previous • Select RFID Object ID, user input MITe receiver Audio & XML Content • Audio output: • Earcons • Voice menus Context Manager Interaction mediation via Mobile device Multi modal interface via accessories RFID Augmented physical objects

  10. Hardware - Sensors • RFID • Cheap • Great Context • Accelerometers (House_n MITEs) • Cheap • Small • Low power

  11. Signal processing • 25 features - Time domain feature extraction • Cross correlation (3) • Power (3) • Turning points (18)

  12. Classification • Online (Real Time) classification • Good accuracy using Naïve Bayes and HMMs • Preliminary results ~98% accuracy:

  13. The big picture • Integrate digital world (information & services) and physical world (physical objects/environment) • Make interfaces more responsive and proactive (objects & environment monitor user and (proactively) present information & services relevant to user’s current needs/interests)

  14. Ambient Intelligence 3rd floor

More Related