420 likes | 515 Vues
Explore innovative input and output methods, from clickless interfaces to virtual reality environments, enhancing interaction with media devices. Delve into advanced technologies like body signals, synthetic sounds, and real-world overlays, offering a glimpse into the future of human-computer interaction.
E N D
Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2008
Major Categories • Input • Harder • Output • More successful history
Inputs - 1 • Clickless Interface Example • http://www.dontclick.it • TTY • Voice • Gesture • Body language • Using succinct communications • Haptic • Phantom devices, etc
Inputs - 2 • Clickless Interface Example • http://www.dontclick.it • Handwriting • Security identification • Fingerprints • Laser identification • Eye tracking • Movement
Inputs - 3 • Body forces • Live seat • Sides of back • Etc • Transporter (gestural communications) • Segway Video • Winglet Video
Inputs - 4 • Simulators • Disney, Pilot training, NASA • Structured light • Body sensors • Animation • Motion capture
Inputs - 5 • Widgets • Buttons, sliders, menus, toggles, etc • User Recognition • Get your coffee the way you always get it! • Machine Learning • Watch and learn • Windows menus: What is on top of menu?
Inputs - 6 • Multi-channel • Games • Simulators • Training/Education • Music • Electronic keyboard
Inputs - 7 • Read CNS signals • Muscle signals • Lie detector • Skin conductivity • Direct brain signal interface • cyberkineticsinc.com <braingate.com> • ALS • Spinal cord injury sufferers
Outputs – 1 • Flat screen • Resolution, colors, refresh rate, size … • “Big Board” on CNN, MSNBC • Stereopsis Techniques • Left/Right visual separation • Color filters: R/G, etc • Polarized glasses
Outputs – 2 • Sound • Synthetic, unnatural sounds • Laser, “wrong,” “dive” • Realistic: • prerecorded DB • generated • Speech • Synthetic • Real, prerecorded
Outputs – 3 • Visualizations • Scientific visualization • Information visualizaiton
Outputs – 5 • VR Environments • 3D • Spinal medication • MRI visualizations • Fly throughs • Fantasy worlds
Outputs – 6 • Overlays on real-world • Breast biopsy procedure • Assembly or Maintenance Info • HUDs in cockpit • Reduce cognitive overload
Outputs – 7 • VR Environments • “Holodecks”, synthetic spaces, avatars • Virtual “try on” for clothes • Smell • Vibrations • Newtonian Physics: ON • Exploit the known, natural experience • Highly predictable • Concise
Outputs – 8 • Newtonian Physics: ON (cont ) • Provide normal physics of environment • Inertia • Collisions (no penetrations) • Gravity • Friction • Noise • Provide artificial physics • New rules/forces
Outputs – 9 • Background sound • Movie score • Important • Not natural
Large Screen Displays • Large touch display with gestures
Large Screen Displays • Large multi-point input display
Virtual, Remote (Robotic) Surgery • Robotic Surgery • daVinci System
Synthetic Worlds • Siggraph (2001)
Video Clips • Magic Board 1 • Magic Board 2 • Magic Board 3 • Braingate 1 • Braingate 2
Transporter/Winglet • Segway device
End Interfaces: Media and Devices