1 / 8

Audio for Telepresence and Virtual Reality

This project aims to enhance auditory experiences in telepresence by replicating human hearing, utilizing binaural sound techniques, and integrating with Virtual Environments to create a more immersive and realistic spatial hearing environment.

xena
Télécharger la présentation

Audio for Telepresence and Virtual Reality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Audio for Telepresence and Virtual Reality Colin S. Harrison

  2. Objective is to enhance sense of hearing for Telepresence and integrate with Virtual Environment Laboratory • Replicate feeling of being there • Hear a sound – turn to look at it • Replicate human hearing • Localise azimuth, elevation, range, properly externalised • Use audio to augment video for improved sensation of presence

  3. Human 3D Spatial Hearing • Differences in Time (ITD) • Differences in Intensity (IID) • Movable Head • Pinnae Filtering (Head Related Transfer Function)

  4. Implementation • Binaural sound / Simulated head • (HRTF) for Headphones • Integrate with Telepresence Projects • B-Format for loudspeakers • Integrate with VE aspects: ABACUS suite • Lake DSP for Headtracked Binaural Simulation and Loudspeaker reproduction

  5. Originality • Binaural -Two eared technique • Ear/sensor assembly • Mechatronic head • World first system • with physical binaural sensors • B-Format approach for Telepresence ( new Application) • No other UK VE site has installed realistic sound

  6. Virtual Environment Integration • Link to existing Virtual Environment Laboratory • Add realistic sound to VE presentations of architectural projects • Change sound as position and room type changes Publications • Conference Paper: (Mechatronics 98) • Journal Paper: (by invitation Mechatronics)

  7. Industrial Relevance • Hostile human environments • Remote Military Intervention • Nuclear Chemical -Chernobyl • Surveillance (Big Brother hears you too!) • Entertainment • Architectural walkthroughs

  8. And Finally • Telepresence: seamlessly represent senses: consider a Turing Test • Accurate sound triggers sense memories

More Related