Mixing the Real and the Virtual in a Hospital through Telepresence

1. Mixing the Real and the Virtual in a Hospital through Telepresence Kevin Smith kevin.smith@sindex.ca

2. Mixing the Real and the Virtual! • Can we mix virtual people with real people? • Can we mix real people with virtual people?

3. It has already been done!

4. Simulation & Training using Telepresence • Benefits: • Clinicians and other professionals with heavy demands on their time can participate in a simulation from anywhere in the hospital (or outside it) • Training can take place anywhere eg a simulation can be run in a patient’s room immediately after a real patient is discharged from that room

5. Is it possible? • Light Field capture and display • Perceptually the same as an optical wavefront • Based on Integral Photography invented by Lippmann in 1908! • Acoustic Wave Field capture and generation

6. What’s a Lightfield?

7. Stanford Multi-Camera Array

8. Data Rate • 128 cameras each operating at 30 fps • 640 x 480 8 bit pixels • Total data rate of over 9 Gbps • http://graphics.stanford.edu/papers/CameraArray/

9. Holografika’s HoloVizio

10. QinetiQ’s Autostereo 3D Display Wall

11. Everyone can see the same point

12. Autostereoscopic Displays Available Today • QinetiQ http://www.qinetiq.com/home/technologies/technologies/optronics/pad/hpv/3d.html • Holografika http://www.holografika.com/markets/ts640rc.shtml • Deep Light http://www.deeplight.com/products_displays_designer.html

13. MIT LOUD

14. Data Rate • 1020 microphones each sampling at 16 KHz • 24 bits per sample • Total data rate of 393 Mbps • http://cag.csail.mit.edu/mic-array/

15. IOSONO: Wavefield Generation • Wave Field Generation • Large array of speakers – uses Huygens’ Principle • http://www.idmt.fraunhofer.de/eng/research_topics/wave_field_synthesis.htm

18. MERL: 3D TV • Lightfield capture and display • 16 cameras at 30 fps • 1300 x 1030 pixels, 24 bits • Total data rate is over 14 Gbps • http://www.merl.com/projects/3dtv/

19. Technology Requirements • At least Tbps data connections as standard! • At least 100 fold increase in embedded computing power

23. Telepresence in a Hospital Already being used eg • CSIRO’s ViCCU • http://www.ict.csiro.au/page.php?did=16 • InTouch’s RP-7 System • http://www.intouch-health.com/products-RP7.html#virtual

24. Telepresence in a Hospital • In the future, hospitals can be built where all walls are two way lightfields so that a person or an object can be projected in “full” 3D into any room of a hospital and, conversely, any patient can be imaged and viewed in “full” 3D • http://www.camfpd.com/future.htm

25. Examples of the Operational Use of Telepresence in a Hospital • Specialists can attend a “code blue” as well as the crash team • Nursing staff can respond through telepresence to a patient’s “call button” and assess whether have to go physically • A patient can be triaged in an ambulance by a trauma specialist