Virtual Reality Trend for Digital Animation and Global Success Cases

1. Virtual Reality Trend for Digital Animation and Global Success Cases Jim X. Chen, Ph.D. Director of Computer Graphics Lab George Mason University Fairfax, VA 22030

2. Contents • Introduction to Virtual Reality and Hardware • Virtual Reality Current Trend • Virtual Reality Software and Digital Animation Systems • VR Research, Applications and Global Successful Cases http://graphics.gmu.edu

3. Computer World Intro to VR & Hardware Conventional Computer VR-based Computer Computer World http://graphics.gmu.edu

4. Virtual Reality VR technologies Character CRT Keyboard Computer graphics Graphic CRT Mouse tablet Realtime CG Virtual console 3D mouse Computer simulation/ visualization Video arts Virtual products design Tele-conference Tele-Existence 3D CAD TV phone Tele-Operation Computer Aided Design Telephone All technologies meet together at VR !! http://graphics.gmu.edu

5. A sense of of immersion • Stereoscopic • Tracking • Tactile & haptic • Acoustic, etc. http://graphics.gmu.edu

6. 3D Graphics and Stereoscopes • 3D graphics • User controlled movement and view • Objects may respond to actions and environment • Stereoscopes • 3D graphics • 2 projections http://graphics.gmu.edu

7. Crystal Eyes (http://www.stereographics.com/)

8. Head Mounted Displays (http://www.fakespace.com/) (http://www.stereo3d.com/)

9. Tracking Systems(http://www.polhemus.com/)(http://www.ascension-tech.com)

10. ImmersaDesk (http://www.fakespace.com/)

11. CAVE(http://www.fakespace.com/) (http://evlweb.eecs.uic.edu/pape/CAVE/)

12. RAVE (http://www.fakespace.com/)

13. Immersive Work Wall

14. VisionDome Alternate Realities Corporation http://www.virtual-reality.com/index.html http://www.avrrc.lboro.ac.uk/Visiondome_facility.html

15. Tactile and Haptic Devices PHANToM (http://www.sensable.com) http://graphics.gmu.edu

16. Cyberglove (http://www.virtex.com)

17. Immersion Corp: Impulse Engines (2D and 4D [pinch]) http://graphics.gmu.edu

18. Sarcos Dextrous Master http://graphics.gmu.edu

19. REFLEX • FREFLEX is a 7 joints articulation systems that mimics human motion • Is an exosqueleton system allowing real-time control of robots • Update rate of 130Hz http://graphics.gmu.edu

20. Exoskeleton (Iowa State U.) • An other exoskeleton system developed at Iowa State University • Based on electromagnetic coupling http://graphics.gmu.edu

21. CyberGrasp http://graphics.gmu.edu

22. 3 DoF Force Feedback Joystick http://graphics.gmu.edu

23. CyberTouch http://graphics.gmu.edu

24. TouchMaster • TouchMaster is a vibro-tactile transducer commercialized by EXOS • Use 6 to 10 speakers coils • An vibrate at a frequency of 210 Hz http://graphics.gmu.edu

25. Virtual Reality - Immersion • Key to the VR field is “immersion”. • A VR environment is immersive if it gives the user the feeling of being inside a scene, rather than simply looking at the scene. • True VR is nonexistent, but we do what we can: • Create a scene that is viewed by the user as if they are in it. • Allow the user to interact with objects in the scene in something approximating a “natural” way. • Bring in as many senses as we can: • Sight & sound are the main ones we deal with. • Lots of research is begin done on touch (haptic interfaces). • Taste & smell: forget it, for now. http://graphics.gmu.edu

26. Virtual / Synthetic Environments Tele-presence Presence Cyberspace Immersion Simulator / Motion Sickness Lag time 3D rendering / Graphics Engine VRML Bodysuit Head Mounted Display (HMD) 3D Mouse Joystick Stereoscopic Display Liquid Crystal Shutterglasses Ultrasonic / Magnetic / Optical Tracking Cyber / Power / Data Glove Haptic Display Position Tracking VR Terminology http://graphics.gmu.edu

27. Window on World (WoW), Desktop Immersive Telepresence Mixed Reality(head up displays) Fishtank VR Entry level VR Basic VR Advanced VR Projected VR (maybe with shutterglasses) Cockpit Simulators Types of VR http://graphics.gmu.edu

28. Output Devices • Visual • Computer Screen, Head Mounted Display, 3D Shutter Glasses, Cyberscope, ImmersaDesk, CAVE, Spherical Projection, Big Screen Technology, Visiondome, Reality Centre. • Audio (Stereo) • Speakers, Earphones, Speech, Music • Tactile • Tactile Gloves • Motion • eg. Flight Simulators using pneumatic motion simulators http://graphics.gmu.edu

29. DataGlove and Bodysuit Mouse, Joystick, Keyboard, 3D Mouse Movement Trackers (eg Polhemus) Gesture Recognition (with DataGlove) Speech Recognition Input Devices http://graphics.gmu.edu

30. Virtual Reality: Current Trend • PC-driven VR system (www.quantum3d.com) • multi-channel synchronized PC-IG • Networked virtual environments with avatars (www.activeworlds.com) • Web3D immersive systems (http://www.web3d.org) • Image-based/Quicktime VR http://graphics.gmu.edu

31. Digital Communication and Animation: Active Worlds (AW) • Universe, populated by Worlds • Universe server: • universe.activeworlds.com • World servers: • anywhere on the Internet • Enter the Universe • Select and enter a world in that Universe http://graphics.gmu.edu

32. The background image The horizontal 0 level surface of the world The virtual reality of AW Getting into a world in the universe …. http://graphics.gmu.edu

33. The virtual reality of AW … later there was: • an avatar • virtual embodiment of person in AW • building blocks (objects) • the building material in AW • the blocks are active - they can respond with some action, or provide additional information. http://graphics.gmu.edu

34. The window to an AW universe/world 3D area Web area Multifunction area Synchronous communication area http://graphics.gmu.edu

35. What is Web3D? • The term Web3d describes any programming or descriptive language that can be used to deliver interactive 3D objects and worlds across the internet. • Virtual Reality Modeling Language (VRML), Java3D and X3D (under development) - also any proprietary languages that have been developed for the same purpose come under the umbrella of Web3d. • http://www.web3d.org : web3d consortuim http://graphics.gmu.edu

36. 3D for the Web • Exploring web-based 3D environments requires the use of a Plug-in • Formats/architectures include: • The Virtual Reality Modelling Language (VRML): viewers include Blaxxun Contact, Cosmo Player and Cortona • X3D • Superscape e-Visualizer and Viscape • Cult 3D • Biovirtual 3DMeNow • Active Worlds • Shout3D • Shockwave 3D http://graphics.gmu.edu

37. History of Web3D http://graphics.gmu.edu

38. Java3D - Class http://graphics.gmu.edu

39. Web3D games • http://www.dave2n.com/ • http://www.dccard.co.jp/ • http://www.activeworlds.com http://graphics.gmu.edu

40. Image-based Virtual Reality • VR system using Image-based Rendering • Presence + Interaction + Autonomy http://graphics.gmu.edu

41. Image-based Virtual Reality • Characteristics of Images • Fixed scene geometry • Fixed camera movement • Fixed light condition • Limitation on image resolution http://graphics.gmu.edu

42. Image-based Virtual Reality • QuickTimeVR was introduced in 1994 • photorealistic virtual reality type effectswith limited interaction • Applications : Museum, Gallery, Sightseeing, Model House, Cyber Shopping Mall http://graphics.gmu.edu

43. Virtual Reality Software and Digital Animation Systems • Low-level graphics libraries • Visualization • Modeling and Rendering • Animation and Simulation • VR Software/Web3D: inventor, VRML, X3D, WTK, WUP, etc. http://graphics.gmu.edu

44. Virtual Reality Software and Digital Animation Systems • Book: Guide to Graphics Software Tools: http://cs.gmu.edu/~jchen/graphics • A shortcut to graphics programming: shortest textbook that covers all • A list of all graphics related tools, including Web3D and Virtual Reality • Rich online sources to all different tools http://graphics.gmu.edu

45. VR Research, Applications and Global Successful Cases Education/ Training Design Engineering Entertainment Museum Arts VR application Medicine Scientific Visualization Communication Products Engineering http://graphics.gmu.edu

46. VR Research • Better, Faster VR with less side-effects. • The long-term effects of VR. • Applications of VR (eg for assessment of brain damage and rehabilitation) • New VR machinery. • VR (and 3D) as the interface to a process. • Presence (what is it and how do we measure it) http://graphics.gmu.edu

47. VR Research • Problems • VR still costly for good system • Still seen as “research” by most companies • Gap between promise and delivery • Applications • Demonstrating products, Sales, Design, Manufacturing, 3D modelling, Walk through, Visualisation, Training, Process control... http://graphics.gmu.edu

48. Industry • A couple of companies using VR • VOLVO • to test car interior designs and to demonstrate new cars on virtual roads. • Combined VR and real car cockpit, gives tactile, visual and audible information. • Nokia • VR + PHANToM, to test new and potential telephone designs. • British Telecom • For visualisation of extremely complex telephone network in England and isolation of faults using 3D visual cues. http://graphics.gmu.edu

49. Cockpit Simulation (flight simulators) Complex Machinery - manipulate parts and see into difficult areas with on-line help In dangerous Situations, eg. Nuclear Reactor - quick in and out, get used to the layout before entering for real toreduce the chance for human error. With Complex Procedures,eg. Surgical Operations, can practice onvirtual patients first, or have the patientscanned and made into a virtual model - complete with force feedback on the surgical instruments. Patient teachers of real-world situations Safer and Cheaper environment, no lives at risk. People with special needs Training / Education http://graphics.gmu.edu

50. (Augmented) Telepresence • VR overlaid onto real-world with see-through HMD. • eg: Heads-up display in fighter plane • eg: Surgeon operating on a patient with overlays from CAT scans to highlight critical nerves, tendons etc. http://graphics.gmu.edu