1 / 35

Augmented Reality

Augmented Reality. MARE : Multi-user Augmented Reality Environment on Real Table Setup Raphael Grasset Jean-Dominique Gascuel iMAGIS, France. iMAGIS is a joint project between CNRS,INRIA,INPG and UJF. Motivations of our Research.

abonita
Télécharger la présentation

Augmented Reality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Augmented Reality MARE : Multi-user Augmented Reality Environment on Real Table Setup Raphael Grasset Jean-Dominique GascueliMAGIS, France iMAGIS is a joint project between CNRS,INRIA,INPG and UJF

  2. Motivations of our Research • Purpose : real collaborative situation (discussion, meeting, project review..). NEED DIRECT 3D Visualization, Interaction.. [Buscher00] • Applications : scientific visualization, architecture, urban planning, game.. • No satisfactory solutions(Desktop Computer, CAVE, Responsive Workbench)

  3. Our Multi-user AREnvironment A collaborative environment for multi-user in augmented reality. [Schmalstieg00], [Fjeld02] Setup : Centralized configuration • Around the table. Not modified environment. • Augmented user. • Private/Public area. shared area Personal area

  4. Goals • Architecture : Hardware/Software. • Calibration / Registration. • Intuitive 3D interaction method. • Visual integration (occlusion, shadow). • Multi-user management (protection, monitoring). • Moto (simplicity, rapidity) / (viability, robustness)

  5. Architecture : Hardware Heterogeneous devices (displays, 3D/2D, two-hand)

  6. Architecture : Hardware • Personal display • Tracking • Interaction devices (Onyx 3, 2 Pipes, SGI)

  7. Architecture : Software • Modular / Multilayer system • XML configuration approach (device, interaction, object). Application Usermanager Objectmanager Devicemanager Interactionmanager OpenGL Performer, AL, VL, Qt X

  8. Architecture : Software Support of various object (3D, 2D, text, picture, music, video, speech synthesis) Text Screen-Stabilized 3D Object Sound Object Animated Objects Picture Text

  9. Calibration of devices • User-based approach : “plug’n calib and play”. Intuitive and simple method. • Optotrak / FOB / Wacom calibration : select points of reference. Fob emitter Pen Calibration : orient pen in specific direction. [Tuceryan95]

  10. Head calibration Fixed view and register specific object. video see-through optical see-through • Maximum error : 1 cm  sufficient for non-critical application • less jitter that magnetic tracker

  11. Goals • Architecture : Hardware/Software. • Calibration / Registration. • Intuitive 3D interaction methods. • Visual integration (occlusion, shadow). • Multi-user management (protection, monitoring). • Moto (simplicity, rapidity) / (viability, robustness)

  12. Interaction moto • Least intrusive device : real pen and hand interaction + TUI. Low haptic feedback : table contact, respect of gravity. virtual tools + personal menu

  13. Tracked pencil real fonction and 6D0F manipulation

  14. Hand tracked device easy wearable/removable gesture and interaction

  15. Tangible User Interface real reality approach. natural object : cup, paper, box. specialized object : marker

  16. Moving Objects 1/2 • Inspired from real methods lift-move method slide method

  17. Moving Objects 2/2 • 3D Tangible UI : select with a real “ghost”

  18. Adding Objects • Add Objects : Virtual/Real • Virtual Objects : menu, catalogue, gesture. • Real Objects : • predefined model : register virtual and real representation. • generic model : fitting with a simple shape

  19. Multiuser management [Gutwin00] Communication/Coordination : like real meeting. Awareness : enhance device, line of sight, visual and sound feedthrough. Personal view : unix access approach + personal scene graph.

  20. Multiuser management [Gutwin00] Communication/Coordination : like real meeting. Awareness : enhance device, line of sight, visual and sound feedthrough. Personal view : unix access approach + personal scene graph.

  21. Multiuser management [Gutwin00] Communication/Coordination : like real meeting. Awareness : enhance device, line of sight, visual and sound feedthrough. Personal view : unix access approach + personal scene graph.

  22. Multiuser management [Gutwin00] Communication/Coordination : like real meeting. Awareness : enhance device, line of sight, visual and sound feedthrough. Personal view : unix access approach + personal scene graph.

  23. Multiuser management • Protection : social + technical protocol • Assistance : Multimedia help + tool tip • Monitoring : Log + Replay

  24. Pre/Post session : Authoring Tools Preparation • hardware setup • scene setup • assistance setup • scenario setup Debriefing • replay • save selected information Meeting XML files Dedicated Graphical User Interfaces

  25. Contributions • Collaborative AR framework • Easy setup, adaptive to object domain. • New interactive techniques • Virtual Reality and CHI approach. Future Works • Gesture Recognition. • TUI : Vision tracking. • Visual Integration : shadow, lighting • Multiuser : coupling, planning. • CHI evaluation

  26. Questions ?

  27. Calibration : Results • Maximum error : 1 cm  sufficient for non-critical application optical see-through video see-through • less jitter that magnetic tracker

  28. How to see that what users see ?

  29. Navigation • Goal : Visualize the scene from different viewpoint. RA (face to face) RV(immersion) ([Kiyokawa99] • Approach : “dim in the scene” (WIM [Stoakley95]). t1 t1 t2 t2 Tree character Working space

  30. Utilisateur Visibilité Déplacement Annotation Défaut Architecte Maurice Clients Joe Robert Personal View : details

  31. Interaction time-multiplexed vs space-multiplexed Personal menus : tools, add objects. Radio Button Push Button Menu slider

  32. S2002 Bookman Old Style, Bold, 37 points This subtitle is 31 points • Bullets are orange; text is 26 points • They have 110% line spacing, 6 points before/after • Longer bullets in the form of a paragraph are harder to read if there is insufficient line spacing. This is the maximum recommended number of lines per slide (seven). • Sub-bullets look like this.

  33. Virtual Reality (VR) Real (R) Simulation, Animationcomplex computationpersistent information Natural metaphor of communicationintuitive 3D interaction Motivations Augmented Reality (RA) Integrate R+V

  34. Calibration : Results • Maximum error : 1 cm  sufficient for non-critical application • less jitter that magnetic tracker

More Related