1 / 14

Outline

VIRTUE – VIRtual Team User Environments Oliver Schreer Heinrich-Hertz-Institute , Berlin Germany. Outline. The challenge of VIRTUE The VIRTUE station The VIRTUE architecture The developed hardware Conclusion. The challenge of VIRTUE. Remote Conferees

pakuna
Télécharger la présentation

Outline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. VIRTUE – VIRtual Team User EnvironmentsOliver SchreerHeinrich-Hertz-Institute, Berlin Germany

  2. Outline • The challenge of VIRTUE • The VIRTUE station • The VIRTUE architecture • The developed hardware • Conclusion

  3. The challenge of VIRTUE • Remote Conferees • represented by full-body sized 3D video images • as natural as possible (no avatars please !!) • Conference Situation • exact reproduction of eye contact, gaze, gestures and body language • realistic viewing conditions by support of head motion parallax • Local Conferees • sitting in front of large immersive mono- or stereoscopic displays • such that they feel immersed in shared virtual environment

  4. The VIRTUE terminal one year ago Current State of the VIRTUE Station(e.g.: 50’’ plasma display) Terminal Design(e.g.: 80’’ rear projection)

  5. Metal framework for mounting cameras and speakers 4 Pulnix Colour Progressive Scan Cameras 61” Plasma display Audio Speakers Access to 3 compartments at the rear of the terminal for PCs and other hardware Semi-circular table The current state

  6. VIRTUE – 2D Demonstrator at IST Event 2001 See video clips at http://bs.hhi.de/SPAG/SPAG-IST_Event2001.htm

  7. VIRTUE Architecture

  8. 4 x 32 Mbyte SDRAM TriMedia TM1300, 143 MHz 4 x VideoIn/VideoOutCCIR601/656 compliantconnecting the interface board Connection to PCI of host PCvia PCI bridge VPS Board (Virtue Processor Station) Internal PCI busconnecting all TriMedia’s

  9. Router FPGA for flexible VideoIn/VideoOut connections 4 x SDI In 4 x SDI Out 4 x LVDS In/Out 4 x VideoIn/VideoOutCCIR601/656 compliantconnecting the VPS board SDI/LVDS Interface (SMPTE 259M)

  10. Using Multimedia and SIMD capabilities of the TriMedia Arbitrary VideoIn/VideoOut with interface board Flexible: C++ code can be used, modified and upgraded directly Modular: Multiple boards can be plugged in 32 bit/64 bit slots Based on standard PCI technology Complete VPS package

  11. The MPEG-2 Low Delay Coder • MPEG-2 Encoder: • 4:2:0 transport stream • Encoding latency < 80ms • Image size 640x480/25 fps • Bitrate 2 Mbit/s • MPEG-2 Decoder: • Decoding latency < 80ms • VIRTUE camera link output • MPEG-2 PCI Base Board: • 66 MHz/64 Bit universal PCI card • 4 MPEG-2 Encoder modules • 4 MPEG-2 Decoder modules • VIRTUE camera link output

  12. Conclusions and Outlook • Real-time hardware fullfilling the demands • Video streaming without loading the host PCI bus • Completely PCI based • Flexible in terms of software update, modification and extension • Successful 2D demonstrator presented at IST event 2001 • Complete 3D video conferencing system in September 2002 • MPEG2 encoding, transmission, 3D analysis, view synthesis, rendering, audio, document sharing • Final human factors test in October 2002

  13. Announcement Workshop on „Immersive Communication and Broadcast Systems“ 29.-30. January 2003 Heinrich-Hertz-Institut (HHI), Berlin, Germany http://bs.hhi.de/ICOB-Workshop Kontakt: Oliver Schreer, schreer@hhi.de

  14. ..... thank you for your attention END

More Related