1 / 17

A Distributed Framework for Collaborative Annotation of Streams

This paper presents a comprehensive framework for collaborative annotation of multimedia streams designed to support distributed users. Existing collaboration and annotation systems are analyzed, revealing limitations in their asynchronous communication capabilities and data type compatibility. Our framework enables annotation on live and pre-recorded streams, thus accommodating a variety of data formats. Key features include flexible architecture, session management, and support for handheld devices. Preliminary tests indicate effective performance under stress. Future work will expand stream types and address security in annotation distribution.

natane
Télécharger la présentation

A Distributed Framework for Collaborative Annotation of Streams

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Distributed Framework for Collaborative Annotation of Streams Tao Huang, ShrideepPallickara, Geoffrey Fox Community Grids Lab Indiana University, Bloomington {taohuang, spallick, gcf}@indiana.edu

  2. Outline • Analysis of existing Collaboration and Annotation Systems • System Objectives • System Design and Implementation • Experiment Results • Future Work and Conclusion

  3. Collaboration Systems • Multimedia based collaboration • Industry • Academic • Digital document based collaboration

  4. Annotation Systems • Microsoft: MRAS • Asynchronous Q/A on lecture videos • IBM : VideoAnnEx • Mpeg-7 based annotation • Support distributed annotation • University of Queensland : Vannotea • Similar to VideoAnnEx with more flexibility on annotation metadata • Indiana University CGL: eSports • Extend annotation forms from texts to images and video clips • Aimed at distance coaching

  5. Limitations of existing systems • MRAS and VideoAnnEx • Asynchronous communication and searching in annotation • Vannotea and eSports • Annotation on real time video streams in distributed environments • None of them supports annotation on other types of data streams

  6. Objectives • Support annotation on live or prerecorded data streams regardless their types • Relatively tolerant to possible failures • Support saving, sharing and searching annotations among distributed users • Easy to extend

  7. System Architecture • Distributed annotation clients over the NaradaBrokering Network. • Session management with two recovery strategies • Distributed stream archiving and replaying • Easy to add support to handheld and streaming clients

  8. Decoupled Functions in Layers • Presentation layer • GUI, Stream Source/Renderer Managers • The Logic layer • Stream manager manages all active senders and receivers • Annotation manager associates and synchronizes content streams with annotation streams. • The Transmission • Creating and managing actual data transmission

  9. Stream Processing Interfaces • Define the generic behaviors of real time data streams • Start, Stop, Pause and so on • Existing Stream Sources/Renderers • Audio/Video • Screen capture • File capture • Easy to write own source/renderer pairs

  10. Annotation management • Annotation and Stream data are stored in remote storage • Annotation metadata is stored in plain XML files • Only Time an Layout information are stored currently • Local Annotation metadata will be synchronized with remote storage before being used to replay

  11. Center Annotation Panel Stream List Panel Client List Stream Progress Panel Client Interface

  12. Preliminary Test 1

  13. Preliminary Test 2

  14. Conclusion • Woks well with data streams of small payloads(<2KB) under high stress circumstances • Delays are under a reasonable level, whichwill not cause any synchronization problems

  15. Summary • Support collaborative annotation on multimedia streams in Sync/Async way • Stream Processing Interfaces make it easy to extend current system

  16. Future Work • Add more types of stream sources/renderers • Research on security issues in annotation distribution • Standardize annotation metadata format into Mpeg-7 • A user friendly Web 2.0 portal to access/manage annotation and stream data

  17. Questions? Thanks

More Related