1 / 10

Enhancing Video Surveillance with Natural Language Interaction

This paper discusses the integration of natural language interaction in video surveillance systems, showcasing how human-like understanding can improve video analysis. Key techniques explored include detection, segmentation, activity recognition, and scene understanding. The authors, Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, and F. Xavier Roca, provide insights into the MIPRCV project, demonstrating applications like video annotation and retrieval, agent tracking, and augmented reality, aimed at enhancing the context and classification of video data.

Télécharger la présentation

Enhancing Video Surveillance with Natural Language Interaction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Exploiting Natural-Language Interaction in Video Surveillance Systems Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15th, 2011

  2. ISE Lab: Research Lab on Image Sequence Evaluation • UNDERSTAND videos withhumans … (oractions in images) • …toEXPLAINthem in theircontext(orclassify, search…)

  3. ISE Lab: some research we do... • Detection • Segmentation • Agent/body/face tracking • Activityrecognition • Sceneunderstanding • Behaviorrecognition • Video annotation/ retrieval • Augmentedreality • NL descriptions human horse

  4. An example: the MIPRCV project 156 : … 203 : Lo vianant surt per la part inferior dreta... 252 : ...

  5. An example: the MIPRCV demonstrator Servolens with integrated Zoom Giga Ethernet cam 3 Dedicated Servers Pan & Tilt Control Terminal Network Infrastructure

  6. PTZ control

  7. Terminal for Active Video Surveillance

  8. Natural Language Understanding

  9. What happened today?

  10. Exploiting Natural-Language Interaction in Video Surveillance Systems Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca http://iselab.cvc.uab.es/

More Related