1 / 3

Innovative Experimentation in Child-Examiner Interaction Using Diverse Imaging Technologies

This preliminary experiment explores the effectiveness of various instrumentation, including two Kinects (overhead and side view), a GoPro for first-person audio/video, a boom microphone, and a consumer video camera, for capturing child-examiner interactions. Activities unfold throughout the room, emphasizing the critical placement of fixed sensors for optimal observation. While Kinects offer a cost-effective solution with RGB and depth sensing, challenges arise from synchronization and video stabilization. High-resolution capture provides optical quality but at a steep price. The study aims to optimize workflows for multi-view analysis.

jensen
Télécharger la présentation

Innovative Experimentation in Child-Examiner Interaction Using Diverse Imaging Technologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Capture: Preliminary Experiment Instrumentation: • 2 Kinects (1 overhead and 1 side view) • 1st person audio/video: GoPro glasses on examiner • Boom microphone (fixed) • Consumer video camera • EDA on child and examiner Observations: • Activities with examiner/child take place across the whole room • Placement of fixed sensors must be studied carefully or activities more controlled • 1st person video • Go Pro $300 price point offers exciting opportunities for in-home use and wide deployment with examiners and families • Challenges with respect to stabilization for viewing/coding • Offers the examiner’s view at any time (both a positive and negative)

  2. Kinect vs. HD Video • Multiple Kinects • Positives: • Inexpensive (~5-10K for system with Kinects, PCs, and 4 Kinects) • Gives RGB + depth • Body pose estimates (in side views) • Negatives: • Overlap between Kinect views yields errors in depth streams • Each Kinect intermittently drops video frames at different times • Capture is asynchronous, which is challenging for multi-view analysis • High-res video capture (using Camera-Link) • Positives: • high-definition, high optical quality • Synchronized at time of capture • Negatives: • Expensive (~$50K for system with capture equip, PC, and 4 cameras) • Does not include depth sensing

  3. Workflow • Where in the workflow does synchronization of streams occur? • What method(s) will be used for synchronization? • Is synchronization needed?

More Related