170 likes | 269 Vues
Feasibility study on ADHD indicators modeling through Dynamic Time Warping from RGB data, focusing on inattention, hyperactivity, and impulsivity in children aged 8-11. The methodology includes data acquisition via Microsoft's Kinect, feature extraction of human pose, and gesture detection using DTW algorithm. Results and conclusions drawn from gesture segmentation and recognition support the feasibility of the approach. Future work involves automatic calibration and feature weighting.
E N D
ADHD indicatorsmodellingbasedonDynamic Time Warpingfrom RGB data: A feasibilitystudy Antonio Hernández-Vela, Miguel Reyes, Laura Igual, Josep Moya, Verónica Violant, and Sergio Escalera
ADHD: Attentiondeficithyperactivitydisorder Inattention Hyperactivity Impulsivity
Outline • Introduction • Methodology • Results • Conclusion
Introduction • Video-based behavior analysis for ADHD diagnosis in children between 8-11 years.
Introduction • Behavior analysis Human pose information along time Inattention Head Body Hands time Hyperactivity Gestures Impulsivity 2. Featureextraction: Human Pose 1. Data acquisition 3. Gesturedetection
Outline • Introduction • Methodology • Data acquisition • Featureextraction • Gesturedetection • Results • Conclusion
Data aqcuisition • Microsoft’s Kinect • Invariant to color, texture and lighting conditions • Human pose directly obtained • RGB + Depth
Featureextraction: Human Pose • Body skeleton • 42-dimensional vector: 14 joints × 3 spatial dimensions • RGB + Depth
Gesturedetection • Dynamic Time Warping (DTW)
Thresholdcomputing • G11 Different samples • Leave-one-outsimilarity measure between different samples and gestures Differentgestures
Outline • Introduction • Methodology • Results • Conclusion
Outline • Introduction • Methodology • Results • Conclusion
Outline • Introduction • Methodology • Results • Conclusion
Conclusion • Methodologyforgesturesegmentation and recognition at thesame time. • Firstresultsindicatetheobjectives are feasible. • Futurework: • Automaticcallibration • Featureweighting (bodyjoints)
ThankYou! ADHD indicatorsmodellingbasedonDynamic Time Warpingfrom RGB data: A feasibilitystudy Antonio Hernández-Vela, Miguel Reyes, Laura Igual, Josep Moya, Verónica Violant, and Sergio Escalera Questions?