110 likes | 231 Vues
This comprehensive design review outlines our gesture recognition project aimed at improving understanding and detection of American Sign Language (ASL) gestures. The project addresses the lack of data by participating in the CHALEARN Gesture Challenge, focusing on novel hand gestures for applications like man-machine communication. The team consists of experts in computer science and electrical engineering, working on software integration, database development, and hardware implementation. The presentation covers the project's objectives, progress timeline, and upcoming milestones, along with a demonstration using a Kinect environment.
E N D
ASLLENGE Comprehensive Design Review Feb 16 2012 He Zhou HuiZheng William Mai Xiang Guo Advisor: Professor Patrick Kelly
Outline • Introduction • Timeline/Progress • Future Work • FPR Goals • Demonstration • Q/A
Introduction Project Objective: Gesture Recognition Unfamiliarity with ASL (lack of data) Wide Implications CHALEARN Gesture Challenge (By Kaggle) Design changes New Record Function Hierarchical Search Pattern marching
CHALEARN Gesture Challenge By Kaggle • “The challenge focuses on hand gestures. Applications include man-machine communication, translating sign languages for the deaf, video surveillance, and computer gaming” • “learning to recognize new categories of gestures from a single video clip of each gesture.”
Team Roles • He Zhou(CSE): test and integrate software prototype • HuiZheng(CSE): database development and programming • William Mai (EE): build microcontroller to detect finger and palm movements • Xiang (EE): build Arduino board, overall testing, building ASL database, and website administration 5
Kinect Environment For Integration Afterward • Two Hand tracking (able to tell left hand from right hand) • Grid Size change according to body size • More refined Grid recognition
To Do • Complete Database and Database Interface • Complete Finger Tracking Module • Refine Kinect Environment • Integration
Q&A 11