20 likes | 196 Vues
Left Image. Marker Segmentation. 3D Kalman Filter. Application. 2D Kalman Filter. Vector Quantizer. Right Image. 3D Reconstruction. Gesture Spotter. Hand Gesture Based User Interface For Generic Windows Applications. Computer Interface
E N D
Left Image MarkerSegmentation 3D Kalman Filter Application 2D Kalman Filter Vector Quantizer Right Image 3D Reconstruction Gesture Spotter Hand Gesture Based User InterfaceFor Generic Windows Applications • Computer Interface • A 2D/3D input device based on real time hand tracking • Translation of gestures to Windows commands • More natural interface for 3D design applications • Aid for disabled and deaf people • Sign language analysis, translation • Sign language teaching • Using multimodality to enable communication between disabled people • Entertainment • Applications involving hand gesture recognition, from computer games to sound and image design applications Capabilities • Camera calibration and gesture training tools • Registration of new markers through the interface • Recognition of 2D and 3D gestures in real time, modeled with HMMs • Real time 2D and 3D Kalman filtering of the trajectories • Support for two hands wearing different colored gloves • Real time mouse simulation based on hand tracking • Capability of triggering windows input device events – controlling third party applications • Generic interface that can be linked to any application through configuration
Requirements Hand Gesture Interface is specifically designed to not require any special hardware Hardware Requirements • Smooth colored hand glove as the marker • Simple WDM or VFW based camera(s) • Good lighting conditions • Mainboard should be able to handle two cameras for the 3D mode Software Requirements • Windows Operating System (Tested on XP and Me) Execution • The user registers the marker by waving the hand to the camera(s) • The user trains the system any 2D or 3D gesture (2D uses only x-y) • The user modifies or replaces the configuration file to link it to any application and mouse or keyboard events • The user starts controlling the interface Remarks • Gestures are only recognized when the hand is held vertically • Keeping the hand horizontal simulates the left click of the mouse • The ends of a gesture are automatically found by the system. • The system comes with 8 pre-trained gestures, which can be changed anytime • The system comes with a pair of calibration matrices, which should work with most camera setups. If they don’t, the calibration tool needs to be used