1 / 16

Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes.

An Effective Dynamic Gesture Recognition System Based on the Feature Vector Reduction for SURF and LCS. Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes. Escola politécnica de Pernambuco - Universidade de Pernambuco - Brasil.

lorne
Télécharger la présentation

Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AnEffectiveDynamicGestureRecognitionSystem Based on the Feature Vector Reduction for SURF and LCS Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes. Escola politécnica de Pernambuco - Universidade de Pernambuco - Brasil

  2. RPPDI Dynamic Gesture Recognition Database • Dynamic Gesture • Frame Sequences • Represent one Gesture • http://rppdi.ecomp.poli.br/gesture/database/

  3. Dynamic Gesture Recognition System • System Architecture • FeatureExtraction Module • Classification Module

  4. Extraction Module • Local Contour Sequence – LCS [1] • SpeedUptRobustFeatures – SURF [2] • Convexity Approach • CLCS • CSURF

  5. Local Contour Sequence - LCS • Algorithm • Identify Hand Shape • Image Segmentation • Contour Detection • Calculate Feature Vector

  6. LCS – Segmentation • Segmentation • OTSU [3]

  7. ContourIdentification • Hand Contour Identification

  8. LCS - Local ContourSequence • Feature Vector Calculation • Findthe top first point oftheimage • Orderthe points in clockwise. • Calculatedistanceof a lineformedbytwo points , ℎ[𝑖−(𝑤−1)⁄2] andℎ[𝑖−(𝑤+1)⁄2] , and h[i].

  9. SpeedUpRobustFeatures - SURF • Integral Image • FindInterest Points • DescribeInterest Points • Intensity • Direction • Descriptors

  10. Convexity Approach • Minimize thehandshape • Douglas-PeuckerAlgorithm • Applyconvexhull • SklankysAlgorithm • Calculate points distances

  11. Convexity Approach • Douglas PeuckerAlgorithm • Selectthetwomost distant points. • Verifyifthereisvertexnearthan a distance T, ifthereis, remove it. • Recursively do it againwithallthe points.

  12. Convexity Approach • Sklanky´sAlgorithm • Find a convexvertex. • Renametheothervertex in clockwise, startingwith p0. • If p0, p1 and p2 turnright: • Put p0 afterp2. • Update p0, p1 and p2. • Else: • Put p1 before p0. • Remove p1. • Update p0, p1 and p2. • Repeatuntil p0 is theinitialvertexand p0, p1 and p2 turnsright. • For eachpairof points draw a lineandfindthemostdistant point.

  13. Convexity Local ContourSequence • Calculatedistance • Adaptationof LCS • Use thetwoexternal points todrawtheline. • Use theinner point tocalculatedistance. • (a) LCS. (b) SuRFinterest points. (c) CLCS. (d) CSURF

  14. Classification Module • ElmanRecurrent Neural Network • HiddenMarkovModel • Dynamic Time Warping

  15. Results • Convexity Approach • Methodology • Run 30 times • Validation (1/3 for testand 2/3 for training)

  16. Referências • [1] Meena, S. 2011. A Study on Hand Gesture Recognition Technique. Master’s thesis, National Institute Of Technology, Rourkela,India • [2] Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (Jun 2008),http://dx.doi.org/10.1016/j.cviu.2007.09.014 • [3] Bao, J.; Song, A.; Guo, Y.; and Tang, H. 2011. Dynamic hand gesture recognition based on surf tracking. In Electric Information and Control Engineering (ICEICE), 2011 International Conference on, 338 –341. • [4] N. Otsu. A threshold selection method from gray-level histograms. Systems, Man and Cybernetics, IEEE Transactions on, 9(1):62 –66, jan. 1979.

More Related