Download
slide1 n.
Skip this Video
Loading SlideShow in 5 Seconds..
Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes. PowerPoint Presentation
Download Presentation
Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes.

Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes.

186 Vues Download Presentation
Télécharger la présentation

Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes.

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. AnEffectiveDynamicGestureRecognitionSystem Based on the Feature Vector Reduction for SURF and LCS Pablo Barros, Nestor júnior, Juvenal bisneto, bruno Fernandes, Byron bezerra, Sérgio Fernandes. Escola politécnica de Pernambuco - Universidade de Pernambuco - Brasil

  2. RPPDI Dynamic Gesture Recognition Database • Dynamic Gesture • Frame Sequences • Represent one Gesture • http://rppdi.ecomp.poli.br/gesture/database/

  3. Dynamic Gesture Recognition System • System Architecture • FeatureExtraction Module • Classification Module

  4. Extraction Module • Local Contour Sequence – LCS [1] • SpeedUptRobustFeatures – SURF [2] • Convexity Approach • CLCS • CSURF

  5. Local Contour Sequence - LCS • Algorithm • Identify Hand Shape • Image Segmentation • Contour Detection • Calculate Feature Vector

  6. LCS – Segmentation • Segmentation • OTSU [3]

  7. ContourIdentification • Hand Contour Identification

  8. LCS - Local ContourSequence • Feature Vector Calculation • Findthe top first point oftheimage • Orderthe points in clockwise. • Calculatedistanceof a lineformedbytwo points , ℎ[𝑖−(𝑤−1)⁄2] andℎ[𝑖−(𝑤+1)⁄2] , and h[i].

  9. SpeedUpRobustFeatures - SURF • Integral Image • FindInterest Points • DescribeInterest Points • Intensity • Direction • Descriptors

  10. Convexity Approach • Minimize thehandshape • Douglas-PeuckerAlgorithm • Applyconvexhull • SklankysAlgorithm • Calculate points distances

  11. Convexity Approach • Douglas PeuckerAlgorithm • Selectthetwomost distant points. • Verifyifthereisvertexnearthan a distance T, ifthereis, remove it. • Recursively do it againwithallthe points.

  12. Convexity Approach • Sklanky´sAlgorithm • Find a convexvertex. • Renametheothervertex in clockwise, startingwith p0. • If p0, p1 and p2 turnright: • Put p0 afterp2. • Update p0, p1 and p2. • Else: • Put p1 before p0. • Remove p1. • Update p0, p1 and p2. • Repeatuntil p0 is theinitialvertexand p0, p1 and p2 turnsright. • For eachpairof points draw a lineandfindthemostdistant point.

  13. Convexity Local ContourSequence • Calculatedistance • Adaptationof LCS • Use thetwoexternal points todrawtheline. • Use theinner point tocalculatedistance. • (a) LCS. (b) SuRFinterest points. (c) CLCS. (d) CSURF

  14. Classification Module • ElmanRecurrent Neural Network • HiddenMarkovModel • Dynamic Time Warping

  15. Results • Convexity Approach • Methodology • Run 30 times • Validation (1/3 for testand 2/3 for training)

  16. Referências • [1] Meena, S. 2011. A Study on Hand Gesture Recognition Technique. Master’s thesis, National Institute Of Technology, Rourkela,India • [2] Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (Jun 2008),http://dx.doi.org/10.1016/j.cviu.2007.09.014 • [3] Bao, J.; Song, A.; Guo, Y.; and Tang, H. 2011. Dynamic hand gesture recognition based on surf tracking. In Electric Information and Control Engineering (ICEICE), 2011 International Conference on, 338 –341. • [4] N. Otsu. A threshold selection method from gray-level histograms. Systems, Man and Cybernetics, IEEE Transactions on, 9(1):62 –66, jan. 1979.