SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS

psyche avatar
psyche
9 diapositives · 26.2K Views · Jul 26, 2014

HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS. Mentor Prof. Amitabha Mukerjee Deepak Pathak 10222 deepakp@ Kaustubh Tapi 10346 ktapi @. PROBLEM OVERVIEW. Objective is to classify human actions from the video dataset.

#human action classification using 3-d convolutional neural networks #human action classification using 3-d convolutional neural networks ppt #powerpoint #presentation
HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS - slide 1
01 / 9HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS
1 / 17

Télécharger la présentation

HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. HUMAN ACTION CLASSIFICATION USING 3-D CONVOLUTIONAL NEURAL NETWORKS Mentor Prof. AmitabhaMukerjee Deepak Pathak 10222 deepakp@KaustubhTapi 10346 ktapi@

  2. PROBLEM OVERVIEW Objective is to classify human actions from the video dataset. • Motivation:Current methods are highly image processing based and highly problem dependent.We’ll use 3-D Convolutional Neural networks which extracts and learns the features to classify different set of actions. • Implemented on Weizmann Dataset of human actions which is classified into 10 actions. [CREDIT: WEIZMANN DATASET]

  3. INPUT PATTERN • Firstly we break each video into its constituent frames and apply bounding box on each frame to reduce input dimension size. • Dataset of 226 videos (10 classifications) was divided into training(181 videos) and testing part(45 videos). • A subsequence of 13(64X48X13) consecutive frames with 12 frames overlap is given as input to 3-D Convolutional Neural Networks. • Till now we have tested on silhouette frames of videos.

  4. ALGORITHM OVERVIEW CREDIT: “Sequential Deep Learning for Human Action Recognition” Paper by: Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., Baskurt, A. [2011] • For training the neural network , inputs from training set are forward propagated till the last layer[FORWARD PROPAGATION]. • Our 3-D Convolutional Neural Network undergoes supervised training.

  5. ALGORITHM OVERVIEW • Error is computed in last layer and then propagated backwards to all previous layers.(BACKPROPAGATION). • Weight updation in layers depends on eta(learning rate). • Weights will converge after a number of epochs. (Hessian Back-propagation used to reduce number of epochs) • Learned feature maps seem to capture visually relevant information (person/background segmentation, limbs involved during the action, edge information. . . ) • Same learning algorithm used for entire 3-D Convolutional Neural Networks

  6. STEPS INVOLVED Input Video Silhouette Frames Convolved feature maps Sub-sampled feature maps (with bias) Recurrent Neural Network Output layer (10 classifications)

  7. IMPLEMENTATION • We obtained code for 2-D Convolutional Neural Network for MNIST digit recognition(C++ Implementation) ) by Mike O’ Neill [3] • We modified the code to construct 3-D Convolutional Neural Network for Human action recognition on WEIZMANN DATASET. • Our code can be implemented from command line and number of nodes, layers and kernels can be modified easily.

  8. RESULTS • Accuracy of 88%-90% was obtained on WEIZMANN DATASET(181 videos for training and 45 videos for testing) after a training of 8 epochs.

  9. REFERENCES • [1] Baccouche M., Mamalet F., Wolf C., Garcia C., Baskurt A. : “Sequential Deep Learning for Human Action Recognition” . In: Salah, A.A., Lepri, B. (eds.) HBU 2011. LNCS, vol. 7065, pp. 29–39. Springer, Heidelberg [2011]. • [2] Weizmann Dataset (std.). • [3] Code for 2-D Convolutional Neural Network for MNIST digit recognition(C++ Implementation) by Mike O’ Neill presented in paper by- Patrice Y. Simard, Dave Steinkraus, John Platt, "Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis," International Conference on Document Analysis and Recognition (ICDAR), IEEE Computer Society, Los Alamitos, pp. 958-962 [2003].