1 / 38

人 脸对齐技术

人 脸对齐技术. xueminzhao@tencent.com 4/3/2014. detect => align => represent => classify 9-layer deep NN 120 million parameters 4 million images, 4000 identities 97.25%. 大纲. 什么是人脸对齐？ 人 脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效 ( 比如 ” 换脸 ” 、 Morphing) 等 人 脸对齐技术及其数学原理

jarrod-eaton
Télécharger la présentation

人 脸对齐技术

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 人脸对齐技术 xueminzhao@tencent.com 4/3/2014

  2. detect => align => represent => classify 9-layer deep NN 120 million parameters 4 million images, 4000 identities 97.25%

  3. 大纲 • 什么是人脸对齐？ • 人脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效(比如”换脸”、Morphing)等 • 人脸对齐技术及其数学原理 - Active Contour Models (Snakes) - Active Shape Models - Active Appearance Models (2D、3D…)

  4. 大纲 • 什么是人脸对齐？ • 人脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效(比如”换脸”、Morphing)等 • 人脸对齐技术及其数学原理 - Active Contour Models (Snakes) - Active Shape Models - Active Appearance Models (2D、3D…)

  5. 人脸检测 (Face Detection)

  6. 人脸识别 (Face Recognition)

  7. 人脸对齐 (Face Alignment)

  8. 图像配准 (Registration)

  9. 大纲 • 什么是人脸对齐？ • 人脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效(比如”换脸”、Morphing)等 • 人脸对齐技术及其数学原理 - Active Contour Models (Snakes) - Active Shape Models - Active Appearance Models (2D、3D…)

  10. 人脸对齐的应用 • 具体见Demos

  11. 大纲 • 什么是人脸对齐？ • 人脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效(比如”换脸”、Morphing)等 • 人脸对齐技术及其数学原理 - Active Contour Models (Snakes) - Active Shape Models - Active Appearance Models (2D、3D…)

  12. Photoshop “套圈”

  13. ACM (Snakes)

  14. Internal Energy

  15. Image Forces

  16. Image Forces (cont.)

  17. Image Forces (cont.)

  18. ACM (Snakes) • 对形状没有太多约束； • 没有使用纹理信息。 • 人脸形状大致固定； • 人脸器官以及人脸形状边缘有明显的纹理变化。

  19. ASM Applications

  20. Shape Training

  21. Labeling the Training Set

  22. Alignment

  23. Alignment (cont.)

  24. Aligned Shape Statistics

  25. Face Examples

  26. ASM Algorithm

  27. Adjusting Model Points

  28. Examples

  29. ASM • 有2D形状模型； • 少量的纹理信息。 • 怎样使用整个人脸区域内部的纹理？

  30. PCA Building Active Appearance Models Warped PCA RI, CMU

  31. Model Instantiation

  32. Active Appearance Models

  33. AAM (2D) • 有2D形状模型； • 使用了整个人脸区域的纹理信息。 • 3D人脸形状成像时有约束。

  34. 3D Morphable Models

  35. AnExample

  36. Fitting with 3D Shape Constraints AAM K→ +∞ Parameters: 3D Shape Constraints

  37. 小结 • 什么是人脸对齐？ • 人脸对齐的应用 - 人脸识别、表情识别、人脸动画、人脸姿态估计、视线跟踪、嘴唇跟踪、 人脸高分辨率重建、疲劳检测、人机交互、特效(比如”换脸”、Morphing)等 • 人脸对齐技术及其数学原理 - Active Contour Models (Snakes) - Active Shape Models - Active Appearance Models (2D、3D…)

  38. Thank You!

More Related