1 / 10

Advanced Gibbs Sampling for Stacked RBMs and Parallel Updates in Deep Learning

In this lecture, Dr. Geoffrey Hinton discusses advanced techniques for Gibbs sampling in Stacked Restricted Boltzmann Machines (RBMs). Focusing on hierarchical architectures, he illustrates how to perform updates on all units in parallel, enhancing computational efficiency. The session explores the prior distribution over hidden layers and its implications for deep learning models. This material is invaluable for researchers and practitioners aiming to understand complex generative models and their training processes.

minowa
Télécharger la présentation

Advanced Gibbs Sampling for Stacked RBMs and Parallel Updates in Deep Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Stacked RBMs Lecture 14a

  2. 1. Gibbs sampling update all units in h3 – h2 – h3 … in parallel • => Prior distribution over h2

  3. http://videolectures.net/mlss09uk_hinton_dbn/

More Related