100 likes | 221 Vues
In this lecture, Dr. Geoffrey Hinton discusses advanced techniques for Gibbs sampling in Stacked Restricted Boltzmann Machines (RBMs). Focusing on hierarchical architectures, he illustrates how to perform updates on all units in parallel, enhancing computational efficiency. The session explores the prior distribution over hidden layers and its implications for deep learning models. This material is invaluable for researchers and practitioners aiming to understand complex generative models and their training processes.
E N D
Stacked RBMs Lecture 14a
1. Gibbs sampling update all units in h3 – h2 – h3 … in parallel • => Prior distribution over h2