Jump to content

Wake-sleep algorithm

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by BRW (talk | contribs) at 13:06, 2 January 2012 (new article). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)

The wake-sleep algorithm is an unsupervised learning algorithm for a multilayer neural network. Training is divided into two phases, "wake" and "sleep". In the "wake" phase, neurons are driven by recognition connections (connections from what would normally be considered an input to what is normally considered an output), while generative connections (those from outputs to inputs) are modified to increase the probability that they would reconstruct the correct activity in the layer below (closer to the sensory input). In the "sleep" phase the process is reversed: neurons are driven by generative connections, while recognition connections are modified to increase the probability that they would produce the correct activity in the layer above (further from sensory input).