0x535 Energy-based Model

The partition function chapter of the deep learning book has a good coverage of those methods.

Energy-based model defines a energy function \(E(X)\), and models the generation using the Boltzmann distribution

\[P(X) = \frac{\exp(-E(X))}{Z}\]

where \(Z\) is the partition function

Model (Boltzmann Machine)

\[E(x) = x^TWx\]

Model (Restricted Boltzmann Machine)

\[E(x, z) = x^TWz\]