Plans for the week of April 8-12
Dear all, welcome back to FYS5429. This week we will try to wrap up our discussions of Boltzmann machines (our first encounter with generative models). Our plans are to discuss
Generative methods: energy models and Boltzmann machines.
-
Restricted Boltzmann machines, reminder from last week
-
Reminder on Markov Chain Monte Carlo and Gibbs sampling
-
Discussions of various Boltzmann machines, RBMs, deep belief networks and deep Boltzmann machines
-
Implementation of Boltzmann machines using TensorFlow and Pytorch, discussion of codes
-
Reading recommendation: Goodfellow et al chapters 18.1-18.2, 20.1-20-7; To create Boltzmann machine using Keras, see Babcock and Bali chapter 4, see https://github.com/PacktPublishing/Hands-On-Generative-AI-with-Python-and-TensorFlow-2/blob/master/Chapter_4/models/rbm.py
-
See also Foster, chapter 7 on energy-based models at https://github.com/davidADSP/Generative_Deep_Learning_2nd_Edition/tree/main/notebooks/07_ebm/01_ebm
We will also discuss briefly alternatives for project 2. We have also our regular lab session on Thursday at 215pm-4pm.
The slides for this week are at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week12/ipynb/week12.ipynb
Best wishes to you all,
Keran, Morten and Ruben