Plans for the week of April 15-19
Hi all, we hope you have had a great weekend. Hopefully the weather is also getting better!
This week our plans are to continue our discussions of generative models. We plan on
-
Finalizing the discussion of Boltzmann machines, with implementations using TensorFlow and Pytorch
-
Discussion of other energy-based models and Langevin sampling
-
Variational Autoencoders (VAE) and the mathematics thereof
-
Generative Adversarial Networks (GANs)
Some reading suggestions.
-
Reading recommendation: Goodfellow et al, for VAEs and GANs see sections 20.10-20.11
-
To create Boltzmann machine using Keras, see Babcock and Bali chapter 4, see https://github.com/PacktPublishing/Hands-On-Generative-AI-with-Python-and-TensorFlow-2/blob/master/Chapter_4/models/rbm.py
-
See Foster, chapter 7 on energy-based models at https://github.com/davidADSP/Generative_Deep_Learning_2nd_Edition/tree/main/notebooks/07_ebm/01_ebm
Some of the notes in this week's jupyter-notebook (math of VAEs) will be updated (need to change notation from previous lectures).
Also, the notes on Langevin sampling will be update. This week's jupyter-notebook is at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week13/ipynb/week13.ipynb
Best wishes to you all,
Keran, Morten and Ruben