Using neural networks to build an expressive hierarchical distribution; A variational inference method to accurately estimate the posterior uncertainty; A fast and general method for approximate Bayesian inference. (ICML 2018)
Thank you for posting the source code for your experiments! While viewing it I noticed that computation of the density q(z|ψ) at SIVAE.py#L113 seemingly lacks the normalizing constant that includes the changing variance term.
Am I missing something? Is it cancelled out somehow?
Hello, I have two doubts reading your code. 1. what is the variable WU in the VAE code? I noticed that it is assigned by warmup and will increase from 0 to 1 as the epoch increases. Means that the weight of the likelihood gradually decreases with training? Is there any consideration behind this?