Looking at the ELBO plot it seems fine. Maybe in some iterations the ELBO goes infinite, you can check where the approx.hist is infinite, and track the parameter using http://docs.pymc.io/notebooks/variational_api_quickstart.html#Tracking-parameters to investigate further.
1 Like