Negative "Average loss" in ADVI

Yes if you are seeing them consistently. It happens sometimes as the monte carlo samples from the ADVI could make the elbo goes to inf, but as training going further it should not appear any more

1 Like