This might be a overly simple question, but what does it mean when the displayed Average Loss is negative, e.g.: Average Loss = -1.7241e+05: 74%|███████▎ | 7366/10000 [24:12<08:39, 5.07it/s] As far as I understand it represents the negation of the ELBO, which should always be negative. Does thi…

The displayed Loss value does not bare much meaning - some constant might be drop during the model set up. As long as the number is getting smaller you dont need to worry too much about it.

Negative "Average loss" in ADVI

Questions

dycontri April 14, 2019, 9:51pm 4

Is a -inf loss similarly indicative of problems as positive inf?

Topic		Replies	Views
Average Loss in optimization output Questions	20	4787	July 20, 2018
Infinite loss with ADVI Questions	1	1119	January 24, 2018
Inf Average loss ADVI in Correlated Topic Model Questions	9	1567	July 25, 2018
Average loss in ADVI optimization Questions	3	1366	July 23, 2018
Having Trouble in Using Mini Batch ADVI for HAR dataset Questions	5	733	December 15, 2018

Negative "Average loss" in ADVI

Related topics