Average loss for ADVI never decrease for my model

OK that means your model is mis-specified. Unfortunately I won’t be able to dig into why but I recommend you start with the simplest model you can, get that working on NUTS, and then slowly add back complexity while always making sure NUTS samples well and fast.

1 Like