Average loss for ADVI never decrease for my model

Can you post the code directly instead of a screenshot?

Does the model sample correctly with NUTS (i.e. pm.sample())? I suspect it’s not an ADVI but a model issue.