Average loss for ADVI never decrease for my model

Thank you for the suggestion! I will definitely try them!