Poor ADVI performance with pymc5?

I’m noticing poorer ADVI performance with the upgrade to pymc5.
Is anyone aware of a change that might explain this?
And I’m struggling to find the default optimizer used with ADVI. Is it adam?

Can you share a minimal reproducible example to investigate?

About the default optimizer, cc @ferrine

Thanks, @ricardoV94, I’ll work on that. One clue: I suspect my likelihood is multi-modal. After hundreds of trials testing the same model in pymc4 and pymc5, the pymc4 version consistently finds the solution more reliably. Hence my question about the optimizer, and whether it or its parameters changed in pymc5.

The default optimizer for ADVI is currently adagrad_window. Seems to work best in general, based on informal comparisons.