ADVI in PyMC3 3.2 is approximately two times slower than 3.1

Questions
6

On weekends I tried to make it work. The problem is that theano clone fails to replace ScanOp when it is not needed (https://github.com/pymc-devs/pymc3/blob/master/pymc3/variational/opvi.py#L1379)
I failed to find the source of the problem quickly