There are other adaptation strategies, for instance if you pass init="jitter+adapt_diag_grad" you’ll get an algorithm that updates the mass matrix continuously and shouldn’t have such discrete jumps
2 Likes