That’s right, for example you can see this in Copula (same marginals, different global maximum https://github.com/tensorflow/probability/blob/master/tensorflow_probability/examples/jupyter_notebooks/Gaussian_Copula.ipynb)
It is reasonable if you only care about the expectation - afterall what it plots is the expected slope and intercept. Of course if the posterior is highly correlated the result could be biased.