How to average multiple chains?

If you have truly mutli-modal outputs you should not be averaging NUTS chains. All the chains should be converging to the same posterior distribution, as evidence of convergence. If you have multi-modal outputs, you should either be using mixture models or a different sampler altogether, such as sequential monte carlo.

2 Likes