How to do model comparison with a dummy variable

That all looks reasonably good to me. There’s only a single chain that is failing to mix. I would expect that tweaking the tuning routine might help to take care of that. As for the fact that the model ultimately ends up preferring a mixture in which a single component is dominant, that’s likely to be a function of your components and your data.