Can you marginalize a mixture model where the draws from the different components are not independent?

Yes it will introduce short-range correlations. It’s just a hack. Those will however exist in your model right?