Can you marginalize a mixture model where the draws from the different components are not independent?

No, in my model there’s only a global correlation, all ids are equally likely to come from one component or the other a priori, there’s nothing special about two adjacent ids.