Can you marginalize a mixture model where the draws from the different components are not independent?

Questions v5
11

You could model the indicator variables as a DiscreteMarkovChain that regresses to the mean of 0.5 with a couple of lag dependencies?