Can you marginalize a mixture model where the draws from the different components are not independent?

On second thought I don’t think this model works. You would need a transition kernel that depends on the state, which I presume is impossible. Otherwise you would introduce short-range correlations that shouldn’t be there.