Identifiable up to rearrangement

Nope, most likely NUTS will try to do sample all the space and failed, see eg Identifying Bayesian Mixture Models

One solution I can think of is to port the permutation bijector from TFP into a transformer in pymc3.

One solution