It means you have a random state that is not updated across calls or is updated incorrectly. This would lead to wrong prior and posterior predictive sampling, but would likely not affect posterior sampling.
Can you share your model code? I imagine you have a CustomDist or a Scan in your model?