Discrete Markov Chain example is here. Note that it was written in PyMC4, so you’ll need to change aesara to pytensor in PyMC5. You could also try the discrete markov chain distribution in pymc-experimental. Here’s an example notebook showing how that works.