Yes, correctly said I am trying to generate samples from the given transition matrix(Markov Chain).
Thanks for the directions. I will try but Whats RV in the pmx.Discrete Markov Chain RV ?
Actually, I am looking into some Markov Chain Monte Carlo methods so that I can reduce the simulation time.