Transition Matrix of Markov Chain

Transition Matrix of Markov Chain