#markov chain #stochastic process #probability state #transition probability #random sequence