One step and n-step transition probabilities

24 Novembro 2016, 10:30 • Kamil Feridun Turkman

definition of one step and n step transition probabilities and  initial distribution. definition of homogeneous markov chains. Showing that the initial distribution together with the onestep transion probabilities define completely the probability structure of e chain