Long Run Proportions of Markov Chains

A Markov chain consisting of a selection of random choices between events A and B may be represented by the table below:

From this we may write down the transformation matrix

If the initial state of the system is represented by the vectorthen the state at timeis represented by

The state at timeis represented by

In general to state at timeis represented by

We can find the proportion of time in whch the system is in statesor by puttingWe obtain

Hence

From both of these equations

Also(since probabilities add to 1).

and similarly