Operations Research Models and Methods / Computation / Stochastic Analysis /
Markov Chain


Steady State Analysis

 

The Steady State worksheet computes the Markov Chain steady state probabilities, if they exist. In addition, the average cost per period is computed.

For the example, we have noted that the transient solution approaches a steady state, and indeed this vector is computed independently on this worksheet. Steady state results are independent of the initial state, and they are available only for Markov Chains that have a single recurrent class.

 

Probability Analysis


Updated 3/29/01
Operations Research Models and Methods

by Paul A. Jensen and Jon Bard, University of Texas, Copyright by the Authors