Operations Research Models and Methods / Computation / Stochastic Analysis /
Markov Chain

Steady State Analysis


The Steady State worksheet computes the Markov Chain steady state probabilities, if they exist. In addition, the average cost per period is computed.

For the example, we have noted that the transient solution approaches a steady state, and indeed this vector is computed independently on this worksheet. Steady state results are independent of the initial state, and they are available only for Markov Chains that have a single recurrent class.


Probability Analysis

Updated 3/29/01
Operations Research Models and Methods

by Paul A. Jensen and Jon Bard, University of Texas, Copyright by the Authors