Operations Research Models and Methods / Computation

Markov Process

Steady State Analysis

This Steady State worksheet shows steady state results for the Markov Process. The time distribution vector provides the proportion of the time the system will be found in each state. The expected transition time vector is the expected time required to leave each state. The three numbers on the right give steady state values of the unconditioned expected transition time, the average cost per unit time and discounted present worth. With the costs used in this example, the average cost per period (minute) is the same as the expected number in the system.

click picture to expand

Operations Research Models and Methods
by Paul A. Jensen and Jon Bard, University of Texas, Copyright by the Authors