Operations Research Models and Methods / Computation

Markov Process


The Embedded Markov Chain

The embedded Markov Chain is constructed to the right of the rate matrix on the worksheet and is shown for the example below. This matrix is used for some computations and can used as the transition matrix for a Markov Chain analysis.
 




Operations Research Models and Methods
by Paul A. Jensen and Jon Bard, University of Texas, Copyright by the Authors