The Markov Decision Process (MDP) add-in has been replaced by the DP Solver add-in. The new program is part of the DP Collection of add-ins. Click the link for instructions for the new materials.

DP Solver add-in