We prove that the classic policy-iteration method [Howard, R. A. 1960. Dynamic Programming and Markov Processes. MIT, Cambridge] and the original simplex method with the most-negative-reduced-cost ...

Markov decision process (MDP): A mathematical framework used to model decision making in situations where outcomes are partly random and partly under the control of a decision-maker.

How Does the Value Function of a Markov Decision Process Depend on the Transition Probabilities?, Mathematics of Operations Research, Vol. 22, No. 4 (Nov., 1997), pp. 872-885 ...