Markov Decision Processes (MDP) Toolbox

Functions related to the resolution of discrete-time Markov Decision Processes.

Download
Download

You are now following this Submission

Cite As

Marie-Josee Cros (2026). Markov Decision Processes (MDP) Toolbox (https://uk.mathworks.com/matlabcentral/fileexchange/25786-markov-decision-processes-mdp-toolbox), MATLAB Central File Exchange. Retrieved .

General Information

MATLAB Release Compatibility

  • Compatible with any release

Platform Compatibility

  • Windows
  • macOS
  • Linux
Version Published Release Notes Action
1.6.0

Add the possibility to download as a toolbox (.mltbx file).

Download
1.5.0

Complete Other Requirements.

Download
1.4.0

Mainly improve documentation (Jan. 2014)

Download
1.3.0

Update the zip file !

Download
1.2.0

The version 4.0 (October 2012) is entirely compatible with GNU Octave (version 3.6), the output of several functions: mdp_relative_value_iteration, mdp_value_iteration and mdp_eval_policy_iterative, were modified.

Download
1.1.0

Add all authors names

Download
1.0.0

Download