Markov Decision Process (MDP) Algorithm
This code is an implementation for the MDP algorithm. It is simple grid world Value Iteration. It provides a graphical representation of the value and policy of each cell and also it draws the final path from the start cell to the end cell.
It was originally a java code. I found it in
https://galweejit.wordpress.com/2010/12/16/ai-class-implementation-of-mdp-grid-world-from-week-5-unit-9/
and I converted it to Matlab version as my homework for Visualization course in my Master degree.
You can email me if u have any question about the code in:
toma2u@hotmail.com
Cite As
Fatuma Shifa (2026). Markov Decision Process (MDP) Algorithm (https://uk.mathworks.com/matlabcentral/fileexchange/55943-markov-decision-process-mdp-algorithm), MATLAB Central File Exchange. Retrieved .
MATLAB Release Compatibility
Platform Compatibility
Windows macOS LinuxCategories
Tags
Acknowledgements
Inspired by: MDP robot grid-world example
Discover Live Editor
Create scripts with code, output, and formatted text in a single executable document.
