Overview
SPUDD stands for "Stochastic Planning using Decision Diagrams". This page is intended to provide information and access to the SPUDD module that was implemented in the department of Computer Science at the University of British Columbia . SPUDD implements a value iteration algorithm for MDPs and POMDPs that uses algebraic decision diagrams (ADDs) to represent value functions and policies.
Publications
The original SPUDD paper
Jesse Hoey, Robert St-Aubin, Alan J Hu and Craig Boutilier SPUDD: Stochastic Planning Using Decision Diagrams. Proceedings of Uncertainty in Artificial Intelligence, Stockholm, Sweden, 1999
The extensions for approximate planning (APRICODD)Robert St-Aubin, Jesse Hoey and Craig Boutilier APRICODD: Approximate policy construction using decision diagrams. Neural Information Processing Systems, Denver, CO, USA, 2000
Spudd online
For small problems if you want to test out how SPUDD works, try submitting your own MDP through Interactive SPUDD.
Spudd online is now Spudd offline. Permanently.
Instead, download the code below and run it yourself!
Downloads
This code is for research purposes only.
Please see the README file in Spudd/doc/ for instructions
- NEW March 1st, 2007. spudd version 3.5.3. fixed two minor problems to get Spudd to compile with gcc v4.
- April 13th, 2005. spudd version 3.5.2. A minor bug was introduced in version 3.5, which is now removed. This bug caused value iteration to converge much more slowly, and also affected problems with state-dependent action costs. Note: the POMDP solution code has problems with caching (I think), causing it to run very slowly on larger problems. Contact the author for further details.
- February 16th, 2005 spudd version 3.5. Improved POMDP support (point-based algorithm). gcc 3.4 compatible. This version was compromised. Please upgrade to version 3.5.2 if you were using 3.5
- September 10, 2004 spudd version 3.4.1 small bug fixes - POMDP solving using Fast Point Based Value Iteration works. The default Spudd binary that is built will be normal MDP Spudd, so current users should see no difference. Contact Jesse Hoey for more details.
- For older versions, go here