ESSAI'23 - Model Uncertainty in Sequential Decision-Making

We provide here material from the lecture course "Model Uncertainty in Sequential Decision-Making" delivered at the 2023 European Summer School on Artificial Intelligence (ESSAI) by Dave Parker, Bruno Lacerda and Nick Hawes.

Here are slides from the 5 lectures:

• Lecture 1 (introduction and MDPs)
• Lecture 2 (stochastic games and uncertain MDPs)
• Lecture 3 (uncertain MDPs and interval MDPs)
• Lecture 4 (sampling-based uncertain MDPs)
• Lecture 5 (Bayes-adaptive MDPs)

Here are the PRISM files for the robot running example from lectures 1-3:

• MDP robot model robot-mdp.prism and properties robot-mdp.props
• Interval MDP robot model robot-imdp.prism and properties robot-imdp.props

See here and here for more details about modelling uncertainty in PRISM.