www.prismmodelchecker.org
[ACDKM17] Pranav Ashok, Krishnendu Chatterjee, Przemysław Daca, Jan Křetínský and Tobias Meggendorfer. Value Iteration for Long-run Average Reward in Markov Decision Processes. In Proc. International Conference on Computer Aided Verification (CAV'17), pages 201-221. 2017. [Implements a novel algorithm for solving long-run average MDPs as an extension of PRISM.]
Links: [Google] [Google Scholar]

Publications