The Quantitative Verification Benchmark Set

[HKPQR19] Arnd Hartmanns, Michaela Klauck, David Parker, Tim Quatmann and Enno Ruijters. The Quantitative Verification Benchmark Set. In Proc. 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'19), volume 11427 of LNCS, pages 344-350, Springer. April 2019. pdf bib [Presents a benchmark suite for quantitative verification, include a selection of models/properties for use in PRISM.]

Downloads
PDF 391 KBBibTeX
Notes
The benchmark set is at https://qcomp.org/benchmarks/.
The original publication is available at link.springer.com.
Search for this paper
Google · Google Scholar

Abstract

We present an extensive collection of quantitative models to facilitate the development, comparison, and benchmarking of new verification algorithms and tools. All models have a formal semantics in terms of extensions of Markov chains, are provided in the JANI format, and are documented by a comprehensive set of metadata. The collection is highly diverse: it includes established probabilistic verification and planning benchmarks, industrial case studies, models of biological systems, dynamic fault trees, and Petri net examples, all originally specified in a variety of modelling languages. It archives detailed tool performance data for each model, enabling immediate comparisons between tools and among tool versions over time. The collection is easy to access via a client-side web application at qcomp.org with powerful search and visualisation features. It can be extended via a Git-based submission process, and is openly accessible according to the terms of the CC-BY license.