en
Proceedings chapter
Open access
English

Improving the significance of benchmarks for Petri nets model checkers

Presented at Braga (Portugal), 22nd June 2010
Publication date2010
Abstract

Benchmarking is a fundamental activity to rigorously quantify the improvements of a new approach or tool with respect to the state of the art. Generally, it consists in comparing results of a given technique with more or less similar approaches. In the Petri nets community, the comparison is often centered on model checking and/or state space calculation performance. However, there is sometimes little justification for the choice of the techniques to compare to. Also, benchmarks often lack context information, such as the exact model used, or how to reproduce the results. This makes it diffcult to draw conclusions from the comparisons. We conducted a survey among the Petri nets community in which we gathered information about the used formalisms and techniques. This revealed an unanimous interest for a common repository of benchmarks. The survey shows that existing efforts in this direction suffer from limitations that prevent their effectiveness. In this article we report the results of the survey and we outline perspectives for improving Petri nets benchmark repositories.

Citation (ISO format)
HOSTETTLER, Steve Patrick et al. Improving the significance of benchmarks for Petri nets model checkers. In: Proceedings of the workshops APNOC and SUMo, Braga, June 22, 2010. Braga (Portugal). [s.l.] : [s.n.], 2010. p. 97–111.
Main files (1)
Proceedings chapter
accessLevelPublic
Identifiers
  • PID : unige:9825
481views
662downloads

Technical informations

Creation07/08/2010 4:48:00 PM
First validation07/08/2010 4:48:00 PM
Update time03/14/2023 3:55:55 PM
Status update03/14/2023 3:55:54 PM
Last indexation02/12/2024 7:00:36 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack