Proceedings chapter
OA Policy
English

Improving the significance of benchmarks for Petri nets model checkers

Presented atBraga (Portugal), 22nd June 2010
Publication date2010
Abstract

Benchmarking is a fundamental activity to rigorously quantify the improvements of a new approach or tool with respect to the state of the art. Generally, it consists in comparing results of a given technique with more or less similar approaches. In the Petri nets community, the comparison is often centered on model checking and/or state space calculation performance. However, there is sometimes little justification for the choice of the techniques to compare to. Also, benchmarks often lack context information, such as the exact model used, or how to reproduce the results. This makes it diffcult to draw conclusions from the comparisons. We conducted a survey among the Petri nets community in which we gathered information about the used formalisms and techniques. This revealed an unanimous interest for a common repository of benchmarks. The survey shows that existing efforts in this direction suffer from limitations that prevent their effectiveness. In this article we report the results of the survey and we outline perspectives for improving Petri nets benchmark repositories.

Citation (ISO format)
HOSTETTLER, Steve Patrick et al. Improving the significance of benchmarks for Petri nets model checkers. In: Proceedings of the workshops APNOC and SUMo, Braga, June 22, 2010. Braga (Portugal). [s.l.] : [s.n.], 2010. p. 97–111.
Main files (1)
Proceedings chapter
accessLevelPublic
Identifiers
  • PID : unige:9825
498views
666downloads

Technical informations

Creation08/07/2010 16:48:00
First validation08/07/2010 16:48:00
Update time14/03/2023 15:55:55
Status update14/03/2023 15:55:54
Last indexation29/10/2024 16:17:57
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack