• Home
  1. Home
  2. Improving the significance of benchmarks for Petri nets model checkers
Proceedings chapter
OA Policy
English

Improving the significance of benchmarks for Petri nets model checkers

Contributors

Hostettler, Steve Patrick; Linard, Alban; Marechal Marin, Alexis Ayar; Risoldi, Matteo

Presented at

Braga (Portugal), 22nd June 2010

Published in

Proceedings of the workshops APNOC and SUMo, Braga, June 22, 2010, p. 97-111

Publication date

2010

Abstract

Benchmarking is a fundamental activity to rigorously quantify the improvements of a new approach or tool with respect to the state of the art. Generally, it consists in comparing results of a given technique with more or less similar approaches. In the Petri nets community, the comparison is often centered on model checking and/or state space calculation performance. However, there is sometimes little justification for the choice of the techniques to compare to. Also, benchmarks often lack context information, such as the exact model used, or how to reproduce the results. This makes it diffcult to draw conclusions from the comparisons. We conducted a survey among the Petri nets community in which we gathered information about the used formalisms and techniques. This revealed an unanimous interest for a common repository of benchmarks. The survey shows that existing efforts in this direction suffer from limitations that prevent their effectiveness. In this article we report the results of the survey and we outline perspectives for improving Petri nets benchmark repositories.

UNIGE affiliation entities

UNIGE research groups

Citation (ISO format)

HOSTETTLER, Steve Patrick et al. Improving the significance of benchmarks for Petri nets model checkers. In: Proceedings of the workshops APNOC and SUMo, Braga, June 22, 2010. Braga (Portugal). [s.l.] : [s.n.], 2010. p. 97–111.

Main files (1)

Proceedings chapter

Identifiers

  • PID : unige:9825
570views
933downloads

Technical informations

Creation

08/07/2010 16:48:00

First validation

08/07/2010 16:48:00

Update

14/03/2023 15:55:55

Status update

14/03/2023 15:55:54

Last indexation

29/10/2024 16:17:57
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated