Open Access
Towards an evaluation framework for process mining algorithms
A Anne Rozinat,de Aka Ana Karla Medeiros,CW Christian Günther,Ajmm Ton Weijters,van der Wmp Wil Aalst +4 more
- 01 Jan 2007
- Vol. 0706
TL;DR: In this article, the authors outline elements of an evaluation framework that is intended to enable process mining researchers to compare the performance of their algorithms, and end users to evaluate the validity of their process mining results.
read more
Abstract: Although there has been a lot of progress in developing process mining algorithms in recent years, no effort has been put in developing a common means of assessing the quality of the models discovered by these algorithms. In this paper, we outline elements of an evaluation framework that is intended to enable (a) process mining researchers to compare the performance of their algorithms, and (b) end users to evaluate the validity of their process mining results. Furthermore, we describe two possible approaches to evaluate a discovered model (i) using existing comparison metrics that have been developed by the process mining research community, and (ii) based on the so-called k-fold-cross validation known from the machine learning community. To illustrate the application of these two approaches, we compared a set of models discovered by different algorithms based on a simple example log.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
A fresh look at precision in process conformance
Jorge Munoz-Gama,Josep Carmona +1 more
- 13 Sep 2010
TL;DR: A novel measure for precision is proposed, based on the simple idea of counting these situations were the model deviates from the log, and a log-based traversal of the model that avoids inspecting its whole behavior is presented.
Algorithms for anomaly detection of traces in logs of process aware information systems
TL;DR: The sampling algorithm proved to be the most effective solution, and was applied to a real log, and compared the resulting detected anomalous traces with the ones detected by a different procedure that relies on manual choices.
126
The Need for a Process Mining Evaluation Framework in Research and Practice
A Anne Rozinat,AK Ana Karla de Medeiros,CW Christian Günther,Ajmm Ton Weijters,Wmp Wil van der Aalst +4 more
- 24 Sep 2007
TL;DR: This paper motivates the need for an evaluation mechanism, and outlines elements of an evaluation framework intended to enable process mining researchers to compare the performance of their algorithms, and end users to evaluate the validity of their process mining results.
•Proceedings Article
The need for a process mining evaluation framework in research and practice: position paper
A Anne Rozinat,A. K. Alves De Medeiros,CW Christian Günther,A.J.M.M. Weijters,W.M.P. van der Aalst +4 more
- 24 Sep 2007
TL;DR: In this article, the authors present an evaluation framework that is intended to enable process mining researchers to compare the performance of their algorithms and end users to evaluate the validity of their process mining results.
ProDiGen: mining complete, precise and minimal structure process models with a genetic algorithm
TL;DR: This paper addresses the problem of process discovery through a genetic algorithm with a new fitness function that takes into account both completeness, precision and simplicity, and includes new definitions for Precision and simplicity.
79
References
Workflow mining: discovering process models from event logs
TL;DR: A new algorithm is presented to extract a process model from a so-called "workflow log" containing information about the workflow process as it is actually being executed and represent it in terms of a Petri net.
Workflow mining: a survey of issues and approaches
W.M.P. van der Aalst,B. F. van Dongen,Joachim Herbst,Laura Maruster,G. Schimm,A.J.M.M. Weijters +5 more
- 01 Nov 2003
TL;DR: This paper introduces the concept of workflow mining and presents a common format for workflow logs, and discusses the most challenging problems and present some of the workflow mining approaches available today.
Conformance checking of processes based on monitoring real behavior
TL;DR: An incremental approach to check the conformance of a process model and an event log is proposed and a Conformance Checker has been implemented within the ProM framework and it has been evaluated using artificial and real-life event logs.
1.2K
Complexity of automaton identification from given data
TL;DR: The question of whether there is an automaton with n states which agrees with a finite set D of data is shown to be NP-complete, although identification-in-the-limit of finite automata is possible in polynomial time as a function of the size of D.
919
Business process mining: An industrial application
W.M.P. van der Aalst,Hajo A. Reijers,A.J.M.M. Weijters,B. F. van Dongen,A. K. Alves De Medeiros,Minseok Song,H. M. W. Verbeek +6 more
TL;DR: This paper describes the application of process mining in one of the provincial offices of the Dutch National Public Works Department, responsible for the construction and maintenance of the road and water infrastructure.
916