Process model discovery algorithms are capable of extracting process models from event logs, but different algorithms have varying capabilities in handling event logs. Currently, most research on evaluating these algorithms involves indirect evaluation methods, which have limitations. To address this issue, a method was proposed to directly evaluate the reliability of process model discovery algorithms, using reliability as an important evaluation metric. The original event log was preprocessed to obtain an incremental sub-log collection, the process model discovery algorithm was applied to the incremental sub-logs and the original event log to obtain process models, and the reliability of the business process model discovery algorithm was evaluated through quality assessment. Based on nine public simulation event logs and four real event logs, multiple model discovery algorithms were experimented on from the aspects of weak reliability, noise interference reliability, and strong reliability. The experimental results showed that the reliability values of Heuristic Miner, Inductive Miner-infrequent, Inductive Miner, and Alpha Miner were 4, 3.2, 2.4, and 1.6, respectively. Higher reliability values indicated stronger reliability of the algorithms. Thus, the proposed method can effectively evaluate the reliability of the algorithms.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |