Collaborative Evaluation to Build Closed Repositories on Business Process Models

Nowadays, many companies define, model and use business processes (BP) for several tasks. BP management has become an important research area and researchers have focused their attention on the development of mechanisms for searching BP models on repositories. Despite the positive results of the current mechanisms, there is no defined collaborative methodology to create a closed repository evaluation for these search mechanisms. This kind of repository contains some closed BP predefined lists representing queries and ideal answers to these queries with the most relevant BPs based on a set of evaluation metrics. This paper describes a methodology for creating such repositories. To apply the proposed methodology, we built a Web tool that allows to a set of evaluators to make relevance judgments in a collaborative way for each one of the items returned according to predefined queries. The evaluation metrics used can measure the consensus degree in the results, therefore confirming the methodology feasibility to create an open access, scalable and expandable closed BP repository with new BP models that can be reusable in future research.

• Publication year

  2014

• Venue

  International Conference on Enterprise Information Systems

• Publication date

  2014-04-27

• Fields of study

  Business, Computer Science

• Identifiers
  DOI 10.5220/0004881203110318
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Dynamic Reconfiguration of Composite Convergent Services Supported by Multimodal Search

  2015cited by this paper
• An Extensible Platform for Process Model Search and Evaluation

  2013cited by this paper
• Increasing process orientation with business process management: Critical practices'

  2013cited by this paper
• A comparative survey of business process similarity measures

  2012cited by this paper
• Recommendation-based editor for business process modeling

  2011cited by this paper
• Similarity of business process models: Metrics and evaluation

  2011cited by this paper
• APROMORE: An advanced process model repository

  2011cited by this paper
• An Open Process Model Library

  2011cited by this paper
• Business process model repositories:framework and survey

  2009cited by this paper
• Relevance Judgments for Web Services Retrieval - A Methodology and Test Collection for SWS Discovery Evaluation

  2009cited by this paper
• A genetic programming approach to business process mining

  2008cited by this paper
• On the Evaluation of Semantic Web Service Matchmaking Systems

  2006cited by this paper
• An evaluation of

  1983cited by this paper

• Recuperación y clasificación de arquitecturas software en GitHub para reutilización, soportado por ontologías

  2021cites this paper
• TrazasBP: A Framework for Business Process Models Discovery Based on Execution Cases

  2018cites this paper
• Business Process Models Clustering Based on Multimodal Search, K-means, and Cumulative and No-Continuous N-Grams

  2016cites this paper
• Multimodal Indexing and Search of Business Processes Based on Cumulative and Continuous N-Grams

  2016cites this paper
• Business Processes Retrieval based on Multimodal Search and Lingo Clustering Algorithm

  2015cites this paper