article

Activity labeling in process modeling: Empirical insights and recommendations

Authors:

J. ReckerAuthors Info & Claims

Information Systems, Volume 35, Issue 4

Pages 467 - 482

https://doi.org/10.1016/j.is.2009.03.009

Published: 01 June 2010 Publication History

Abstract

Few studies have investigated the factors contributing to the successful practice of process modeling. In particular, studies that contribute to the act of developing process models that facilitate communication and understanding are scarce. Although the value of process models is not only dependent on the choice of graphical constructs but also on their annotation with textual labels, there has been hardly any work on the quality of these labels. Accordingly, the research presented in this paper examines activity labeling practices in process modeling. Based on empirical data from process modeling practice, we identify and discuss different labeling styles and their use in process modeling praxis. We perform a grammatical analysis of these styles and use data from an experiment with process modelers to examine a range of hypotheses about the usability of the different styles. Based on our findings, we suggest specific programs of research towards better tool support for labeling practices. Our work contributes to the emerging stream of research investigating the practice of process modeling and thereby contributes to the overall body of knowledge about conceptual modeling quality.

References

[1]

Davies, I., Green, P., Rosemann, M., Indulska, M. and Gallo, S., How do practitioners use conceptual modeling in practice?. Data and Knowledge Engineering. v58 i3. 358-380.

Digital Library

[2]

In: Dumas, M., van der Aalst, W.M.P., ter Hofstede, A.H.M. (Eds.), Process Aware Information Systems: Bridging People and Software Through Process Technology, Wiley, Hoboken, NJ.

Digital Library

[3]

Erl, T., Service-oriented Architecture: Concepts, Technology, and Design. 2005. Prentice-Hall, Upper Saddle River, NJ.

Digital Library

[4]

Ferris, C., What are web services?. Communications of the ACM. v46 i6. 31-32.

Digital Library

[5]

Curtis, B., Kellner, M.I. and Over, J., Process modeling. Communications of the ACM. v35 i9. 75-90.

Digital Library

[6]

Scheer, A.-W., ARIS-Business Process Modeling. 2000. third ed. Springer, Berlin, Germany.

Digital Library

[7]

Dehnert, J. and van der Aalst, W.M.P., Bridging the gap between business models and workflow specifications. International Journal of Cooperative Information Systems. v13 i3. 289-332.

[8]

Moody, D.L., Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions. Data and Knowledge Engineering. v15 i3. 243-276.

Digital Library

[9]

Mendling, J., Reijers, H.A. and Cardoso, J., What makes process models understandable?. In: Alonso, G., Dadam, P., Rosemann, M. (Eds.), Business Process Management-BPM 2007, Lecture Notes in Computer Science, vol. 4714. Springer, Brisbane, Australia. pp. 48-63.

Digital Library

[10]

Mendling, J., Neumann, G. and van der Aalst, W.M.P., Understanding the occurrence of errors in process models based on metrics. In: Meersman, R., Tari, Z. (Eds.), On the Move to Meaningful Internet Systems 2007, Lecture Notes in Computer Science, vol. 4803. Springer, Vilamoura, Portugal. pp. 113-130.

Digital Library

[11]

Recker, J. and Dreiling, A., Does it matter which process modelling language we teach or use? An experimental study on understanding process modelling languages without formal education. In: Toleman, M., Cater-Steel, A., Roberts, D. (Eds.), 18th Australasian Conference on Information Systems, The University of Southern Queensland, Toowoomba, Australia. pp. 356-366.

[12]

Rosemann, M., Recker, J., Indulska, M. and Green, P., A study of the evolution of the representational capabilities of process modeling grammars. In: Dubois, E., Pohl, K. (Eds.), Advanced Information Systems Engineering-CAiSE 2006, Lecture Notes in Computer Science, vol. 4001. Springer, Luxembourg, Grand-Duchy of Luxembourg. pp. 447-461.

Digital Library

[13]

van der Aalst, W.M.P., ter Hofstede, A.H.M., Kiepuszewski, B. and Barros, A.P., Workflow patterns. Distributed and Parallel Databases. v14 i1. 5-51.

Digital Library

[14]

Russell, N., van der Aalst, W.M.P., ter Hofstede, A.H.M. and Edmond, D., Workflow resource patterns: identification. In: Pastor, O., Falcao e Cunha, J. (Eds.), Advanced Information Systems Engineering-CAiSE 2005, Lecture Notes in Computer Science, vol. 3520. Springer, Porto, Portugal. pp. 216-232.

Digital Library

[15]

Russell, N., ter Hofstede, A.H.M., Edmond, D. and van der Aalst, W.M.P., Workflow data patterns: identification, representation and tool support. In: Delcambre, L.M.L., Kop, C., Mayr, H.C., Mylopoulos, J., Pastor, O. (Eds.), Conceptual Modeling-ER 2005, Lecture Notes in Computer Science, vol. 3716. Springer, Klagenfurt, Austria. pp. 353-368.

Digital Library

[16]

Krogstie, J., Sindre, G. and Jorgensen, H.D., Process models representing knowledge for action: a revised quality framework. European Journal of Information Systems. v15 i1. 91-102.

Digital Library

[17]

Storey, V.C., Comparing relationships in conceptual modeling: mapping to semantic classifications. IEEE Transactions on Knowledge and Data Engineering. v17 i11. 1478-1489.

Digital Library

[18]

Miles, L.D., Techniques of Value Analysis and Engineering. 1961. McGraw-Hill, New York.

[19]

Sharp, A. and McDermott, P., Workflow Modeling: Tools for Process Improvement and Application Development. 2001. Artech House, Boston, MA.

Digital Library

[20]

Malone, T.W., Crowston, K. and Herman, G.A., Organizing Business Knowledge: The MIT Process Handbook. 2003. The MIT Press, Cambridge, MA.

Digital Library

[21]

Paivio, A., Dual coding theory: retrospect and current status. Canadian Journal of Psychology. v45 i3. 255-287.

[22]

Brooks, L.R., The suppression of visualization by reading. The Quarterly Journal of Experimental Psychology. v19 i4. 289-299.

[23]

Mayer, R.E., Models for understanding. Review of Educational Research. v59 i1. 43-64.

[24]

Mayer, R.E., Multimedia Learning. 2001. Cambridge University Press, Cambridge, MA.

Digital Library

[25]

Bodart, F., Patel, A., Sim, M. and Weber, R., Should optional properties be used in conceptual modelling? A theory and three empirical tests. Information Systems Research. v12 i4. 384-405.

Digital Library

[26]

Gemino, A. and Wand, Y., Complexity and clarity in conceptual modeling: comparison of mandatory and optional properties. Data and Knowledge Engineering. v55 i3. 301-326.

Digital Library

[27]

Cox, K. and Phalp, K.T., Replicating the crews use case authoring guidelines experiment. Empirical Software Engineering. v5 i3. 245-267.

Digital Library

[28]

Phalp, K.T., Vincent, J. and Cox, K., Improving the quality of use case descriptions: empirical assessment of writing guidelines. Software Quality Journal. v15 i4. 383-399.

Digital Library

[29]

Davis, R.B., Business Process Modelling with ARIS: A Practical Guide. 2001. Springer, London, England.

Digital Library

[30]

Mendling, J. and Strembeck, M., Influence factors of understanding business process models. In: Abramowicz, W., Fensel, D. (Eds.), Business Information Systems-BIS 2008, Lecture Notes in Business Information Processing, vol. 7. Springer, Innsbruck, Austria. pp. 142-153.

[31]

Keller, G. and Teufel, T., SAP R/3 Process Oriented Implementation: Iterative Process Prototyping. 1998. Addison-Wesley, Boston, MA.

Digital Library

[32]

Daneva, M., Erp requirements engineering practice: lessons learned. IEEE Software. v21 i2. 26-33.

Digital Library

[33]

Mendling, J., Verbeek, H.M.V., van Dongen, B.F., van der Aalst, W.M.P. and Neumann, G., Detection and prediction of errors in epcs of the sap reference model. Data and Knowledge Engineering. v64 i1. 312-329.

Digital Library

[34]

Dreiling, A., Rosemann, M., van der Aalst, W.M.P. and Sadiq, W., From conceptual process models to running systems: a holistic approach for the configuration of enterprise system processes. Decision Support Systems. v45 i2. 189-207.

Digital Library

[35]

Miller, G.A., Wordnet-a lexical database for English. Communications of the ACM. v38 i11. 39-41.

Digital Library

[36]

Dixon, R.M.W., Deriving verbs in English. Language Sciences. v30 i1. 31-51.

[37]

Price, R. and Shanks, G., A semiotic information quality framework: development and comparative analysis. Journal of Information Technology. v20 i2. 88-102.

[38]

Khatri, V., Vessey, I., Ramesh, P.C.V. and Sung-Jin, P., Understanding conceptual schemas: exploring the role of application and is domain knowledge. Information Systems Research. v17 i1. 81-99.

[39]

Masri, K., Parker, D.C. and Gemino, A., Using iconic graphics in entity-relationship diagrams: the impact on understanding. Journal of Database Management. v19 i3. 22-41.

[40]

Batra, D. and Davis, J.G., Conceptual data modelling in database design: similarities and differences between expert and novice designers. International Journal of Man-Machine Studies. v37 i1. 83-101.

Digital Library

[41]

Shanks, G., Conceptual data modelling: an empirical study of expert and novice data modellers. Australasian Journal of Information Systems. v4 i2. 63-73.

[42]

J. Recker, Understanding process modelling grammar continuance: a study of the consequences of representational capabilities, Ph.D Thesis, Queensland University of Technology, 2008.

[43]

Maes, A. and Poels, G., Evaluating quality of conceptual modelling scripts based on user perceptions. Data and Knowledge Engineering. v63 i3. 769-792.

Digital Library

[44]

Bhattacherjee, A., Understanding information systems continuance: an expectation-confirmation model. MIS Quarterly. v25 i3. 351-370.

Digital Library

[45]

J. Mendling, Detection and prediction of errors in epc business process models, Ph.D. Thesis, Vienna University of Economics and Business Administration, 2007.

[46]

Gemino, A. and Wand, Y., A framework for empirical evaluation of conceptual modeling techniques. Requirements Engineering. v9 i4. 248-260.

[47]

Batra, D., Hoffler, J.A. and Bostrom, R.P., Comparing representations with relational and eer models. Communications of the ACM. v33 i2. 126-139.

Digital Library

[48]

Siau, K. and Loo, P.-P., Identifying difficulties in learning uml. Information Systems Management. v23 i3. 43-51.

[49]

Parsons, J. and Cole, L., What do the pictures mean? Guidelines for experimental evaluation of representation fidelity in diagrammatical conceptual modeling techniques. Data and Knowledge Engineering. v55 i3. 327-342.

Digital Library

[50]

Cohen, J., A coefficient of agreement for nominal scales. Educational and Psychological Measurement. v20 i1. 37-46.

[51]

Landis, J.R. and Koch, G.G., The measurement of observer agreement for categorical data. Biometrics. v33 i2. 159-174.

[52]

Siegel, S., Nonparametric Statistics for The Behavioral Sciences, McGraw-Hill Series in Psychology. 1956. McGraw-Hill Kogakusha, Tokyo, Japan.

[53]

Nunnally, J.C. and Bernstein, I.H., Psychometric Theory, McGraw-Hill Series in Psychology. 1994. third ed. McGraw-Hill, New York.

[54]

Fornell, C. and Larcker, D.F., Evaluating structural equations with unobservable variables and measurement error. Journal of Marketing Research. v18 i1. 39-50.

[55]

Stevens, J.P., Applied Multivariate Statistics for the Social Sciences. 2001. fourth ed. Applied Multivariate STATS, Lawrence Erlbaum Associates, Hillsdale, NJ.

[56]

Davis, F.D., Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly. v13 i3. 319-340.

[57]

Moore, G.C. and Benbasat, I., Development of an instrument to measure the perceptions of adopting an information technology innovation. Information Systems Research. v2 i3. 192-222.

[58]

G. Alonso, M. Rosemann, P. Dadam (Eds.), Business Process Management-BPM 2007, Lecture Notes in Computer Science, vol. 4714, Springer, Brisbane, Australia, 2007.

Digital Library

[59]

M. Dumas, M. Reichert, M.-C. Shan (Eds.), Business Process Management-BPM 2008, Lecture Notes in Computer Science, vol. 5240, Springer, Milan, Italy, 2008.

Digital Library

[60]

Kindler, E., On the semantics of epcs: resolving the vicious circle. Data and Knowledge Engineering. v56 i1. 23-40.

Digital Library

[61]

J. Mendling, in: Metrics for Process Models: Empirical Foundations of Verification, Error Prediction and Guidelines for Correctness, Lecture Notes in Business Information Processing, vol. 6, Springer, Berlin, Germany, 2008.

Digital Library

[62]

Sutton, D.C., Linguistic problems with requirements and knowledge elicitation. Requirements Engineering. v5 i2. 114-124.

[63]

Guarino, N., Concepts, attributes, and arbitrary relations. Some linguistic and ontological criteria for structuring knowledge bases. Data and Knowledge Engineering. v8 i3. 249-261.

Digital Library

[64]

Burg, J.F.M. and van de Riet, R.P., The impact of linguistics on conceptual models: consistency and understandability. Data and Knowledge Engineering. v21 i2. 131-146.

Digital Library

[65]

Agerfalk, P.J. and Eriksson, O., Action-oriented conceptual modelling. European Journal of Information Systems. v13 i1. 80-92.

Digital Library

[66]

Kiepuszewski, B., ter Hofstede, A.H.M. and van der Aalst, W.M.P., Fundamentals of control flow in workflows. Acta Informatica. v39 i3. 143-209.

[67]

Gasevic, D. and Devedzic, V., Petri net ontology. Knowledge-Based Systems. v19 i4. 220-234.

[68]

Mendling, J. and van der Aalst, W.M.P., Formalization and verification of epcs with or-joins based on state and context. In: Krogstie, J., Opdahl, A.L., Sindre, G. (Eds.), Advanced Information Systems Engineering-CAiSE 2007, Lecture Notes in Computer Science, vol. 4495. Springer, Trondheim, Norway. pp. 439-453.

Digital Library

[69]

D. Hardt, Verb phrase ellipsis: form, meaning, and processing, Ph.D. Thesis, University of Pennsylvania, 1993.

Digital Library

[70]

Fliedl, G., Kop, C. and Mayr, H.C., From textual scenarios to a conceptual schema. Data and Knowledge Engineering. v55 i1. 20-37.

Digital Library

[71]

Ingvaldsen, J.E., Gulla, J.A., Su, X. and Ronneberg, H., A text mining approach to integrating business. Process models and governing documents. In: Meersman, R., Tari, Z. (Eds.), On the Move to Meaningful Internet Systems 2005: OTM Workshops, Lecture Notes in Computer Science, vol. 3762. Springer, Agia Napa, Cyprus. pp. 473-484.

Digital Library

[72]

Ehrig, M., Koschmider, A. and Oberweis, A., Measuring similarity between semantic business process models. In: Roddick, J.F., Hinze, A. (Eds.), Conceptual Modelling 2007, Conferences in Research and Practice in Information Technology, vol. 67. Australian Computer Science Communications, Ballarat, Australia. pp. 71-80.

Digital Library

[73]

Halpin, T. and Curland, M., Automated verbalization for orm 2. In: Meersman, R., Tari, Z., Herrero, P. (Eds.), On the Move to Meaningful Internet Systems 2006: OTM year Workshops, Lecture Notes in Computer Science, vol. 4278. Springer, Montpellier, France. pp. 1181-1190.

Digital Library

[74]

Frederiks, P.J.M. and van der Weide, T.P., Information modeling: the process and the required competencies of its participants. Data and Knowledge Engineering. v58 i1. 4-20.

Digital Library

[75]

Nuseibeh, B. and Easterbrook, S., Requirements engineering: a roadmap. In: Ghezzi, C., Jazayeri, M., Wolf, A.L. (Eds.), 22nd International Conference on Software Engineering, ACM, Limerick, Ireland. pp. 35-46.

Digital Library

[76]

Rosemann, M., Preparation of process modeling. In: Becker, J., Kugeler, M., Rosemann, M. (Eds.), Process Management: A Guide for the Design of Business Processes, Springer, Berlin, Germany. pp. 41-78.

[77]

Fillies, C., Wood-Albrecht, G. and Weichardt, F., Pragmatic applications of the semantic web using semtalk. Computer Networks. v42 i5. 599-615.

Digital Library

[78]

Guizzardi, G., Herre, H. and Wagner, G., On the general ontological foundations of conceptual modeling. In: Spaccapietra, S., March, S.T., Kambayashi, Y. (Eds.), Conceptual Modeling-ER 2002, Lecture Notes in Computer Science, vol. 2503. Springer, Tampere, FL. pp. 65-78.

Digital Library

[79]

M. Hepp, F. Leymann, C. Bussler, J. Domingue, A. Wahler, D. Fensel, Semantic business process management: using semantic web services for business process management, in: IEEE International Conference on e-Business Engineering, IEEE, Beijing, China, 2005, pp. 535-540.

Digital Library

[80]

Wagner, G., The agent-object-relationship metamodel: towards a unified view of state and behavior. Information Systems. v28 i5. 475-504.

Digital Library

[81]

Levin, B., English Verb Classes and Alternations: A Preliminary Investigation. 1993. University of Chicago Press, Chicago, IL.

[82]

Menzel, C.P. and Grüninger, M., A formal foundation for process modeling. In: Guarino, N., Smith, B., Welty, C. (Eds.), 2nd International Conference on Formal Ontology in Information Systems, ACM, Oguinquit, Maine. pp. 256-269.

Digital Library

[83]

J. Mendling, J. Recker, Towards systematic usage of labels and icons in business process models, in: T. Halpin, H.A. Proper, J. Krogstie (Eds.), 12th International Workshop on Exploring Modeling Methods in Systems Analysis and Design, CEUR Workshop Proceedings Series, CEUR, Montpellier, France, 2008, pp. 1-13.

[84]

Boudreau, M., Gefen, D. and Straub, D., Validation in information systems research: a state-of-the-art assessment. MIS Quarterly. v25 i1. 1-16.

Digital Library

[85]

Reijers, H.A. and Mendling, J., Modularity in process models: review and effects. In: Dumas, M., Reichert, M., Shan, M.-C. (Eds.), Business Process Management-BPM 2008, Lecture Notes in Computer Science, vol. 5240. Springer, Milan, Italy. pp. 20-35.

Digital Library

[86]

J. Mendling, H.A. Reijers, W.M.P. van der Aalst, Seven process modeling guidelines (7pmg), QUT ePrints Report 12340, Queensland University of Technology, 2008.

[87]

C.B. Achour, C. Rolland, N.A.M. Maiden, C. Souveyet, Guiding use case authoring: results of an empirical study, in: IEEE International Symposium on Requirements Engineering, IEEE, Limerick, Ireland, 1999, pp. 36-43.

Digital Library

Cited By

Winter MPryss R(2024)The effects of modular process models on gaze patterns - A follow-up investigation about modularization in process model literacyExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121176237:PAOnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121176
Dai FMo QLi THuang BYang YZhao Y(2024)Refactoring business process models with process fragments substitutionWireless Networks10.1007/s11276-020-02367-330:5(3507-3521)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11276-020-02367-3
Farshidi SKwantes IJansen S(2024)Business process modeling language selection for research modelersSoftware and Systems Modeling (SoSyM)10.1007/s10270-023-01110-823:1(137-162)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10270-023-01110-8
Show More Cited By

Recommendations

Styles in business process modeling: an exploration and a model

Business process models are an important means to design, analyze, implement, and control business processes. As with every type of conceptual model, a business process model has to meet certain syntactic, semantic, and pragmatic quality requirements to ...
The Structured Process Modeling Theory (SPMT) a cognitive view on why and how modelers benefit from structuring the process of process modeling

After observing various inexperienced modelers constructing a business process model based on the same textual case description, it was noted that great differences existed in the quality of the produced models. The impression arose that certain quality ...
The importance of business process modeling in software systems design

Despite diligent efforts made by the software engineering community, the failure of software projects keeps increasing at an alarming rate. After two decades of this problem reoccurring, one of the leading causes for the high failure rate is still poor ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Information Systems

Information Systems Volume 35, Issue 4

June, 2010

154 pages

ISSN:0306-4379

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2009.

Publisher

Elsevier Science Ltd.

United Kingdom

Publication History

Published: 01 June 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Winter MPryss R(2024)The effects of modular process models on gaze patterns - A follow-up investigation about modularization in process model literacyExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121176237:PAOnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121176
Dai FMo QLi THuang BYang YZhao Y(2024)Refactoring business process models with process fragments substitutionWireless Networks10.1007/s11276-020-02367-330:5(3507-3521)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11276-020-02367-3
Farshidi SKwantes IJansen S(2024)Business process modeling language selection for research modelersSoftware and Systems Modeling (SoSyM)10.1007/s10270-023-01110-823:1(137-162)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10270-023-01110-8
Klievtsova NKampik TMangler JRinderle-Ma S(2024)Conversationally Actionable Process Model CreationCooperative Information Systems10.1007/978-3-031-81375-7_3(39-55)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-81375-7_3
Franceschetti MAbbad-Andaloussi ASchreiber CLópez HWeber B(2024)Exploring the Cognitive Effects of Ambiguity in Process ModelsBusiness Process Management10.1007/978-3-031-70396-6_28(493-510)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-70396-6_28
Winter MNeumann HPryss RProbst TReichert M(2023)Defining gaze patterns for process model literacy – Exploring visual routines in process models with diverse mappingsExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.119217213:PCOnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.eswa.2022.119217
Sola Dvan der Aa HMeilicke CStuckenschmidt H(2023)Activity Recommendation for Business Process Modeling with Pre-trained Language ModelsThe Semantic Web10.1007/978-3-031-33455-9_19(316-334)Online publication date: 28-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-33455-9_19
Corradini FMarcelletti AMorichetta APolini ARe BTiezzi F(2022)Engineering Trustable and Auditable Choreography-based Systems Using BlockchainACM Transactions on Management Information Systems10.1145/350522513:3(1-53)Online publication date: 11-Feb-2022
https://dl.acm.org/doi/10.1145/3505225
Rosenthal KStrecker SSnoeck M(2022)Modeling difficulties in creating conceptual data modelsSoftware and Systems Modeling (SoSyM)10.1007/s10270-022-01051-822:3(1005-1030)Online publication date: 13-Oct-2022
https://dl.acm.org/doi/10.1007/s10270-022-01051-8
Abdelkader MMansour M(2021)A Method Based on a New Word Embedding Approach for Process Model MatchingInternational Journal of Artificial Intelligence and Machine Learning10.4018/IJAIML.202101010111:1(1-14)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.4018/IJAIML.2021010101
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents