Abstract
This research was aimed at eliciting the requirements of practitioners who use conceptual modeling in their professional work for the visual notations of modeling languages. While the use of conceptual modeling in practice has been addressed, what practitioners in fact require of the visual notation of the modeling languages they use has received little attention. This work was thus motivated by the need to understand to what extent practitioners’ requirements are acknowledged and accommodated by visual notation research efforts. A mixed-method study was conducted, with a survey being offered over the course of several months to LinkedIn professional groups. The requirements included in the survey were based on a leading design theory for visual notations, the Physics of Notations. After preprocessing, 104 participant responses were analyzed. Data analysis included descriptive coding and qualitative analysis of purposes for modeling and additional requirements beyond the scope of visual design. Statistical and factorial analysis was used to explore potential correlations between the importance of different requirements as perceived by practitioners and the demographic factors (e.g., domain, purpose, topics). The results indicate several correlations between demographic factors and the perceived importance of visual notation requirements, as well as differences in the perceived relative importance of different requirements for models used to communicate with modeling experts as compared to non-experts. Furthermore, the results show an evolution from trends identified in studies conducted in the previous decade. The identified correlations with practitioners’ demographics reveal several research challenges that should be addressed, as well as the potential benefits of more purpose-specific tailoring of visual notation design. Furthermore, the shift in practitioner demographics as compared to those found in earlier work indicates that the research and development of conceptual modeling efforts needs to stay up-to-date with the way practitioners employ conceptual modeling.
Similar content being viewed by others
Notes
See the full output of the statistical analysis at www.dirkvanderlinden.eu/data.
References
Baar, T.: Correctly defined concrete syntax for visual modeling languages. In: International Conference on Model Driven Engineering Languages and Systems, pp. 111–125. Springer (2006)
Braun, R., Esswein, W.: Designing dialects of enterprise modeling languages with the profiling technique. In: Enterprise Distributed Object Computing Conference (EDOC), 2015 IEEE 19th International, pp. 60–67. IEEE (2015)
Caire, P., Genon, N., Heymans, P., Moody, D.L.: Visual notation design 2.0: Towards user comprehensible requirements engineering notations. In: Requirements Engineering Conference (RE), 2013 21st IEEE International, pp. 115–124. IEEE (2013)
Cronbach, L.J., Meehl, P.E.: Construct validity in psychological tests. Psychol. Bull. 52(4), 281 (1955)
Davies, I., Green, P., Rosemann, M., Indulska, M., Gallo, S.: How do practitioners use conceptual modeling in practice? Data Knowl. Eng. 58(3), 358–380 (2006)
Dehnert, J., Van Der Aalst, W.M.: Bridging the gap between business models and workflow specifications. Int. J. Cooperative Inf. Syst. 13(03), 289–332 (2004)
Fettke, P.: How conceptual modeling is used. Commun. Assoc. Inf. Syst. 25(1), 43 (2009)
Figl, K., Derntl, M.: The impact of perceived cognitive effectiveness on perceived usefulness of visual conceptual modeling languages. Concept. Model. ER 2011, 78–91 (2011)
Fondement, F., Baar, T.: Making metamodels aware of concrete syntax. In: European Conference on Model Driven Architecture-Foundations and Applications, pp. 190–204. Springer (2005)
Freudenberg, S., Sharp, H.: The top 10 burning research questions from practitioners. IEEE Softw. 27(5), 8–9 (2010)
Genon, N., Heymans, P., Amyot, D.: Analysing the cognitive effectiveness of the bpmn 2.0 visual notation. In: International Conference on Software Language Engineering, pp. 377–396. Springer (2010)
Granada, D., Vara, J.M., Bollati, V.A., Marcos, E.: Enabling the development of cognitive effective visual dsls. In: International Conference on Model Driven Engineering Languages and Systems, pp. 535–551. Springer (2014)
Green, T.R.G., Petre, M.: Usability analysis of visual programming environments: a cognitive dimensions framework. J. Vis. Lang. Comput. 7(2), 131–174 (1996)
Heß, M., Kaczmarek, M., Frank, U., Podleska, L., Täger, G.: A domain-specific modelling language for clinical pathways in the realm of multi-perspective hospital modelling. In: ECIS (2015)
Ivanov, V., Rogers, A., Succi, G., Yi, J., Zorin, V.: What do so ware engineers care about? gaps between research and practice. In: ESEC/FSE Industry Track (2017)
Kaindl, H., Brinkkemper, S., Bubenko Jr., J.A., Farbey, B., Greenspan, S.J., Heitmeyer, C.L., do Prado Leite, J.C.S., Mead, N.R., Mylopoulos, J., Siddiqi, J.: Requirements engineering and technology transfer: obstacles, incentives and improvement agenda. Requirements Eng. 7(3), 113–123 (2002)
Kleppe, A.: A language description is more than a metamodel. In: Fourth International Workshop on Software Language Engineering (ATEM 2007) (2007)
Krogstie, J., Sindre, G., Jørgensen, H.: Process models representing knowledge for action: a revised quality framework. Eur. J. Inf. Syst. 15(1), 91–102 (2006)
Lakhotia, A.: Understanding someone else’s code: Analysis of experiences. J. Syst. Softw. 23(3), 269–275 (1993)
van der Linden, D., Hadar, I.: Evaluating the evaluators. In: Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering, ENASE 2016, pp. 222–227. SCITEPRESS - Science and Technology Publications, Lda (2016). https://doi.org/10.5220/0005895802220227
van der Linden, D., Hadar, I.: User involvement in applications of the pon. In: International Conference on Advanced Information Systems Engineering, pp. 109–115. Springer (2016)
van der Linden, D., Hadar, I.: A systematic literature review of applications of the physics of notations. IEEE Trans. Softw. Eng. (2018). https://doi.org/10.1109/TSE.2018.2802910. Forthcoming
van der Linden, D., Hadar, I., Zamansky, A.: A framework for improving the verifiability of visual notation design grounded in the physics of notations. In: Requirements Engineering Conference (RE), 2017 IEEE International. IEEE
van der Linden, D., Van Zee, M.: Insights from a study on decision making in enterprise architecture. PoEM (Short Papers) 1497, 21–30 (2015)
van der Linden, D., Zamansky, A., Hadar, I.: How cognitively effective is a visual notation? on the inherent difficulty of operationalizing the physics of notations. In: International Workshop on Business Process Modeling, Development and Support, pp. 448–462. Springer (2016)
van der Linden, D., Zamansky, A., Hadar, I.: On the need for more requirements towards visual notation design of bpmn extensions. In: CAiSE Radar 2016, pp. 1–4. University of Ljubljana (2016)
van der Linden, D., Zamansky, A., Hadar, I.: A framework for improving the verifiability of visual notation design grounded in the physics of notations. In: IEEE 25th International Requirements Engineering Conference (2017)
Malavolta, I., Lago, P., Muccini, H., Pelliccione, P., Tang, A.: What industry needs from architectural languages: A survey. IEEE Trans. Softw. Eng. 39(6), 869–891 (2013)
Mendling, J., Reijers, H.A., van der Aalst, W.M.: Seven process modeling guidelines (7pmg). Inf. Softw. Technol. 52(2), 127–136 (2010)
Milton, S.K., Rajapakse, J., Weber, R.: Conceptual modeling in practice: An evidence-based process-oriented theory. In: Information and Automation for Sustainability (ICIAFs), 2010 5th International Conference on, pp. 533–536. IEEE (2010)
Moody, D.: Review of archimate: The road to international standardisation. Report commissioned by the ArchiMate Foundation and BiZZDesign BV, Enschede, The Netherlands 77 (2007)
Moody, D., van Hillegersberg, J.: Evaluating the visual syntax of uml: An analysis of the cognitive effectiveness of the uml family of diagrams. In: International Conference on Software Language Engineering, pp. 16–34. Springer (2008)
Moody, D.L.: The physics of notations: Toward a scientific basis for constructing visual notations in software engineering. Ieee Transactions on Software Engineering 35(6), 756–779 (2009). https://doi.org/10.1109/TSE.2009.67. \(<\)GotoISI\(>\)://WOS:000272172800003
Muller, P.A., Fleurey, F., Fondement, F., Hassenforder, M., Schneckenburger, R., Grard, S., Jzquel, J.M.: Model-driven analysis and synthesis of concrete syntax. In: International Conference on Model Driven Engineering Languages and Systems, pp. 98–110. Springer (2006)
Myers, M.D.: Qualitative research in information systems. Manag. Inf. Syst. Q. 21(2), 241–242 (1997)
(OMG), O.M.G.: Unified modeling language (uml), version 2.5 (2015). http://www.omg.org/spec/UML/2.5/. Accessed 28 Feb 2014
(OMG), O.M.G.: Meta object facility (mof) version 2.5.1 (2016). http://www.omg.org/spec/MOF/2.5.1/. Accessed 28 Feb 2014
Recker, J.: modeling with tools is easier, believe me—the effects of tool functionality on modeling grammar usage beliefs. Inf. Syst. 37(3), 213–226 (2012)
Reijers, H.A., Mendling, J.: A study into the factors that influence the understandability of business process models. IEEE Trans. Syst. Man Cybern-Part A: Syst. Hum. 41(3), 449–462 (2011)
Saldana, J.: The coding manual for qualitative researchers. Sage, Beverly Hills (2015)
Schuette, R., Rotthowe, T.: The guidelines of modeling–an approach to enhance the quality in information models. In: International Conference on Conceptual Modeling, pp. 240–254. Springer (1998)
Störrle, H., Fish, A.: Towards an operationalization of the physics of notations for the analysis of visual languages. In: International Conference on Model Driven Engineering Languages and Systems, pp. 104–120. Springer (2013)
Vessey, I.: Cognitive fit: a theory-based analysis of the graphs versus tables literature. Decis. Sci. 22(2), 219–240 (1991)
Wanderley, F., Silva, A., Araujo, J., Silveira, D.S.: Snapmind: A framework to support consistency and validation of model-based requirements in agile development. In: Model-Driven Requirements Engineering Workshop (MoDRE), 2014 IEEE 4th International, pp. 47–56. IEEE (2014)
Wiebring, J., Sandkuhl, K.: Selecting the right notation for business process modeling: experiences from an industrial case. In: International Conference on Business Informatics Research, pp. 129–144. Springer (2015)
Wieringa, R.J., Heerkens, J.M.: The methodological soundness of requirements engineering papers: a conceptual framework and two case studies. Requirements Eng. 11(4), 295–307 (2006)
Wilmont, I., Hengeveld, S., Barendsen, E., Hoppenbrouwers, S.: Cognitive mechanisms of conceptual modelling. In: International Conference on Conceptual Modeling, pp. 74–87. Springer (2013)
Zur Muehlen, M., Recker, J.: How much language is enough? theoretical and practical use of the business process modeling notation. In: Seminal Contributions to Information Systems Engineering, pp. 429–443. Springer (2013)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Dr. Iris Reinhartz-Berger, Wided Guédria, and Palash Bera.
Appendices
Appendices
A Survey structure
B Correlations between requirements and demographics
C Delta between requirements toward modeling expert and non-expert use
Rights and permissions
About this article
Cite this article
van der Linden, D., Hadar, I. & Zamansky, A. What practitioners really want: requirements for visual notations in conceptual modeling. Softw Syst Model 18, 1813–1831 (2019). https://doi.org/10.1007/s10270-018-0667-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10270-018-0667-4