Abstract
Interaction design is considered important for achieving usable Web user interfaces. Communicative acts as abstractions from speech acts can model basic building blocks (‘atoms’) of communication, like a question or an answer. When, e.g., a question and an answer are glued together as a so-called adjacency pair, a simple ‘molecule’ of a dialogue is modeled. Deliberately complex discourse structures can be modeled using relations from Rhetorical Structure Theory (RST). The content of a communicative act can refer to ontologies of the domain of discourse. Taking all this together, we created a new discourse metamodel that specifies what discourse models may look like. Such discourse models can specify an interaction design. Since manual creation of user interfaces is hard and expensive, automated generation may become more and more important. This tutorial also demonstrates how such an interaction design can be used for automated Web GUI generation. This is based on model-transformation rules according to the model-driven architecture. Based on AI optimization techniques, the graphical user interfaces (GUIs) are automatically tailored to a device such as a smartphone according to a given device specification. Since the usability of fully-automatically generated GUIs is still not satisfactory, unique customization techniques are employed as well. We also address low-vision accessibility of Web-pages, by combining automated design-time generation of Web-pages with responsive design for improving accessibility.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bogdan, C., et al.: Generating an abstract user interface from a discourse model inspired by human communication. In: Proceedings of the 41st Hawaii International Conference on System Sciences (HICSS 2008), Waikoloa, Big Island, Hawaii. IEEE (2008)
Bogdan, C., Kaindl, H., Falb, J., Popp, R.: Modeling of interaction design by end users through discourse modeling, In: Proceedings of the 2008 ACM International Conference on Intelligent User Interfaces (IUI 2008), Maspalomas, Gran Canaria, Spain. ACM Press (2008)
Falb, J., Kaindl, H., Horacek, H., Bogdan, C., Popp, R., Arnautovic, E.: A discourse model for interaction design based on theories of human communication. In: CHI’06 Extended Abstracts on Human Factors in Computing Systems, pp. 754–759, ACM Press (2006)
Falb, J., Kavaldjian, S., Popp, R., Raneburger, D., Arnautovic, E., Kaindl, H.: Fully automatic user interface generation from discourse models. In: Proceedings of the 2009 ACM International Conference on Intelligent User Interfaces (IUI 2009). ACM Press (2009). Tool demo paper
Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: Using communicative acts in interface design specifications for automated synthesis of user interfaces. In: Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering (ASE 2006), pp. 261–264 (2006)
Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: UI prototyping for multiple devices through specifying interaction design. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 136–149. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74796-3_15
Kaindl, H., Popp, R., Raneburger, D.: Alternative interaction design patterns for automated GUI generation from discourse-based communication models. In: Proceedings of the 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC 2014), San Diego, CA, USA. IEEE (2014)
Kavaldjian, S., Bogdan, C., Falb, J., Kaindl, H.: Transforming Discourse Models to Structural User Interface Models, Models in Software Engineering, MoDELS 2007 Workshops, LNCS 5002, pp. 77–88. Springer-Verlag, Berlin-Heidelberg (invited) (2008)
Kavaldjian, S., Falb, J., Kaindl, H.: Generating content presentation according to purpose. In: Proceedings of the 2009 IEEE International Conference on Systems, Man and Cybernetics (SMC 2009), San Antonio, TX, USA. IEEE (2009)
Popp, R., Falb, J., Raneburger, D., Kaindl, H.: A transformation engine for model-driven UI generation. In: Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2012), Copenhagen, Denmark (2012)
Popp, R., Kaindl, H., Badalians Gholi Kandi, S., Raneburger, D., Paterno, F.: Duality of task- and discourse-based interaction design for GUI generation. In: Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC 2014), pp. 3323–3328 (2014)
Popp, R., Kaindl, H., Raneburger, D.: Connecting interaction models and application logic for model-driven generation of web-based graphical user interfaces. In: Proceedings of the 20th Asia-Pacific Software Engineering Conference (APSEC 2013). ACM (2013)
Popp, R., Raneburger, D., and Kaindl, H.: Tool support for automated multi-device GUI generation from discourse-based communication models. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2013) (2013)
Raneburger, D., Alonso-Ríos, D., Popp, R., Kaindl, H., Falb, J.: A user study with GUIs tailored for smartphones. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 505–512. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40480-1_34
Raneburger, D., Kaindl, H., Popp, R.: Strategies for automated GUI tailoring for multiple devices. In: Proceedings of the 48st Annual Hawaii International Conference on System Sciences (HICSS-48) (2015)
Raneburger, D., Kaindl, H., Popp, R.: Model transformation rules for customization of multi-device graphical user interfaces. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2015), pp. 100–109 (2015)
Raneburger, D., Kaindl, H., Popp, R., Šajatovic, V., Armbruster, A.: A process for facilitating interaction design through automated GUI generation. In: Proceedings of the 29th ACM/SIGAPP Symposium on Applied Computing (SAC 2014) (2014)
Raneburger, D., Popp, R., Kaindl, H.: Model-driven transformation for optimizing PSMs: a case study of rule design for multi-device GUI generation. In Proceedings of the 8th International Joint Conference on Software Technologies (ICSOFT 2013). SciTePress (2013)
Raneburger, D., Popp, R., Kaindl, H.: A user study to evaluate the customization of automatically generated GUIs. In: Black, N.L., Neumann, W.P., Noy, I. (eds.) IEA 2021. LNNS, vol. 223, pp. 683–690. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-74614-8_85
Raneburger, D., Popp, R., Kaindl, H., Armbruster, A., Šajatović, V.: An iterative and incremental process for interaction design through automated GUI generation. In: Kurosu, M. (ed.) HCI 2014. LNCS, vol. 8510, pp. 373–384. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07233-3_35
Raneburger, D., Popp, R., Kaindl, H., Falb, J.: Automated WIMP-UI behavior generation: parallelism and granularity of communication units. In: Proceedings of the 2011 IEEE International Conference on Systems, Man and Cybernetics (SMC 2011), pp. 2816–2821 (2011)
Raneburger, D., Popp, R., Kaindl, H., Falb, J., Ertl, D.: Automated generation of device-specific WIMP-UIs: weaving of structural and behavioral models. In: Proceedings of the 2011 SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2011) (2011)
Rathfux, T., Popp, R., Kaindl, H.,: Adding custom widgets to model-driven GUI generation. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2016), Brussels, Belgium (2016)
Rathfux, T., Thöner, J., Kaindl, H., Popp, R.: Combining design-time generation of web-pages with responsive design for improving low-vision accessibility. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2018), Paris (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kaindl, H. (2023). Automated Web GUI Generation from High-Level Interaction Design with Discourse Models. In: Garrigós, I., Murillo Rodríguez, J.M., Wimmer, M. (eds) Web Engineering. ICWE 2023. Lecture Notes in Computer Science, vol 13893. Springer, Cham. https://doi.org/10.1007/978-3-031-34444-2_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-34444-2_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34443-5
Online ISBN: 978-3-031-34444-2
eBook Packages: Computer ScienceComputer Science (R0)