Abstract
Mobile device use is omnipresent in everyday life spawning design to account for the increased complexity and diversity of “Situationally Induced Impairments and Disabilities (SIID)”. Although SIIDs frequently impact interactions, little research has attempted to provide generalizable guidance supporting users when these events occur. Situational impairment events may produce challenges similar to those faced by users with Health Induced Impairments and Disabilities. This study conducted an exhaustive literature review from Assistive Technology and Accessibility research and parallel domains, and found that existing guidance on designing for “impairments” can inform designing for “temporary” impairments created by the mobile interaction context. Guidance identified was validated by a panel of mobile interaction experts with a novel adaptation of the consensus-seeking approach known as the Delphi method. This research presents preliminary guidelines to support mobile interface designers and researchers to better recognize and effectively account for the new complexity present during mobile interaction.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Additional discovery becomes redundant, reasonably assuring further data collection would only yield similar results [12]
The IQR is an alternative measure of variance that is the result of the subtraction of the 3rd quartile from the 1st quartile value. This measure has been used by some Delphi studies like Chen [7] that employed Likert Scale rating as an alternative measure of variance to standard deviation. IQR has an advantage over standard deviation in that it is unaffected by extreme outliers. It is for this reason that the researchers chose this measure of variance for the present study.
When referring to final set of 26 guidelines, we use the numbering applied to the original 49 of the unique draft guidelines first offered to the expert panel for review and validation.
References
Abdolrahmani, A., Kuber, R., Hurst, A.: An empirical investigation of the situationally-induced impairments experienced by blind mobile device users. Paper presented at 13th web for all conference (W4A '16), Montreal, QC Canada, 21:1–21:8 (2016)
Al-Ismail, M., Sajeev, A. : Usability challenges in mobile web. Presented at 2014 IEEE international conference on communication, networks and satellite (COMNETSAT), Jakarta: IEEE, pp 50–55 (2014)
Anthony, L., Kim, Y., Findlater, L.: Analyzing user-generated youtube videos to understand touchscreen use by people with motor impairments. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '13), Paris, France, pp. 1223–1232 (2013)
Barnard, L., Yi, J., Jacko, J.A., Sears, A.: Capturing the effects of context on human performance in mobile. Pers. Ubiquit. Comput. 11(2), 81–96 (2007)
Biolchini, J.C., Mian, P.G., Natali, A.C., Conte, T.U., Travassos, G.H.: Scientific research ontology to support systematic review in software engineering. Adv. Eng. Inform. 21(2), 133–151 (2007)
Bright, A.K., Coventry, L.: Assistive technology for older adults: psychological and socio-emotional design requirements. In: Proceedings of the 6th international conference on pervasive technologies related to assistive environments, pp. 1–4 (2013)
Chen, Y.: Exploring design guidelines of using user-centered design in gamification development: a Delphi study. Int. J. Hum. Comput. Interact. 35(13), 1170–1181 (2019). https://doi.org/10.1080/10447318.2018.1514823
Costa, L.C., Ficheman, I.K., Correa, A.G., Lopes, R.D., Zuffo, M.K.: Accessibility in digital television: designing remote controls. IEEE Trans. Consum. Electron. (2012). https://doi.org/10.1109/TCE.2012.6227466
Dey, A.K., Abowd, G.D., Salber, D.: A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum. Comput. Interact. 16, 97–166 (2001)
Dillman, D.A.: Mail and Internet surveys: The tailored design method–2007 Update with new Internet, visual, and mixed-mode guide. Wiley (2011)
Economou, D., Gavalas, D., Kenteris, M., Tsekouras, G.: Cultural applications for mobile devices: issues and requirements for authoring tools and development platforms. Mob. Comput. Commun. Rev. (2008). https://doi.org/10.1145/1462141.1462145
Faulkner, S.L., Trotter, S.P.: Theoretical saturation. The International Encyclopedia of Communication Research Methods, pp. 1–2 (2017)
Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47(6), 381–391 (1954)
Goel, M., Findlater, L., Wobbrock, J.: WalkType: using accelerometer data to accommodate situational impairments in mobile touch screen text entry. In: Proceedings of the SIGCHI conference on human factors in computing systems, Austin, Texas USA: ACM, pp. 2687–2696 (2012)
Groenewald, C., Anslow, C., Islam, J., Rooney, C., Passmore, P., Wong, W.: Understanding 3D mid-air hand gestures with interactive surfaces and displays: a systematic literature review. In: Proceedings of the 30th international BCS human computer interaction conference: Fusion!, Poole, United Kingdom, pp. 43:1–43:13 (2016)
Holsapple, C.W., Joshi, K.D.: Knowledge manipulation activities: results of a Delphi study. Inf. Manag. 39, 477–490 (2002). https://doi.org/10.1016/S0378-7206(01)00109-4
Inostroza, R., Rusu, C.: Mapping usability heuristics and design principles for touchscreen-based mobile devices. In: Proceedings of the 7th Euro American Conference on telematics and information systems, pp. 1–4 (2014)
Jarl, G., Lundqvist, L.O.: An alternative perspective on assistive technology: the person–environment–tool (PET) model. Assist. Tech. 32(1), 47–53 (2020)
Kane, S.K., Wobbrock, J.O., Smith, I.E.: Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces. In: Proceedings of the 10th international conference on human computer interaction with mobile devices and services, pp. 109–118 (2008)
Kascak, L.R., Rebola, C.B., Sanford, J.A.: Integrating Universal Design (Ud) principles and mobile design guidelines to improve design of mobile health applications for older adults. In: 2014 IEEE international conference on healthcare informatics, pp. 343–348 (2014)
Keil, M., Cule, P.E., Lyytinen, K., Schmidt, R.C.: A framework for identifying software project risks. Commun. ACM 41, 76–83 (1998). https://doi.org/10.1145/287831.287843
Kurniawan, S., Zaphiris, P.: Research-derived web design guidelines for older people. In: Proceedings of the 7th international ACM SIGACCESS conference on computers and accessibility, pp. 129–135 (2005)
La, H.J., Lee, H.J., Kim, S.D.: An efficiency-centric design methodology for mobile application architectures. In: 2011 IEEE 7th international conference on wireless and mobile computing, networking and communications (WiMob), pp. 272–279 (2011)
Linstone, H.A., Turoff, M., et al.: The Delphi method. Addison-Wesley, MA (1975)
Lyons, K., Profita, H.: The multiple dispositions of on-body and wearable devices. IEEE Pervasive Comput. 13, 24–31 (2014)
Marshall, J., Tennent, P.: Mobile Interaction does not Exist. Chi ’13 Extended Abstracts on Human Factors in Computing Systems, pp. 2069–2078. France, Paris (2013)
Morales, L., Arteaga, S.M., Kurniawan, S.: Design Guidelines of a Tool to Help Blind Authors Independently Format their Word Documents. CHI ’13 Extended Abstracts on Human Factors in Computing Systems, pp. 31–36 (2013)
Nemésio, F.D., Barbosa, E.F.: A requirements catalog for mobile learning environments. In: Proceedings of the 28th annual ACM symposium on applied computing, pp. 1266–1271 (2013)
Nicolau, H.: Disabled’R’All: bridging the gap between health and situational induced impairments and disabilities. ACM SIGACCESS Access. Comput. 102, 21–24 (2012)
Norman, D. A.: The design of everyday things. Basic Books (1988)
Oh, U., Findlater, L.: Design of and subjective response to on-body input for people with visual impairments. In: Proceedings of the 16th international ACM SIGACCESS conference on computers & accessibility, pp. 115–122 (2014)
Okoli, C., Pawlowski, S.D.: The Delphi method as a research tool: an example, design considerations and applications. Inf. Manag. 42, 15–29 (2004)
Okoshi, T., Tsubouchi, K., Taji, M., Ichikawa, T., Tokuda, H.: Attention and engagement-awareness in the wild: a large-scale study with adaptive notifications. In: 2017 IEEE international conference on pervasive computing and communications (PerCom), Kona, HI, pp. 100–110 (2017)
Oliver, E., Keshav, S.: Design Principles for Opportunistic Communication in Constrained Computing Environments, 31–36 (2008)
Paliwoda, S.J.: Predicting the future using Delphi. Manag. Decis. 21, 31–38 (1983)
Pantonial, C.M., Cornelio, C.S.: Accessibility design for enterprise touchscreen printers. In: 2017 IEEE International Symposium on Technology and Society (ISTAS), pp. 1–7 (2017)
Piccolo, L.S., De Menezes, E.M., De Campos Buccolo, B.: Developing an accessible interaction model for touch screen mobile devices: preliminary results. In: Proceedings of the 10th Brazilian symposium on human factors in computing systems and the 5th Latin American conference on human-computer interaction, pp. 222–226 (2011)
Quinones, P.A., Greene, T., Yang, R., Newman, M.: Supporting visually impaired navigation: a needs-finding study. In: CHI'11 Extended Abstracts on Human Factors in Computing Systems, pp. 1645–1650 (2011)
Sarsenbayeva, Z., Goncalves, J., Garcia, J., Klakegg, S., Rissanen, S., Rintamäki, H., Kostakos, V., et al.: Situational impairments to mobile interaction in cold environments. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing (UbiComp '16), Heidelberg, Germany, pp. 85–96 (2016)
Sarsenbayeva, Z., van Berkel, N., Luo, C., Kostakos, V., Goncalves, J.: Challenges of situational impairments during interaction with mobile devices. In: Proceedings of the 29th Australian conference on computer-human interaction, Association for Computing Machinery, (2017)
Sarsenbayeva, Z., van Berkel, N., Velloso, E., Kostakos, V., Goncalves, J.: Effect of Distinct Ambient Noise Types on Mobile Interaction. Proc.ACM Interact. Mob. Wearable Ubiquitous Technol. 2(2), 1–23 (2018)
Saulynas, S.A., Kuber, R.: Understanding and supporting individuals experiencing severely constraining situational impairments. Univ. Access Inf. Soc. (2019). https://doi.org/10.1007/s10209-019-00705-7
Saulynas, S., Burgee, L.E., Kuber, R.: All situational impairments are not created equal: a classification system for situational impairment events and the unique nature of severely constraining situational impairments. In: iConference 2017 Proceedings (2017)
Schmidt, R.C.: Managing Delphi surveys using nonparametric statistical techniques. Decis. Sci. 28, 763–774 (1997)
Schulze, F., Woerndl, W.: Using touch gestures to adjust context parameters in mobile recommender and search applications. In: 2011 international conference on collaboration technologies and systems (CTS), pp. 389–396 (2011)
Sears, A., Jacko, J., Xiao, Y.: When computers fade: pervasive computing and situationally induced impairments and disabilities. In: Proceedings of HCI international, pp. 1298–1302 (2003)
Sehic, S., Nastic, S., Vögler, M., Li, F., Dustdar, S.: Entity-adaptation: a programming model for development of context-aware applications. In: Proceedings of the 29th annual ACM symposium on applied computing, pp. 436–443 (2014)
Sierkowski, B.: Achieving web accessibility. In: Proceedings of the 30th annual ACM SIGUCCS conference on user services, pp. 288–291 (2002)
Spencer, J., Inventor: Bulk resistive glove. United States patent US 8,605,049. (2013)
Sulaiman, S., Saei, S.N., Mean, F.O., Hasbullah, H.: Understanding domain expert's perspectives and expectations in assistive technology. 2010 international symposium on information technology, 3, pp. 1164–1167 (2010)
Thangaratinam, S., Redman, C.W.: The Delphi technique. Obstet. Gynaecol. 7(2), 120–125 (2005)
Tigwell, G.W., Flatla, D.R., Menzies, R.: It's not just the light: understanding the factors causing situational visual impairments during mobile interaction. In: Proceedings of the 10th Nordic conference on human-computer interaction (NordCHI '18), Oslo, Norway: ACM, pp. 388–351 (2018)
Tung, Y.-C., Goel, M., Zinda, I., Wobbrock, J.O.: RainCheck: overcoming capacitive interference caused by rainwater on smartphones. In: Proceedings of the 2018 on international conference on multimodal interaction (ICMI '18), Boulder, CO, USA, pp. 464–471 (2018)
University of Michigan: Battery breakthrough: Doubling performance with lithium metal that doesn't catch fire: Longer-lasting drop-in replacements for lithium ion could be on the horizon. ScienceDaily. (15 August 2018). https://www.sciencedaily.com/releases/2018/08/180815124000.htm
van Biljon, J., Renaud, K.: Validating mobile phone design guidelines: focusing on the elderly in a developing country. In: Proceedings of the annual conference of the South African Institute of Computer Scientists and Information Technologists, pp. 1–10 (2016)
Veloso, A., Costa, L.: Heuristics for designing digital games in assistive environments: applying the guidelines to an ageing society. In: 1st international conference on technology and innovation in sports, health and wellbeing (TISHW), pp. 1–8 (2016)
Wang, G., Suh, A.: Disorder or driver?: The effects of nomophobia on work-related outcomes in organizations. In: Proceedings of the 2018 CHI conference on human factors in computing systems (2018)
Wentzel, J., Velleman, E., Van der Geest, T.: Developing accessibility design guidelines for wearables: accessibility standards for multimodal wearable devices. In: Antona, M., Stephanidis, C. (eds.) Universal Access in Human-Computer Interaction: Methods, Techniques, and Best Practices, pp. 109–119. Springer, Cham (2016)
Wijenayake, S.: Understanding the dynamics of online social conformity. In: conference companion publication of the 2020 on computer supported cooperative work and social computing, pp. 189–194 (2020)
Wobbrock, J.O.: The future of mobile device research in HCI. In: CHI 2006 workshop proceedings: what is the next generation of human-computer interaction, pp. 131–134 (2006)
Wobbrock, J.O., Kane, S.K., Gajos, K.Z., Harada, S., Froehlich, J.: Ability-based design: concept, principles and examples. ACM Trans. Access. Comput. (TACCESS) 3(3), 1–27 (2011)
York, C.S., Ertmer, P.A.: Towards an understanding of instructional design heuristics: an exploratory Delphi study. Educ. Tech. Research Dev. 59, 841–863 (2011)
Zhang, L., Tiwana, B., Qian, Z., Wang, Z., Dick, R.P., Mao, Z.M., Yang, L.: Accurate online power estimation and automatic battery behavior based power model generation for smartphones. In: Proceeding of international conference on hardware/software codesign and system synthesis, pp. 105–114 (2010)
Acknowledgements
The authors wish to acknowledge the assistance of Dr. Jobke Wentzel for her input to this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1
See Table
11.
Severely Constraining Situational Impairments (SCSI) An occurrence of a situational impairment where a workaround is not available/easily obtained, or where a technological solution was found that only led to the introduction of a new situational impairment and disability.
1.1 Characteristics/types of SCSI
“Super” situational impairment event Multiple impairment events combined in a single transaction (e.g., “Thought of something I wanted to search the web for while I was cutting grass, but couldn't use phone because it was too bright out and couldn't use Siri because it was too noisy- By the time I reached a shady area, I ended up forgetting what the task was.”)
Expiration of transaction “Half-Life” The value of a transaction becomes zero before conditions conducive to transaction completion can be achieved. (e.g., A SMS is received (and unattended) while in a store. The text is read upon returning from the store and was a request from the spouse to purchase an item.)
Solution to one SIID produces new SIID An existing design solution to an SIID creates a new and different SIID (e.g., voice input can overcome hand encumbrance, but not necessarily if that input contains information that cannot be disseminated in public)
Competing modal transactions Common communication channel needed for competing modal transactions (e.g., “GPS navigation in car interrupted by telephone call.”)
Pre-abandonment Transaction voluntarily terminated due to [a] concern over the violation of certain contextual social/cultural norms, or [b] past history leads user to not make transaction attempt (e.g., “Operation to get files from a secured ‘cloud’ service, download them to my phone with an app, then upload them to a web service is simply too cumbersome to do on the phone... If even possible at all…”)
Appendix 2
See Table
12.
Appendix 3
The table below displays 26 final guidelines validated by the expert panel. The topic areas of the sources primarily used to create the guideline are shown in the third column. The last column shows the theme(s) from Saulynas et al. [43] that each guideline was mapped to.
Original numbering for guidelines | Guideline | Source topic area(s) | Mapped theme(s) from Saulynas et al. [43] |
|---|---|---|---|
1 | A system should read “the right thing, at the right time, and at the right pace” (e.g., shield users from unimportant minutiae, smart asynchronous notifications for managing interruptions, or correcting automatically transcribed texts) | Mobile visual display/visual impairments | Complexity/social- cultural/SCSI |
2 | Access should be guaranteed by different input methods (e.g., keyboards, simulators, switches, mouth pointers and head pointers) with attention to particular users’ needs and strengths | Cognitive impairments/web accessibility | Ambient-environmental/workspace-location/SCSI |
4 | Account for the fact that users may engage in distracting activities because they may not realize that their performance is degraded or overconfident in their ability to deal with distractions while engaged in the primary activity | Distractive driving | Complexity |
5 | Any function designed for the adaptation to the variable contexts and environments must function in real-time and as a background task without altering the normal operation and use | Visual impairments/SIID in cold environments | SCSI |
8 | Avoid distractions (i.e., blinking images) and discourage unconscious action in tasks that require vigilance | UD and designing for older adults | Complexity |
9 | Avoid gestures needing precision, large areas to perform, or cause physical pain after prolonged use | Motor impairments/hearing impairments | Workspace-location |
11 | Avoid touch input that is too sensitive (prevent accidental presses) and tackle the fear of accidentally initiated commands | Designing for older adults | Ambient-environmental |
12 | Avoid two-handed, multiple-finger interaction | Accessibility | Workspace-location |
13 | Connect with different communications and data networks to ensure high availability of services | Mobile services in unstable environments | Technical |
14 | Connectivity and power issues should be transparent for the end-user. Use automatic logging as an efficient way to obtain continuous battery information and highlight/educate the user regarding their battery life limitations and performance improvements | Shared workspace accessibility/smartphone energy efficiency | Technical |
19 | Design features to reduce contextual stress. (e.g., facilitate the ease of safety check-ins, users locating one another, and compensate for lack of communication synchronicity) | Cognitive impairments | SCSI |
20 | Design flexible limits for task completion and warnings/feedback should stay on the screen as long as the user does not respond to them | Accessibility | Complexity/social-cultural/SCSI |
21 | Design technology such that it poses little burden/encumbrance (i.e., reducing the need for resources such as hands or storage areas like a coat pocket) | Visual impairments | Workspace-location |
22 | Detect breakpoints (when the user is not actively manipulating the device) using additional sensors, such as GPS, accelerometer, proximity and light sensors | Interruption notification on smartphones | Complexity |
23 | Device should be easy to recharge via a cradle rather than a plug | Designing for older adults | Technical |
24 | Employ a simple and universal external mechanism to provide power for phone (e.g., implemented in a carry bag or in a coat pocket) making it accessible | Capacitive touch input on clothing | Technical |
25 | Ensure the AI system’s language and behaviors do not reinforce undesirable and unfair stereotypes and biases | Human-AI interaction | Social-cultural |
26 | Explicitly distinguish between periods of active use and passive use, then use the passive periods to conduct power and data intensive operations | Communication in constrained computing environments | Technical |
27 | For any given task the design should specify which modalities are appropriate for each context and offer additional value to users that are not directly interacting with the screen | Adaptive multi-modal mobile input | Ambient-environmental |
29 | In highly demanding situations, the user should be saved from overload by either oppressing or delaying non-important information | In-Vehicle device interaction | Complexity/SCSI |
33 | Low energy consuming localization methods should be used as substitute for power hungry localization techniques (e.g., GPS) | Smartphone energy efficiency | Technical |
36 | Minimize the number of steps and consider simple movement (e.g., clicking) over complex movements (e.g., dragging, drawing certain shapes). Also, interaction based on tap length (invoking different functionality on long tap) should be avoided | Accessible mouse-based widgets/designing for older adults/ nose-based interaction | Complexity/workspace-location |
39 | Passively identify potential situational impairment events so that the device can react independently of users’ direct feedback | SIID in cold environments | SCSI |
41 | Provide subtle feedback, such as vibration from within a pocket, or personal audio, in situations where individuals are hesitant to carry their devices in public | Visual impairments | Social-cultural |
45 | Under certain ambient conditions (e.g., extreme cold) account for reduced accuracy (e.g., offset skew) in target acquisition, particularly in one-handed interaction | SIID in cold environments | Ambient-environmental |
48 | When in motion, users can query the system using voice, when not in motion, users can interact with the system using tabs and gestures | Visual impairments | Workspace-location |
Rights and permissions
About this article
Cite this article
Saulynas, S., Burgee, L., Bendigeri, A. et al. Putting situational impairments in context: developing guidance for situational impairments and severely constraining situational impairments by examining parallel domains. Univ Access Inf Soc 21, 941–966 (2022). https://doi.org/10.1007/s10209-021-00811-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-021-00811-5