Abstract
Deaf pilots in France are currently allowed to fly planes with the help of a second pilot handling voice and radio communication. Yet they are not allowed to pilot independently. Fans4All is an association that aims at making aeronautics more accessible to pilots who are hearing or speech impaired (HSI). In this paper we present our experience as a multidisciplinary design team (including two HSI pilots) working towards this goal. We present current and past steps to develop a Multimodal Sensory Communication Device (MSCD) composed of a touchscreen tablet and a haptic jacket, as well as the visual vocabulary to define messages between HSI pilots and air traffic controllers. Moreover, we present our approach combining quantitative and qualitative methods for evaluation. We hope that our work will help to make aeronautics more accessible to people with impairments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We use the term HSI instead of DHH (deaf or hard of hearing) because FANS4all project is also directed at people/pilots with speech difficulties.
References
Bougnoux, D.: Introduction aux sciences de la communication. La Découverte, Paris (2001)
Bragg, D., Caselli, N., Hochgesang, J.A., Huenerfauth, M., Katz-Hernandez, L., et al.: The FATE landscape of sign language AI datasets: an interdisciplinary perspective. ACM Trans. Access. Comput. 14(2), 1–45 (2021). Article 7
Brewster, S.A., Brown, L.M.: Non-visual information display using tactons. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria, 24–29 April 2004, pp. 787–788 (2004)
Brock, A., Classe, C., Duphil, L., Fabas, F., Guigo, L., et al.: Making ATIS accessible for pilots who are deaf or hard of hearing. In: ICCAS 2022 - International Conference on Cognitive Aircraft Systems, Toulouse, France, 1–2 June 2022 (2022)
Brock, H., Law, F., Nakadai, K., Nagashima, Y.: Learning three-dimensional skeleton data from sign language video. ACM Trans. Intell. Syst. Technol. 11, 30 (2020)
Brooke, J.: SUS-a quick and dirty usability scale. In: Usability Evaluation in Industry, 1st edn. CRC Press (1996)
Endsley, M.R.: Design and evaluation for situation awareness enhancement. In: Proceedings of the Human Factors Society Annual Meeting, vol. 32, no. 2, pp. 97–101 (1988)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 139–183. North-Holland (1988)
Hutchins, E., Klausen, T.: Distributed cognition in an airline cockpit. In: Engeström, Y., Middleton, D. (eds.) Cognition and Communication at Work, pp. 15–34. Cambridge University Press, Cambridge (1996)
Jain, D., Chiu, B., Goodman, S., Schmandt, C., Findlater, L., et al.: Field study of a tactile sound awareness device for deaf users. In: Proceedings of the 2020 International Symposium on Wearable Computers, Virtual Event Mexico, 12–16 September 2020, pp. 55–57 (2020)
Jain, D., Junuzovic, S., Ofek, E., Sinclair, M., Porter, J., et al.: A taxonomy of sounds in virtual reality. In: Designing Interactive Systems Conference 2021 (DIS 2021), pp. 160–170. Association for Computing Machinery, New York (2021)
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó.I., Balan, O., Spagnol, S., et al.: Designing sensory-substitution devices: principles, pitfalls and potential 1. Restorative Neurol. Neurosci. 34, 769–787 (2016)
Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7(1), 57–78 (1995)
Selcon, S.J., Taylor, R.M.: Evaluation of the situational awareness rating technique (SART) as a tool for aircrew systems design. In: AGARD, Situational Awareness in Aerospace Operations, 8 p (SEE N 90-28972 23-53) (1990)
Shinar, D., Vogelzang, M.: Comprehension of traffic signs with symbolic versus text displays. Transport. Res. F Traffic Psychol. Behav. 18, 72–82 (2013)
Theureau, J.: Les entretiens d’autoconfrontation et de remise en situation par les traces matérielles et le programme de recherche «cours d’action». Revue D’anthropologie des Connaissances 4, 287–322 (2010)
Valéry, B., Scannella, S., Peysakhovich, V., Barone, P., Causse, M.: Can an aircraft be piloted via sonification with an acceptable attentional cost? A comparison of blind and sighted pilots. Appl. Ergon. 62, 227–236 (2017)
Velichkovsky, B., Sprenger, A., Unema, P.: Towards gaze-mediated interaction: collecting solutions of the “Midas touch problem.” In: Howard, S., Hammond, J., Lindgaard, G. (eds.) Human-Computer Interaction INTERACT ’97. ITIFIP, pp. 509–516. Springer, Boston (1997). https://doi.org/10.1007/978-0-387-35175-9_77
Weick, K.E., Sutcliffe, K.M., Obstfeld, D.: Organizing and the process of sensemaking. Organ. Sci. 16, 409–421 (2005)
Wood, J.R., Wood, L.E.: Card sorting: current practices and beyond. J. Usability Stud. 4(1), 1–6 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lounis, C. et al. (2023). Towards a Multidisciplinary Approach for Designing Multimodal Sensory Communication Devices for Aeronautics. In: Goodman-Deane, J., Dong, H., Heylighen, A., Lazar, J., Clarkson, J. (eds) Design for Sustainable Inclusion. CWUAAT 2023. Springer, Cham. https://doi.org/10.1007/978-3-031-28528-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-28528-8_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28527-1
Online ISBN: 978-3-031-28528-8
eBook Packages: EngineeringEngineering (R0)