Abstract
Human performance modeling (HPM) has been effective for determining crew designs. Crew design includes determining the number of operators needed, the role of automation, and member task responsibilities required to operate a system. Crew models are built for target systems under development to better inform the design and the needs of each operator’s user interface. This is a Verification and Validation (V&V) challenge—it is difficult to obtain metrics to validate a model when the completed system does not yet exist for obtaining sample measures. This paper addresses the challenge with an implementation of the V&V approach applying it to an HPM that successfully received V&V Accreditation for a large United States Air Force (USAF) command and control system. This paper then compares the results of the validated model with NASA TLX workload metrics and discusses the V&V effectiveness. Finally, it recommends better methods for V&V for human performance models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wickens, C., Goh, J., Helleberg, J., Horrey, W., Talleur, D.: Attentional models of multitask pilot performance using advanced display technology. Hum. Factors 45, 360–380 (2003)
Wickens, C., Hollands, J.: Engineering Psychology and Human Performance, 3rd edn. Pearson Publishing, New York (1999)
Armstrong, S., Brewer, W., Steinberg, R.: Usability testing. In: O’ Brien and Charlton (eds.) Handbook of Human Factors Engineering Methods (2001)
Yerkes, R., Dodson, J.: The relation of strength of stimulus to rapidity of habit formation. J. Comparative Neurol. Psychol. 18, 459–482 (1908)
Matthews, G., Reineman-Jones, L.: Workload Assessment: How to Diagnose Workload Issues and Enhance Performance, Santa Monica (2017)
Parasuraman, R., Mouloua, M.: Automation and Human Performance. Erlbaum, Mahwah (1994)
Endsley, M.R., Kiris, E.O.: The out-of the loop performance problem and level of control in automation. Hum. Factors 37(2), 381–394 (1995)
United States Air Force Instruction 16-1001. Verification, Validation and Accreditation (VV&A), June 2016
Plotkin, N., Imhoff, S., Gililland, W.: VV&A of Models and Simulations: The Power of Independent Cumulative Analysis. Raytheon Company IIS Publications (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Steinberg, R., Diggs, A., Driggs, J. (2020). Validating a Human Performance Model Without a Complete System. In: Arezes, P., Boring, R. (eds) Advances in Safety Management and Human Performance. AHFE 2020. Advances in Intelligent Systems and Computing, vol 1204. Springer, Cham. https://doi.org/10.1007/978-3-030-50946-0_45
Download citation
DOI: https://doi.org/10.1007/978-3-030-50946-0_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50945-3
Online ISBN: 978-3-030-50946-0
eBook Packages: EngineeringEngineering (R0)