Abstract
With the development of Evidence based training (EBT), more and more airlines realize this is a subsystem of SMS, which provides overarching tool from operation safety to training and vice versa. The analysis of instructor grading data and operation data allows the training manager analyze the whole system performance. In order to run through ADDIE (Analyze, design, development, implement, evaluation) process, evaluation is necessary to course design, instructor performance and the training system performance. This paper analyzes two airlines EBT training data from the competency grading, trainees rank, correlation perspectives, and also propose the possible way of analyzing competency from FOQA data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Balzer, W.K., Sulsky, L.M.: Halo and performance appraisal research: a critical examination. J. Appl. Psychol. 77(6), 975 (1992)
Croskerry, P.: The importance of cognitive errors in diagnosis and strategies to minimize them. Acad. Med. 78, 1–6 (2003)
Croskerry, P.: Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad. Emerg. Med. 9(11), 1184–1204 (2002)
Thomas, M.J.W.: Training and Assessing Non-Technical Skills: A Practical Guide (1st ed.). CRC Press (2018). https://doi.org/10.1201/9781315550336
Yeates, P., O’ Neill, P., Mann, K., Eva, K. W.: ‘You’ re certainly relatively competent’: Assessor bias due to recent experiences. Med. Educ. 47(9), 910–922
Downing, S.M.: Threats to the validity of clinical teaching assessments: what about rater error? Med. Educ. 39:350–355. [PubMed: 15813754] (2013)
Feldman, M., Lazzara, E.H., Vanderbilt, A.A., DiazGranados, D.: Rater training to support highstakes simulation-based assessments. J. Contin. Educ. Health Prof. 2012 Fall 32(4), 279–86. https://doi.org/10.1002/chp.21156. PMID: 23280532; PMCID: PMC3646087
Arthur, W., Jr., Bennett, W., Jr., Edens, P.S., Bell, S.T.: Effectiveness of training in organizations: a meta-analysis of design and evaluation features. J. Appl. Psychol. 88(2), 234–245 (2003)
Baker, D., Dismukes, R.: A framework for understanding crew performance assessment issues. Int. J. Aviat. Psychol. 12(3), 205–222 (2002)
Beaudin-Seiler, B.M., Seiler, R.: A study of how flight instructors assess flight maneuvers and give grades: inter-rater reliability of instructor assessments. J. Aviation/Aerospace Educ. Res. 25(1) (2015)
Callantine T J.: The crew activity tracking system: Leveraging flight data for aiding, training and analysis. In: 20th DASC. 20th Digital Avionics Systems Conference (Cat. No. 01CH37219). IEEE, 1: 5C3/1–5C3/12 vol. 1 (2001)
Li, D., Chen, X.: Method and system for pilot competency portrait based on large data of aviation QAR. Beijing: CN113298431B, 2023–04–21
Xie, H., Li, T., Lai, S.: Civil aircraft landing loads prediction based on flight data and oleo-pneumatic absorber behavior. In: 2021 IEEE 3rd International Conference on Civil Aviation Safety and Information Technology (ICCASIT). IEEE, pp. 227–231 (2021)
Lei, W., Ying, Z., Shuo, W.: Quantitative evaluation of pilot's unsafe operating behavior driven by QAR data. J. China Saf. Sci. 33(5), 49 (2023)
Lee, H.K., Puranik, T.G., Fischer, O.P., et al.: Flight data driven system identification using neural networks for landing safety assessment. In: 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), pp. 1–9. IEEE (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Meng, Q., Li, T., Xie, H. (2024). EBT Training Effectiveness and Evaluation. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2024. Lecture Notes in Computer Science(), vol 14692. Springer, Cham. https://doi.org/10.1007/978-3-031-60728-8_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-60728-8_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60727-1
Online ISBN: 978-3-031-60728-8
eBook Packages: Computer ScienceComputer Science (R0)