Abstract
Underwriting decisions by insurance companies make a significant contribution to their profitability. Machine Learning (ML) techniques in underwriting decision making have saved time and improved operational efficiencies. A user-friendly cause-and-effect explanation of model’s predictions is useful to stakeholders, financial institutions and regulators. This research performed comparative analysis between tree-based classifiers such as Decision Tree, Random Forest and XGBoost. The study focused on enhancing risk assessment capabilities for life insurance companies using predictive analytics by classifying the insurance risk based on the historical data and propose the appropriate model to assess risk. Its purpose also included incorporating mechanisms that can aid in user friendly interpretation of ML models. Of all the models created as part of this research, the XGBoost classifier performed the best when compared to other classifiers, with an AUC value of 0.86 and F1-score above 0.56 on the validation set. The Random Forest classifier got AUC value of .84 and f1 score of .53 on the validation dataset. The results indicate the importance and advantages of tree -based models. These models i.e., XGBoost, decision tree and random forest are one of the best alternate techniques after the advent and popularity of the new age techniques in the machine learning such as neural networks, deep learning etc. The research also provides an insight on the interpretability of these conventional techniques by way of ‘SHAP’ or shapley values and ‘Feature Importance’ or ‘Variable Importance’. SHAP was used on complex models such as XGBoost and neural networks whereas Feature Importance is used in supervised learning methods such as Logistic Regression and tree- based models such as Decision Tree and Random Forest. Overall, the study was able to propose XGBoost as the most accurate model for Insurance risk classification and predictions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wang, Y.P.: Predictive machine learning for underwriting life and health insurance, pp. , 19–22, October (2021)
Dhieb, N., Ghazzai, H., Besbes, H., Massoud, Y.: Extreme gradient boosting machine learning algorithm for safe auto insurance operations. In: 2019 IEEE International Conference on Vehicular Electronics and Safety, ICVES 2019, pp.1–5 (2019)
Boodhun, N., Jayabalan, M.: Risk prediction in life insurance industry using supervised learning algorithms. Complex Intell. Syst. 4(2), 145–154 (2018). https://doi.org/10.1007/s40747-018-0072-1
Rawat, S., Rawat, A., Kumar, D., Sabitha, A.S.: Application of machine learning and data visualization techniques for decision support in the insurance sector. Int. J. Inf. Manag. Data Insights 12, 100012 (2021)
Mashrur, A., Luo, W., Zaidi, N.A., Robles-Kelly, A.: Machine learning for financial risk management: a survey. IEEE Access 8, 203203–203223 (2020). https://doi.org/10.1109/ACCESS.2020.3036322
Rodríguez-Pérez, R., Bajorath, J.: Interpretation of machine learning models using shapley values: application to compound potency and multi-target activity predictions. J. Comput. Aided Mol. Des. 34(10), 1013–1026 (2020). https://doi.org/10.1007/s10822-020-00314-0
Al-Jumeily, D., Hussain, A., Alghamdi, M., Dobbins, C., Lunn, J.: Educational crowdsourcing to support the learning of computer programming. Res. Pract. Technol. Enhanced Learn. 10(1), 13 (2015). https://doi.org/10.1186/s41039-015-0011-3
Henckaerts, R., Côté, M.P., Antonio, K., Verbelen, R.: Boosting insights in insurance tariff plans with tree-based machine learning methods. North Am. Actuarial J. 25(2), 1–31 (2020). https://doi.org/10.1080/10920277.2020.1745656
Mohamed, A.H.H.M., Tawfik, H., Norton, L., Al-Jumeily, D.: e-HTAM: a technology acceptance model for electronic health. In: 2011 International Conference on Innovations in Information Technology, IIT 2011, pp. 134–138, 5893804 (2011)
Alloghani, M., Aljaaf, A., Hussain, A., Al-Jumeily, D., Khalaf, M.: Implementation of machine learning algorithms to create diabetic patient re-admission profiles. BMC Med. Inform. Decis. Mak. 19, 253 (2019)
Keight, R., Aljaaf, A.J., Al-Jumeily, D., Özge, A., Mallucci, A.C.: An intelligent systems approach to primary headache diagnosis. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) LNCS, vol. 10362, pp. 61–72 (2017)
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A.: A survey on bias and fairness in machine learning. ACM Comput. Surv. 54(6), 1–35 (2021). https://doi.org/10.1145/3457607
Rusdah, D.A., Murfi, H.: XGBoost in handling missing values for life insurance risk prediction. SN Appl. Sci. 2(8), 1 (2020). https://doi.org/10.1007/s42452-020-3128-y
Hanafy, M., Ming, R.: Machine Learning approaches for auto insurance big data. Risks 9(2), 1–23 (2021)
Qadadeh, W., Abdallah, S.: Customers segmentation in the insurance company (TIC) dataset. Procedia Comput. Sci. 144, 277–290 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sahai, R. et al. (2023). Insurance Risk Prediction Using Machine Learning. In: Wah, Y.B., Berry, M.W., Mohamed, A., Al-Jumeily, D. (eds) Data Science and Emerging Technologies. DaSET 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 165. Springer, Singapore. https://doi.org/10.1007/978-981-99-0741-0_30
Download citation
DOI: https://doi.org/10.1007/978-981-99-0741-0_30
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-0740-3
Online ISBN: 978-981-99-0741-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)