Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Evaluating the reliability of diagnostic performance indices by using Taguchi quality loss function

  • S.I.: Reliability Modeling with Applications Based on Big Data
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

A medical test to diagnose a disease is often used to distinguish between healthy and diseased individuals, where early, accurate and reliable diagnosis can decrease morbidity and mortality rates of disease. An optimal cut-off point is required to discriminate healthy from diseased individuals, and a corresponding biomarker value is used to assess the accuracy and robustness whether a person is healthy (negative) or diseased (positive). If the biomarker values, that are greater than or equal to this cut-off value, are considered positive, otherwise they are negative. Several indices such as Youden index, Euclidean index, product of sensitivity and specificity have been used in clinical practices but their reliability of performance are not well understood by clinicians. This study uses Taguchi quality loss function to compare the choice of methods in determining optimal cut-off points for the diagnostic tests. The results illustrate that the variance of diseased populations is less than the variance of healthy populations and the loss coefficient of false negative results is greater than loss coefficient of the false positive results, the Youden index has a better performance; in other cases, the Euclidean index is a better measure. This paper proposes a Taguchi index based on the quality loss function can measure the diagnostic accuracy for differences in the sensitivity and specificity by minimizing the cost of false positive and false negative results. The proposed index can assess diagnostic tests and offer perfect discrimination.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Fluss, R., Faraggi, D., & Reiser, B. (2005). Estimation of the Youden index and it’s associated cutoff point. Biometrical Journal, 47(4), 458–472.

    Article  Google Scholar 

  • Hajian-Tilaki, K. (2017). The choice of methods in determining the optimal cut-off value for quantitative diagnostic test evaluation. Statistical Methods in Medical Research, 27(8), 2374–2383.

    Article  Google Scholar 

  • Liu, X. (2012). Classification accuracy and cut point selection. Statistics in Medicine, 31(23), 2676–2686.

    Article  Google Scholar 

  • Nakas, C. T., Alonzo, T. A., & Yiannoutsos, C. T. (2010). Accuracy and cut-off point selection in three-class classification problems using a generalization of the Youden index. Statistics in Medicine, 29(28), 2946–2955.

    Article  Google Scholar 

  • Schisterman, E. F., & Perkins, N. (2007). Confidence intervals for the Youden index and the corresponding optimal cut-point. Communications in Statistics—Simulation and Computation, 36(3), 549–563.

    Article  Google Scholar 

  • Schisterman, E. F., Perkins, N., Liu, A., & Bondell, H. (2005). Optimal cut-point and its corresponding Youden index to discriminate individuals using pooled blood samples. Epidemiology, 16(1), 73–81.

    Article  Google Scholar 

  • Skaltsa, K., Jover, L., & Carrasco, J. L. (2010). Estimation of the diagnostic threshold accounting for decision costs and sampling uncertainty. Biometrical Journal, 52(5), 676–697.

    Article  Google Scholar 

  • Stefan, M., Panduru, N. M., & Ion, D. A. (2011). Estimation of Youden index and its associated optimal cut-point when the parameters of gamma biomarkers are estimated by the method of moments. Proceedings of the Romanian Academy, Series A, 12(4), 269–276. https://acad.ro/sectii2002/proceedings/doc2011-4/01-Stefan.pdf.

  • Taguchi, G. (1992). Taguchi methods: Research and development. Dearborn, MI: American Suppliers Institute.

    Google Scholar 

  • Taner, M. T., & Antony, J. (2000). The assessment of quality in medical diagnostic tests: A comparison of ROC/Youden and Taguchi methods. International Journal of Health Care Quality Assurance, 13(7), 300–307.

    Article  Google Scholar 

  • Taner, M. T., & Sezen, B. (2009a). An assessment of diagnostic efficiency by Taguchi/DEA methods. International Journal of Health Care Quality Assurance, 22(1), 93–98.

    Article  Google Scholar 

  • Taner, M. T., & Sezen, B. (2009b). Modelling of Taguchi’s signal-to-noise ratios for healthcare. Journal Total Quality Management and Business Excellence, 20(5), 483–495.

    Article  Google Scholar 

  • Taner, M. T., Sezen, B., & Atwat, K. (2013). A comparison of two diagnostic performance measures: Signal-to-noise ratio versus partial area under receiver operating characteristic curve. International Journal of Health Care Quality Assurance, 26(2), 109–117.

    Article  Google Scholar 

  • Wu, F.-C., Wang, H.-M., & Fan, T.-Y. (2010). Quality design of Taguchi’s digital dynamic systems. International Journal of Industrial Engineering—Applications and Practice, 16(5), 405–416.

    Google Scholar 

  • Wu, P.-C., & Wu, F.-C. (2017). A hybrid indicator of Youden index and Taguchi loss function to determine the diagnostic efficiency. In AETMS 2017 proceedings: 4th International conference on advanced education technology and management science, (pp. 278–282).

  • Youden, W. J. (1950). Index for rating diagnostic tests. Cancer, 3(1), 32–35.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Hotel Management, Vanung University, Tao-Yuan, 32601, Taiwan

    Ful-Chiang Wu & Ya-Chi Lee

  2. Department of Information Science and Technology, Vanung University, Tao-Yuan, 32601, Taiwan

    Thomas C. Chuang

  3. College of Mechanical and Electronic Engineering, Wenzhou University, Wenzhou, 325035, Zhejiang, China

    Fuh-Der Chou

Authors
  1. Ful-Chiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas C. Chuang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fuh-Der Chou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ya-Chi Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fuh-Der Chou.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, FC., Chuang, T.C., Chou, FD. et al. Evaluating the reliability of diagnostic performance indices by using Taguchi quality loss function. Ann Oper Res 311, 437–449 (2022). https://doi.org/10.1007/s10479-019-03512-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-019-03512-8

Keywords

Search

Navigation