Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Validation of an ontological medical decision support system for patient treatment using a repository of patient data: Insights into the value of machine learning

Published: 08 October 2013 Publication History

Abstract

In this article, we begin by presenting OMeD, a medical decision support system, and argue for its value over purely probabilistic approaches that reason about patients for time-critical decision scenarios. We then progress to present Holmes, a Hybrid Ontological and Learning MEdical System which supports decision making about patient treatment. This system is introduced in order to cope with the case of missing data. We demonstrate its effectiveness by operating on an extensive set of real-world patient health data from the CDC, applied to the decision-making scenario of administering sleeping pills. In particular, we clarify how the combination of semantic, ontological representations, and probabilistic reasoning together enable the proposal of effective patient treatments. Our focus is thus on presenting an approach for interpreting medical data in the context of real-time decision making. This constitutes a comprehensive framework for the design of medical recommendation systems for potential use by medical professionals and patients both, with the end result being personalized patient treatment. We conclude with a discussion of the value of our particular approach for such diverse considerations as coping with misinformation provided by patients, performing effectively in time-critical environments where real-time decisions are necessary, and potential applications facilitating patient information gathering.

Supplementary Material

a68-khan-apndx.pdf (khan.zip)
Supplemental movie, appendix, image and software files for, Validation of an ontological medical decision support system for patient treatment using a repository of patient data: Insights into the value of machine learning

References

[1]
Abidi, S. and Hussain, S. 2007. Medical knowledge morphing via a semantic Web framework. In Proceedings of the 20th IEEE International Symposium on Computer-Based Medical Systems (CBMS'07). IEEE, 554--562.
[2]
Adler, D. 2005. vioplot: Violin plot. R package version 0.2.
[3]
Berner, E. 2007. Clinical Decision Support Systems: Theory and Practice. Springer Verlag, New York. NY.
[4]
Berners-Lee, T. 2005. Notation 3 (n3): A readable language for data on the Web. http://www.w3.org/DesignIssues/Notation3.
[5]
Berners-lee, T., Connolly, D., Kagal, L., Scharf, Y., and Hendler, J. 2008. N3logic: A logical framework for the World Wide Web. Theory Pract. Logic Program. 8, 3, 249--269.
[6]
Bernstein, A., Provost, F., and Hill, S. 2005. Toward intelligent assistance for a data mining process: An ontology-based approach for cost-sensitive classification. IEEE Trans. Knowl. Data Eng. 17, 503--518.
[7]
Boley, H., Shafiq, O., Smith, D., and Osmun, T. 2011. The social semantic subweb of virtual patient support groups. In Proceedings of the 3rd Canadian Semantic Web Symposium (CSW'2011). 1.
[8]
Breiman, L. 1996. Bagging predictors. Mac. Learn. 24, 2, 123--140.
[9]
Brisson, L. and Collard, M. 2009. How to semantically enhance a data mining process? In Enterprise Information Systems, W. Aalst, J. Mylopoulos, N. M. Sadeh, M. J. Shaw, C. Szyperski, J. Filipe, and J. Cordeiro, Eds. Lecture Notes in Business Information Processing, vol. 19. Springer, Berlin Heidelberg, 103--116.
[10]
Buettcher, S., Clarke, C. L. A., and Cormack, G. V. 2010. Information Retrieval: Implementing and Evaluating Search Engines. The MIT Press, Cambridge, MA.
[11]
Castano, S. and Ferrara, A. 2003. Knowledge representation and transformation in ontology-based data integration. In Proceedings of the ECAI Workshop on Knowledge Transformation for the Semantic Web. 107--121.
[12]
Centers for Disease Control Prevention 2010. Behavioral risk factor surveillance system survey data. http://www.cdc.gov/brfss/data_documentation/index.htm.
[13]
Chang, C.-C. and Lin, C.-J. 2011. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 1--27. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
[14]
Choi, N., Song, I., and Han, H. 2006. A survey on ontology mapping. ACM Sigmod Record 35, 3, 34--41.
[15]
Cortes, C. and Vapnik, V. 1995. Support-vector networks. Mach. Learn. 20, 3, 273--297.
[16]
Decker, S., Erdmann, M., Fensel, D., and Studer, R. 1998. Ontobroker: Ontology based access to distributed and semi-structured information. In Proceedings of the IFlP TCZ/WG 2.6 8th Working Conference on Database Semantics. 351--369.
[17]
Doucette, J. and Heywood, M. 2008. Gp classification under imbalanced data sets: Active sub-sampling and auc approximation. In Proceedings of the European Conference on Genetic Programming.
[18]
Doucette, J., Khan, A., and Cohen, R. 2012. A comparative evaluation of an ontological medical decision support system (omed) for critical environments. In Proceedings of the 2nd ACM SIGHIT Internatioanl Health Informatics Symposium (IHI'12).
[19]
Ehrig, M. and Sure, Y. 2004. Ontology mapping--an integrated approach. In The Semantic Web: Research and Application. Lecture Notes in Computer Science, vol. 3053, Springer-Verlag, Berlin Heidelberg, 76--91.
[20]
Embley, D. W, Campbell, D. M, Smith, R. D., and Liddle, S. W. 1998. Ontology-based extraction and structuring of information from data-rich unstructrued documents. In Proceedings of the ACM International Conference on Information and Knowledge Management.
[21]
Freund, Y. and Schapire, R. E. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55.
[22]
Frize, M. and Walker, R. 2000. Clinical decision-support systems for intensive care units using case-based reasoning. Med. Eng. Physics 22, 9, 671--677.
[23]
Garg, A., Adhikari, N., McDonald, H., Rosas-Arellano, M., Devereaux, P., Beyene, J., Sam, J., and Haynes, R. 2005. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. J. Am. Med. Assoc. 293, 10, 1223.
[24]
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. 2009. The weka data mining software: An update. SIGKDD Explo. 11, 1.
[25]
Harrison, R. and Kennedy, R. 2005. Artificial neural network models for prediction of acute coronary syndromes using clinical data from the time of presentation. Ann. Emergency Med. 46, 5, 431--439.
[26]
Holte, R. C. 1993. Very simple classification rules perform well on most commonly used datasets. Mach. Learn. 11, 63--91.
[27]
Hunt, D., Haynes, R., Hanna, S., and Smith, K. 1998. Effects of computer-based clinical decision support systems on physician performance and patient outcomes. J. Am. Med. Assoc. 280, 15, 1339.
[28]
Hussain, S. 2009. K-morph: A semantic web based knowledge representation and context-driven morphing framework. In Advances in Artificial Intelligence, Lecture Notes in Computer Science, vol. 5549, Springer-Verlag, Berlin Heidelberg, 279--282.
[29]
Jacquemart, P. and Zweigenbaum, P. 2009. Knowledge and reasoning for medical question-answering. In Proceedings of the Workshop on Knowledge and Reasoning for Answering Questions.
[30]
Jurisica, I., Mylopoulos, J., and Yu, E. 1999. Using ontologies for knowledge management: An information systems perspective. In Proceedings of the 62nd Annual Meeting of the American Society for Information Science (ASIS'99). 482--496.
[31]
Kalfoglou, Y. and Schorlemmer, M. 2003. Ontology mapping: The state of the art. Knowledge Eng. Rev. 18, 1, 1--31.
[32]
Kataria, P. and Juric, R. 2010. Sharing e-health information through ontological layering. In Proceedings of the 43rd Hawaii International Conference on System Sciences.
[33]
Kawamoto, K., Houlihan, C., Balas, E., and Lobach, D. 2005. Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. Brit. Med. J. 330, 7494, 765.
[34]
Khan, A., Doucette, J., Jin, C., Fu, L., and Cohen, R. 2011. An ontological approach to data mining for emergency medicine. In Proceedings of the 40th Annual Meeting Northeast Decision Sciences Institute Conference. 578--594.
[35]
Kohn, L., Corrigan, J., Donaldson, M., Eds. 2000. To err is human: building a safer health system. A report of the committee on quality of health care in America. Institute of Medicine, National Academy Press, Washington, D.C.
[36]
Maedche, A., Motik, B., Silva, N., and Volz, R. 2002. Mafra—a mapping framework for distributed ontologies. In Proceedings of the 13th International Conference on Knowledge Engineering and Knowledge Management. Ontologies and the Semantic Web (EKAW'02). Springer-Verlag, London, U.K., 235--250.
[37]
Marakas, G. 2003. Decision Support Systems in the 21st century. Vol. 2. Prentice Hall, Upper Saddle River, NJ.
[38]
Martin, J., Avant, R., Bowman, M., Bucholtz, J., Dickinson, J., Evans, K., Green, L., Henley, D., Jones, W., Matheny, S., Nevin, J., Panther, S., Puffer, J., Roberts, R., Rodgers, D., Sherwood, R., Stange, K., and Weber, C. 2004. The future of family medicine: A collaborative project of the family medicine community. Ann. Fam. Med. 2, S3.
[39]
McDonald, C. 1997. The barriers to electronic medical record systems and how to overcome them. J. Am. Med. Inf. Assoc. 4, 3, 213.
[40]
Mendonca, E. A., Cimino, J. J., Johnson, S. B., and Seol, Y.-H. 2001. Accessing heterogeneous sources of evidence to answer clinical questions. J. Biomed. Inf. 34, 85--98.
[41]
Ornstein, S. 1997. Electronic medical records in family practice: The time is now. J. Fam. Pract. 44, 1, 45.
[42]
Pearce, C., Gunn, S., Ahmed, A., and Johnson, C., 2006. Machine learning can improve prediction of severity in acute pancreatitis using admission values of apache ii score and c-reactive protein. Pancreatology 6, 1--2, 123--131.
[43]
Perreault, L. and Metzger, J. 1999. A pragmatic framework for understanding clinical decision support. J. Healthcare Inf. Manage. 13, 5, 5--21.
[44]
Pople, H. 1985. Evolution of an expert system: From internist to caduceus. Artif. Intell. Med. 179--208.
[45]
Quinlan, J. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, Burlington, MA.
[46]
R Development Core Team. 2010. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0.
[47]
Rahm, E. and Bernstein, P. A. 2001. A survey of approaches to automatic schema matching. VLDB J. 10, 334--350. 10.1007/s007780100057.
[48]
Richardson, J. 2009. (expert opinion). Mayo Clinic, Rochester, MN. Nov. 11, 2009.
[49]
Rodnick, J. 1990. Should the complete medical record be computerized in family practice? an opposing view. J. Fam. Pract. 30, 4, 460.
[50]
Shea, S., DuMouchel, W., and Bahamonde, L. 1996. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J. Am. Med. Inf. Assoc. 3, 6, 399.
[51]
Shortliffe, E. 1976. Computer-based medical consultations: Mycin. Elsevier Science Ltd, Toranto, Ontario.
[52]
Spann, S. 1990. Should the complete medical record be computerized in family practice? An affirmative view. J. Fam. Prac. 30, 4, 457.
[53]
Tho, Q., Hui, S., Fong, A., and Cao, T. H. 2006. Automatic fuzzy ontology generation for semantic Web. IEEE Trans. Knowl. Data Eng. 18, 6, 842--856.
[54]
Tibbitts, G. 2008. Sleep disorders: Causes, effects and solutions. Primary Care: Clinics in Office Practice 35.
[55]
W3C. 2004. Resource description framework (rdf). http://www.w3.org/RDF/.
[56]
Wager, K., Lee, F., White, A., Ward, D., and Ornstein, S. 2000. Impact of an electronic medical record system on community-based primary care practices. J. Am. Board Fam. Pract. 13, 5, 338--348.
[57]
Wager, K., Ornstein, S., and Jenkins, R. 1997. Perceived value of computer-based patient records among clinician users. MD Comput. Comput. Med. Pract. 14, 5, 334.
[58]
Weiss, G. M. and Provost, R. 2003. Learning when training data are costly: The effect of class distribution on tree induction. J. Arti. Intell. Res. 19, 315--354.
[59]
Wolpert, D. and Macready, W. 1997. No free lunch theorems for optimization. IEEE Trans. Evolution. Comput.
[60]
Wolpert, D. and Macready, W. 2005. Coevolutionary free lunches. IEEE Trans. Evolution. Comput. 9, 6, 721--735.
[61]
Yang, Y. and Pedersen, J. O. 1997. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning (ICML'97). 412--420.
[62]
Zhu, M., Zhang, Z., Hirdes, J., and Stolee, P. 2007. Using machine learning algorithms to guide rehabilitation planning for home care clients. BMC Med. Inf. Decision Making 7, 1, 41.
[63]
Zhu, S., Ji, X., Xu, W., and Gong, Y. 2005. Multi-labelled classification using maximum entropy method. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development Information Retrieval (SIGIR'05). 274--281.

Cited By

View all
  • (2022)Modified K-Nearest Neighbour Using Proposed Similarity Fuzzy Measure for Missing Data Imputation on Medical Datasets (MKNNMBI)International Journal of Fuzzy System Applications10.4018/IJFSA.30627811:3(1-15)Online publication date: 5-Aug-2022
  • (2019)A Comprehensive Review on Smart Decision Support Systems for Health CareIEEE Systems Journal10.1109/JSYST.2018.289012113:3(3536-3545)Online publication date: Sep-2019
  • (2016)An Innovative Approach for Imputation and Classification of Medical Records for Efficient Disease PredictionProceedings of the Second International Conference on Information and Communication Technology for Competitive Strategies10.1145/2905055.2905273(1-6)Online publication date: 4-Mar-2016
  • Show More Cited By

Index Terms

  1. Validation of an ontological medical decision support system for patient treatment using a repository of patient data: Insights into the value of machine learning

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Intelligent Systems and Technology
        ACM Transactions on Intelligent Systems and Technology  Volume 4, Issue 4
        Survey papers, special sections on the semantic adaptive social web, intelligent systems for health informatics, regular papers
        September 2013
        452 pages
        ISSN:2157-6904
        EISSN:2157-6912
        DOI:10.1145/2508037
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 08 October 2013
        Accepted: 01 August 2012
        Revised: 01 May 2012
        Received: 01 December 2011
        Published in TIST Volume 4, Issue 4

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Medical decision support system
        2. automated knowledge inference
        3. machine learning
        4. ontology-based knowledge representation

        Qualifiers

        • Research-article
        • Research
        • Refereed

        Funding Sources

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)11
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 22 Sep 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2022)Modified K-Nearest Neighbour Using Proposed Similarity Fuzzy Measure for Missing Data Imputation on Medical Datasets (MKNNMBI)International Journal of Fuzzy System Applications10.4018/IJFSA.30627811:3(1-15)Online publication date: 5-Aug-2022
        • (2019)A Comprehensive Review on Smart Decision Support Systems for Health CareIEEE Systems Journal10.1109/JSYST.2018.289012113:3(3536-3545)Online publication date: Sep-2019
        • (2016)An Innovative Approach for Imputation and Classification of Medical Records for Efficient Disease PredictionProceedings of the Second International Conference on Information and Communication Technology for Competitive Strategies10.1145/2905055.2905273(1-6)Online publication date: 4-Mar-2016
        • (2016)Smart Anomaly Prediction in Nonstationary CT Colonography ScreeningIEEE Transactions on Industrial Informatics10.1109/TII.2016.259539912:6(2292-2301)Online publication date: Dec-2016
        • (2015)An Approach to Find Missing Values in Medical DatasetsProceedings of the The International Conference on Engineering & MIS 201510.1145/2832987.2833083(1-7)Online publication date: 24-Sep-2015
        • (2015)Exploring Research Issues in Mining Medical DatasetsProceedings of the The International Conference on Engineering & MIS 201510.1145/2832987.2833078(1-8)Online publication date: 24-Sep-2015
        • (2015)Smart Colonography for Distributed Medical Databases with Group Kernel Feature AnalysisACM Transactions on Intelligent Systems and Technology10.1145/26681366:4(1-24)Online publication date: 27-Jul-2015

        View Options

        Get Access

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media