Abstract
The present paper is devoted to the pattern recognition methods for combining heterogeneous sets of learning data: set of training examples and the set of expert rules with unprecisely formulated weights understood as conditional probabilities. Adopting the probabilistic model two concepts of recognition learning are proposed. In the first approach two classifiers trained on homogeneous data set are generated and next their decisions are combined using local weighted voting combination rule. In the second method however, one set of data is transformed into the second one and next only one classifier trained on homogeneous set of data is used. Presented algorithms were practically applied to the computer-aided diagnosis of acute renal failure in children and results of their classification accuracy are given.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Chen, D., Cheng, X.: An Asymptotic Analysis of Some Expert Fusion Methods. Pattern Recognition Letters 22, 901–904 (2001)
Czabanski, R.: Self-Generating Fuzzy Rules from Numerical Data. Techn. Report, Silesian Technical Univ. Gliwice, PhD Thesis (2002) (in Polish)
Devroye, L., Gyorfi, P., Lugossi, G.: A Probabilistic Theory of Pattern Recognition. Springer, Heidelberg (1996)
Dubois, D., Lang, J.: Possibilistic Logic. In: Handbook of Logic in Artificial Intelligence and Logic Programming, pp. 439–513. Oxford Univ. Press, Oxford (1994)
Duda, R., Hart, P., Stork, D.: Pattern Classification. John Wiley and Sons, London (2001)
Halpern, J.: Reasoning about Uncertainty. MIT Press, Cambridge (2003)
Jacobs, R.: Methods for Combining Experts Probability Assessments. Neural Computation 7, 867–888 (1995)
James, J.A.: Renal Disease in Childhood. The C.V. Mosby Comp., London (1996)
Kuncheva, L.: Combining Classifiers: Soft Computing Solutions. In: Pal, S., Pal, A. (eds.) Pattern Recognition: from Classical to Modern Approaches, pp. 427–451. World Scientific, Singapore (2001)
Kurzynski, M., Sas, J., Blinowska, A.: Rule-Based Medical Decision-Making with Learning. In: Proc. 12th World IFAC Congress, Sydney, vol. 4, pp. 319–322 (1993)
Kurzynski, M., Sas, J.: Rule-Based Classification Procedures Related to the Unprecisely Formulated Expert Rules. In: Proc. SIBIGRAPI Conference, Rio de Janeiro, pp. 241–245 (1998)
Kurzynski, M.: The Application of Combined Recognition Decision Rules to the Multistage Diagnosis Problem. In: 20th Int. Conf. of IEEE EMBS, Hong-Kong, pp. 1194–1197 (1998)
Kurzynski, M., Wozniak, M.: Rule-Based Algorithms with Learning for Sequential Recognition Problem. In: Proc. 3rd Int. Conf. Fusion 2000, Paris, pp. 10–13 (2000)
Kurzynski, M., Puchala, E.: Hybrid Pattern Recognition Algorithms Applied to the Computer-Aided Medical Diagnosis. In: Crespo, J.L., Maojo, V., Martin, F. (eds.) ISMDA 2001. LNCS, vol. 2199, pp. 133–139. Springer, Heidelberg (2001)
Kurzynski, M.: Consistency Conditions of the Expert Rule Set in the Probabilistic Pattern Recognition. In: Zhang, J., He, J.-H., Fu, Y. (eds.) CIS 2004. LNCS, vol. 3314, pp. 831–836. Springer, Heidelberg (2004)
Mitchell, T.: Machine Learning. McGraw-Hill Science, London (1997)
Kuratowski, K., Mostowski, A.: Set Theory. Nort-Holland Publishing Co, Amsterdam (1986)
Sachs, L.: Applied Statistics: A Handbook of Techniques. Springer, Berlin (1982)
Woods, K., Kegelmeyer, W.: Combination of Multiple Classifiers Using Local Accuracy Estimates. IEEE Trans. on PAMI 19, 405–410 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kurzynski, M. (2005). Fusion of Rule-Based and Sample-Based Classifiers – Probabilistic Approach. In: Yolum, p., Güngör, T., Gürgen, F., Özturan, C. (eds) Computer and Information Sciences - ISCIS 2005. ISCIS 2005. Lecture Notes in Computer Science, vol 3733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11569596_56
Download citation
DOI: https://doi.org/10.1007/11569596_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29414-6
Online ISBN: 978-3-540-32085-2
eBook Packages: Computer ScienceComputer Science (R0)