Abstract
A method for quantifying the reliability of object classifications using trained neural networks is given. Using this method one is able to give an estimation of a confidence value for a certain object. This reveals how trustworthy the classification of the particular object by the neural pattern classifier is. Even for badly trained networks it is possible to give reliable confidence estimations. Several estimators are considered. A k-NN technique has been developed to compare these using a learning set based artificially generated validation set. Experiments show that applying the developed estimators on a validation set gives the same results as applying the estimators on an independent test set. The method was tested on a real-life application, human chromosome classification, and gave good results which indicate the applicability of our method.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, J.A. Logistic discrimination, volume 2 of Handbook of Statistics, pages 169–191. North-Holland, 1982.
Denker, J.S. and Le Cun, Y. Transforming neural-net output levels to probability distribution. In R.P. Lippmann, J.E. Moody, and D.S. Touretzky, editors, Advances in Neural information Processing Systems 3, pages 853–859. Morgan Kaufmann, 1991.
Duda, R.O. and Hart, P.E. Pattern classification and scene analysis. John Wiley and sons, 1973.
Duin, R.P.W. Nearest neighbor interpolation for error estimation and classifier optimization. In Proceedings of the 8th SCIA tromsø, 1993.
Fukanaga, K. Introduction to Statistical pattern recognition. Academic Press, 1990.
Houtepen, J.D.J. Chromosome banding profiles: how many samples are necessary for a neural network classifier ? Master's thesis, Delft University of Technology, October 1994.
Tholen, S.A. Confidence values for neural network classifications. Master's thesis, Delft University of Technology, April 1995.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hoekstra, A., Tholen, S.A., Duin, R.P.W. (1996). Estimating the reliability of neural network classifications. In: von der Malsburg, C., von Seelen, W., Vorbrüggen, J.C., Sendhoff, B. (eds) Artificial Neural Networks — ICANN 96. ICANN 1996. Lecture Notes in Computer Science, vol 1112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61510-5_13
Download citation
DOI: https://doi.org/10.1007/3-540-61510-5_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61510-1
Online ISBN: 978-3-540-68684-2
eBook Packages: Springer Book Archive