Data-Efficient Information-Theoretic Test Selection

We use the concept of conditional mutual information (MI) to approach problems involving the selection of variables in the area of medical diagnosis. Computing MI requires estimates of joint distributions over collections of variables. However, in general computing accurate joint distributions conditioned on a large set of variables is expensive in terms of data and computing power. Therefore, one must seek alternative ways to calculate the relevant quantities and still use all the available observations. We describe and compare a basic approach consisting of averaging MI estimates conditioned on individual observations and another approach where it is possible to condition on all observations at once by making some conditional independence assumptions. This yields a data-efficient variant of information maximization for test selection. We present experimental results on public heart disease data and data from a controlled study in the area of breast cancer diagnosis.

Authors and Affiliations

1. Institut für Informatik, Technische Universität München, 85748, Garching, Germany

   Marianne Mueller & Stefan Kramer

2. IKM CAD and Knowledge Solutions, Siemens Healthcare, Malvern, PA, 19335, USA

   Rómer Rosales, Harald Steck, Sriram Krishnan & Bharat Rao

Editors and Affiliations

1. University of Verona, Department of Computer Science, Ca’ Vignal 2, strada le Grazie 15, 37134, Verona, Italy

   Carlo Combi

2. Department of Information Systems Engineering, Ben Gurion University of the Negev, P.O. Box 653, 84105, Beer-Sheva, Israel

   Yuval Shahar

3. Department of Medical Informatics, University of Amsterdam, Academic Medical Center, Meibergdreef 15, 1105, Amsterdam, AZ, The Netherlands

   Ameen Abu-Hanna

Reprints and permissions

© 2009 Springer-Verlag Berlin Heidelberg

Policies and ethics