Abstract
We introduce a novel relevance feedback method for content-based image retrieval and demonstrate its effectiveness using a subset of the Corel Gallery photograph collection and five low-level colour descriptors. Relevance information is translated into updated, analytically computed descriptor weights and a new query representation, and thus the system combines movement in both query and weight space. To assess the effectiveness of relevance feedback, we first determine the weight set that is optimal on average for a range of possible queries. The resulting multiple-descriptor retrieval model yields significant performance gains over all the single-descriptor models and provides the benchmark against which we measure the additional improvement through relevance feed-back. We model a number of scenarios of user-system interaction that differ with respect to the precise type and the extent of relevance feedback. In all scenarios, relevance feedback leads to a significant improvement of retrieval performance suggesting that feedback-induced performance gain is a robust phenomenon. Based on a comparison of the different scenarios, we identify optimal interaction models that yield high performance gains at a low operational cost for the user. To support the proposed relevant feedback technique we developed a novel presentation paradigm that allows relevance to be treated as a continuous variable.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Y-S Choi, D Kim, and R Krishnapuram. Relevance feedback for content-based retrieval using the Choquet integral. In Proc of the IEEE International Conference on Multimedia and Expo (II), 2000.
G Ciocca and R Schettini. A relevance feedback mechanism for content-based image retrieval. Information Processing and Management, 35(5):605–632, 1999.
I J Cox, M L Miller, T P Minka, T V Papathomas, and P N Yianilos. The Bayesian image retrieval system, pichunter. IEEE Transactions on Image Processing, 9(1):20–38, 2000.
D Daneels, D Campenhout, W Niblack, W Equitz, R Barber, E Bellon, and F Fierens. Interactive outlining: an improved approach using active contours. In Proc. SPIE Storage and Retrieval for Image and Video Databases, 1993.
Y Deng and B S Manjunath. An efficient color representation for image retrieval. IEEE Transactions on Image Processing, 10:140–147, 2001.
D Heesch and S Rüger. Combining features for content-based sketch retrieval — a comparative evaluation of retrieval performance. In Proceedings of the European Colloquium on IR Research 2002, Berlin, 2002. LNCS, Springer.
Y Ishikawa, R Subramanya, and C Faloutsos. MindReader: Querying databases through multiple examples. In Proc. 24th Int. Conf. Very Large Data Bases, VLDB, pages 218–227, 24–27 1998.
A Lelescu, O Wolfson, and B Xu. Approximate retrieval from multimedia databases using relevance feedback. In SPIRE/CRIWG, pages 215–223, 1999.
W Y Ma and B S Manjunath. Texture features and learning similarity. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 425–430, 1996.
B S Manjunath and J-R Ohm. Color and texture descriptors. IEEE Transactions on circuits and systems for video technology, 11:703–715, 2001.
C Meilhac and C Nastar. Relevance feedback and category search in image databases. In Proc. IEEE Int. Conf. Multimedia Comp. and Syst., pages 512–517, 1999.
T P Minka and R W Picard. Interactive learning using a society of models. In Proc. IEEE Computer Vision and Pattern Recognition, pages 447–452, 1996.
H Mueller, S Marchand-Maillet, and T Pun. The truth about Corel — evaluation in image retrieval. In Proceedings of CIVR, pages 38–49, 2002.
K Porkaew, M Ortega, and S Mehrotra. Query reformulation for content based multimedia retrieval in MARS. In ICMCS, Vol. 2, pages 747–751, 1999.
K Rodden, W Basalaj, D Sinclair, and K Wood. Evaluating a visualization of image similarity. In Proceedings of SIGIR’99, ACM, pages 275–276, 1999.
Y Rubner and L J Guibas. The earth mover’s distance, multi-dimensional scaling and color-based image retrieval. In Proceedings of the APRA Image Understanding Workshop, pages 661–668, 1997.
Y Rui and T S Huang. A novel relevance feedback technique in image retrieval. In ACM Multimedia (2), pages 67–70, 1999.
Y Rui, T S Huang, and S Mehrotra. Relevance feedback techniques in interactive content-based image retrieval. In Storage and Retrieval for Image and Video Databases (SPIE), pages 25–36, 1998.
G Salton and M J Gill. Introduction to Modern Information Retrieval. McGraw-Hill Book Co., 1983.
S Santini, A Gupta, and R Jain. Emergent semantics through interaction in image databases. IEEE transactions on knowledge and data engineering, 13(3):337–351, 2001.
D McG Squire, W Müller, H Müller, and T Pun. Content-based query of image databases: inspirations from text retrieval. Pattern Recognition Letters, 21(13–14):1193–1198, 2000.
E M Voorhees and D Harman. Overview of the eigth Text REtrieval Conference (TREC-8). In Proc. TREC, pages 1–33 and A.17–A.18, 1999.
M E J Wood, N W Campbell, and B T Thomas. Iterative re-nement by relevance feedback in content-based digital image retrieval. In ACM Multimedia 98, pages 13–20, Bristol, UK, 1998. ACM.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heesch, D.C., Rüger, S. (2003). Relevance feedback for content-based image retrieval: what can three mouse clicks achieve?. In: Sebastiani, F. (eds) Advances in Information Retrieval. ECIR 2003. Lecture Notes in Computer Science, vol 2633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36618-0_26
Download citation
DOI: https://doi.org/10.1007/3-540-36618-0_26
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-01274-0
Online ISBN: 978-3-540-36618-8
eBook Packages: Springer Book Archive