Article

A novel log-based relevance feedback technique in content-based image retrieval

Authors:

Michael R. LyuAuthors Info & Claims

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

Pages 24 - 31

https://doi.org/10.1145/1027527.1027533

Published: 10 October 2004 Publication History

Abstract

Relevance feedback has been proposed as an important technique to boost the retrieval performance in content-based image retrieval (CBIR). However, since there exists a semantic gap between low-level features and high-level semantic concepts in CBIR, typical relevance feedback techniques need to perform a lot of rounds of feedback for achieving satisfactory results. These procedures are time-consuming and may make the users bored in the retrieval tasks. For a long-term study purpose in CBIR, we notice that the users' feedback logs can be available and employed for helping the retrieval tasks in CBIR systems. In this paper, we propose a novel scheme to study the log-based relevance feedback (LRF) technique for improving retrieval performance and reducing the semantic gap in CBIR. In order to effectively incorporate the users' feedback logs, we propose a modified support vector machine (SVM) technique called soft label support vector machine (SLSVM) to construct the LRF algorithm in CBIR. We conduct extensive experiments to evaluate the performance of our proposed algorithm. Compared with the typical approach using query expansion (QEX) technique, we demonstrate that our proposed scheme can significantly improve the retrieval performance of semantic image retrieval from detailed experiments.

References

[1]

P. Anick. Using terminological feedback for web search refinement: a log-based study. In Proceedings of the 26th Intl. ACM SIGIR Conf. (SIGIR'03), pages 88--95, 2003.

Digital Library

[2]

D. Blei and M. I. Jordan. Modeling annotated data. In Proceedings of the 26th Intl. ACM SIGIR Conf. (SIGIR'03), pages 127--134, 2003.

Digital Library

[3]

C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2):121--167, 1998.

Digital Library

[4]

C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.

[5]

I. J. Cox, M. Miller, T. Minka, and P. Yianilos. An optimized interaction strategy for bayesian relevance feedback. In Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'98), pages 553--558, Santa Barbara, CA, USA, 1998.

Digital Library

[6]

H. Cui, J.-R. Wen, J.-Y. Nie, and W.-Y. Ma. Probabilistic query expansion using query logs. In Proceedings of the 11th Intl. World Wide Web Conf. (WWW'2002), 2002.

Digital Library

[7]

P. Duygulu, K. Barnard, J. de~Freitas, and D. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Proceedings of the 7th European Conference on Computer Vision (ECCV'02), pages 97--112, 2002.

Digital Library

[8]

X. He, O. King, W.-Y. Ma, M. Li, and H. J. Zhang. Learning a semantic space from user's relevance feedback for image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 13(1):39--48, Jan. 2003.

Digital Library

[9]

C.-H. Hoi and M. R. Lyu. Biased support vector machine for relevance feedback in image retrieval. In Proceedings of Intl. Joint Conf. on Neural Networks (IJCNN'04), Budapest, Hungary, 2004.

[10]

C.-H. Hoi and M. R. Lyu. Group-based relevance feeedback with support vector machine ensembles. In Proceedings of the 17th Intl. Conf. on Pattern Recognition (ICPR'04), Cambridge, UK, 2004.

Digital Library

[11]

P. Hong, Q. Tian, and T. Huang. Incorporate support vector machines to content-based image retrieval with relevant feedback. In Proceedings of IEEE Intl. Conf. on Image Processing (ICIP'00), volume 3, pages 750--753, Vancouver, BC, Canada, 2000.

[12]

T. S. Huang and X. S. Zhou. Image retrieval by relevance feedback: from heuristic weight adjustment to optimal learning methods. In Proceedings of IEEE Intl. Conf. on Image Processing (ICIP'01), volume~3, pages 2--5, Thessaloniki, Greece, Oct. 2001.

[13]

Y. Ishikawa, R. Subramanya, and C. Faloutsos. MindReader: Querying databases through multiple examples. In Proceedings of the 24th Int. Conf. Very Large Data Bases (VLDB'98), pages 218--227, 1998.

Digital Library

[14]

A. K. Jain and A. Vailaya. Shape-based retrieval: a case study with trademark image database. Pattern Recognition, (9):1369--1390, 1998.

[15]

J. Jeon, V. Lavrenko, and R. Manmatha. Automatic image annotation and retrieval using cross-media relevance models. In Proceedings of the 26th Intl. ACM SIGIR Conf. (SIGIR'03), pages 119--126, 2003.

Digital Library

[16]

I. King and J. Zhong. Integrated probability function and its application to content-based image retrieval by relevance feedback. Pattern Recognition, 36(9):2177--2186, 2003.

[17]

V. Lavrenko, R. Manmatha, and J. Jeon. A model for learning the semantics of pictures. In Advances in Neural Information Processing Systems (NIPS'03), 2003.

[18]

B. Manjunath, P. Wu, S. Newsam, and H. Shin. A texture descriptor for browsing and similarity retrieval. Signal Processing Image Communication, 2001.

[19]

K. Porkaew, K. Chakrabarti, and S. Mehrotra. Query refinement for multimedia retrieval and its evaluation techniques in mars. In Proceedings of ACM Intl. Conf. on Multimedia (MM'99), Orlando, Florida, USA, 1999.

Digital Library

[20]

K. Porkaew, M. Ortega, and S. Mehrotra. Query reformulation for content based multimedia retrieval in MARS. In Proceedings of ICMCS, volume~2, pages 747--751, 1999.

Digital Library

[21]

Y. Rui and T. Huang. Optimizing learning in image retrieval. In Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'00), volume~1, pages 236--243, South Carolina, USA, 2000.

[22]

Y. Rui and T. S. Huang. A novel relevance feedback technique in image retrieval. In Proceedings of ACM Intl. Conf. on Multimedia (MM'99), pages 67--70, Orlando, Florida, USA, 1999.

Digital Library

[23]

Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A power tool in interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 8(5):644--655, Sept. 1998.

Digital Library

[24]

G. Salton and C. Buckley. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 44(4):288--287, 1990.

[25]

B. Scholkof, A. J. Smola, R. Williamson, and P. Bartlett. New support vector algorithms. Neural Computation, 12:1083--1121, 2000.

Digital Library

[26]

B. Scholkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson. Estimating the support of a high-dimensional distribution. Neural Computation, 13(7):1443--1471, 2001.

Digital Library

[27]

A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transaction on Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000.

Digital Library

[28]

J. Smith and S.-F. Chang. Automated image retrieval using color and texture. IEEE Transaction on Pattern Analysis and Machine Intelligence, Nov. 1996.

[29]

K. Tieu and P. Viola. Boosting image retrieval. In Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'00), South Carolina, USA, 2000.

[30]

S. Tong and E. Chang. Support vector machine active learning for image retrieval. In Proceedings of the 9th ACM Intl. Conf. on Multimedia, pages 107--118. ACM Press, 2001.

Digital Library

[31]

V. N. Vapnik. Statistical Learning Theory. Wiley, 1998.

Digital Library

[32]

N. Vasconcelos and A. Lippman. Bayesian relevance feedback for content-based image retrieval. In Proceedings of IEEE Workshop on Content-based Access of Image and Video Libraries (CVPR'00), South Carolina, USA, 2000.

Digital Library

[33]

L. Wu, C. Faloutsos, K. P. Sycara, and T. R. Payne. FALCON: Feedback adaptive loop for content-based retrieval. The VLDB Journal, pages 297--306, 2000.

Digital Library

[34]

J. Xu and W. B. Croft. Query expansion using local and global document analysis. In Proceedings of the 19th Intl. ACM SIGIR Conf. (SIGIR'96), pages 4--11, 1996.

Digital Library

Cited By

Cha G(2020)Similarity ranking technique exploiting the structure of similarity relationshipsComputing10.1007/s00607-020-00859-w105:3(559-576)Online publication date: 17-Nov-2020
https://doi.org/10.1007/s00607-020-00859-w
Supreeth HPatil C(2018)Efficient multiple moving object detection and tracking using combined background subtraction and clusteringSignal, Image and Video Processing10.1007/s11760-018-1259-z12:6(1097-1105)Online publication date: 6-Mar-2018
https://doi.org/10.1007/s11760-018-1259-z
Chang E(2018)Semantic Modeling and Knowledge Representation for Multimedia DataEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1038(3399-3405)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1038
Show More Cited By

Index Terms

A novel log-based relevance feedback technique in content-based image retrieval
1. Information systems
  1. Information retrieval

Recommendations

A Unified Log-Based Relevance Feedback Scheme for Image Retrieval

Relevance feedback has emerged as a powerful tool to boost the retrieval performance in content-based image retrieval (CBIR). In the past, most research efforts in this field have focused on designing effective algorithms for traditional relevance ...
Interactive content-based image retrieval using relevance feedback

Database search engines are generally used in a one-shot fashion in which a user provides query information to the system and, in return, the system provides a number of database instances to the user. A relevance feedback system allows the user to ...
A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

October 2004

1028 pages

ISBN:1581138938

DOI:10.1145/1027527

General Chairs:
Henning Schulzrinne
Columbia University
,
Nevenka Dimitrova
Philips Research
,
Program Chairs:
Angela Sasse
UCL
,
Sue Moon
KAIST
,
Rainer Lienhart
U Augsburg

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 10 - 16, 2004

NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
1,216
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cha G(2020)Similarity ranking technique exploiting the structure of similarity relationshipsComputing10.1007/s00607-020-00859-w105:3(559-576)Online publication date: 17-Nov-2020
https://doi.org/10.1007/s00607-020-00859-w
Supreeth HPatil C(2018)Efficient multiple moving object detection and tracking using combined background subtraction and clusteringSignal, Image and Video Processing10.1007/s11760-018-1259-z12:6(1097-1105)Online publication date: 6-Mar-2018
https://doi.org/10.1007/s11760-018-1259-z
Chang E(2018)Semantic Modeling and Knowledge Representation for Multimedia DataEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1038(3399-3405)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1038
Pinjarkar LSharma MSelot S(2017)Novel System for Color Logo Recognition Using Optimization and Learning Based Relevance Feedback TechniqueInternational Journal of Computer Vision and Image Processing10.4018/IJCVIP.20171001037:4(28-40)Online publication date: Oct-2017
https://doi.org/10.4018/IJCVIP.2017100103
Chang E(2017)Semantic Modeling and Knowledge Representation for Multimedia DataEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_1038-2(1-6)Online publication date: 13-Jan-2017
https://doi.org/10.1007/978-1-4899-7993-3_1038-2
Zhiqiang ZHua SYun WZou Q(2016)Annotation-retrieval reinforcement by visual cognition modeling on manifoldNeurocomputing10.1016/j.neucom.2015.07.162215:C(150-159)Online publication date: 26-Nov-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.07.162
Jyothi BMadhaveeLatha YKrishna Mohan PReddy V(2016)Region Based Multiple Features for an Effective Content Based Access Medical Image Retrieval an Integrated with Relevance Feedback ApproachSwarm, Evolutionary, and Memetic Computing10.1007/978-3-319-48959-9_16(176-187)Online publication date: 1-Dec-2016
https://doi.org/10.1007/978-3-319-48959-9_16
Mosbah MBoucheham B(2015)Majority Voting Re-ranking Algorithm for Content Based-Image RetrievalMetadata and Semantics Research10.1007/978-3-319-24129-6_11(121-131)Online publication date: 3-Nov-2015
https://doi.org/10.1007/978-3-319-24129-6_11
Bugatti PKaster DPonciano-Silva MTraina CAzevedo-Marques PTraina A(2014)PRoSPerComputers in Biology and Medicine10.1016/j.compbiomed.2013.11.01545(8-19)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.compbiomed.2013.11.015
Zhang LWang LLin W(2013)A semantic subspace learning method to exploit relevance feedback log data for image retrieval2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM)10.1109/CIDM.2013.6597234(178-183)Online publication date: Apr-2013
https://doi.org/10.1109/CIDM.2013.6597234
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents