article

A survey on the use of relevance feedback for information access systems

Authors:

Mounia LalmasAuthors Info & Claims

The Knowledge Engineering Review, Volume 18, Issue 2

Pages 95 - 145

https://doi.org/10.1017/S0269888903000638

Published: 01 June 2003 Publication History

Abstract

Users of online search engines often find it difficult to express their need for information in the form of a query. However, if the user can identify examples of the kind of documents they require then they can employ a technique known as relevance feedback. Relevance feedback covers a range of techniques intended to improve a user's query and facilitate retrieval of information relevant to a user's information need. In this paper we survey relevance feedback techniques. We study both automatic techniques, in which the system modifies the user's query, and interactive techniques, in which the user has control over query modification. We also consider specific interfaces to relevance feedback systems and characteristics of searchers that can affect the use and success of relevance feedback systems.

References

[1]

Aalbersberg, IJ, 1992, "Incremental relevance feedback" Proceedings of the Fifteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 11-22.

[2]

Baeza-Yates, R and Ribeiro-Neto, B, 1999, Modern Information Retrieval Addison-Wesley.

[3]

Barry, CL and Schamber, L, 1998, "Users' criteria for relevance evaluation: a cross-situational comparison" Information, Processing and Management 34(2/3) 219-237.

Digital Library

[4]

Bates, M, 1990, "Where should the person stop and the information search interface start?" Information, Processing and Management 26(5) 575-592.

Digital Library

[5]

Bayes, T, 1763, "An essay toward solving a problem in the doctrine of chances" Philosophical Transactions of the Royal Society of London 53 370-418.

[6]

Beaulieu, M, 1997, "Experiments with interfaces to support query expansion" Journal of Documentation 53(1) 8-19.

[7]

Beaulieu, M and Jones, S, 1998, "Interactive searching and interface issues in the Okapi best match probabilistic retrieval system" Interacting with Computers 10(3) 237-248.

[8]

Belew, RK, 2000, Finding out about Cambridge University Press.

[9]

Belkin, NJ, 1997, "An overview of results from Rutgers's investigation of interactive information retrieval" Proceedings of the 34th Annual Clinic on Library Applications of Data Processing. Visualizing Subject Access for 21st Century Information Resources 45-62.

[10]

Belkin, NJ, Cabezas, A, Cool, C, Kim, K, Ng, KB, Park, S, Pressman, R, Rieh, S, Savage, P and Xie, H, 1997, "Rutgers interactive track at TREC-5" Proceedings of the Sixth Text Retrieval Conference (TREC-5) 257-266.

[11]

Belkin, NJ, Cool, C, Koenemann, J, Bor Ng, K and Park, S, 1996, "Using relevance feedback and ranking in interactive searching" Proceedings of the Fourth Text Retrieval Conference (TREC-4) 181-210.

[12]

Belkin, NJ, Kantor, P, Fox, EA and Shaw, JA, 1995, "Combining the evidence of multiple query representations for information retrieval" Information Processing and Management 31(3) 431-448.

Digital Library

[13]

Belkin, NJ, Perez Carballo, J, Cool, C, Lin, S, Park, SY, Rieh, SY, Savage, P, Sikora, C, Xie, H and Allan, J, 1998, "Rutgers' TREC-6 interactive track experience" Proceedings of the Sixth Text Retrieval Conference (TREC-6) 597-610.

[14]

Belkin, NJ, Perez Carballo, J, Kelly, D, Lin, S Park, SY, Rieh, SY, Savage-Knepshield, P, Sikora, C and Cool, C, 1999, "Rutgers' TREC-7 interactive track experience" Proceedings of the Seventh Text Retrieval Conference (TREC-7) 275-284.

[15]

Berger, F and van Bommel, P, 1997, "Augmenting a characterization network with semantic information" Information Processing and Management 33(4)45-479.

[16]

Bhatia, SK, 1992. "Selection of search terms based on user profile" Proceedings of the 1992 ACM/SIGAPP Symposium on Applied Computing. Vol. I: Technological Challenges of the 1990s 224-233.

[17]

Borgman, CL, 1989. "All users of information retrieval systems are not created equal: an exploration into individual differences" Information Processing and Management 25(3) 237-251.

Digital Library

[18]

Borgman, CL, 1996, "Why are online catalogs still hard to use?" Journal of the American Society for Information Science 47(7) 493-503.

Digital Library

[19]

Borlund, P and Ingwersen, P, 1997, "The development of a method for the evaluation of interactive information retrieval systems" Journal of Documentation 53(5) 225-250.

[20]

Borlund, P and Ingwersen, P, 1999, "The application of work tasks in connection with the evaluation of interactive information retrieval systems: empirical results" in S Draper, M Dunlop, I Ruthven and C J Van Rijsbergen (eds) Electronic Workshops in Computing British Computer Society.

[21]

Buckland, M and Gey, F, 1994, "The relationship between recall and precision" Journal of the American Society for Information Science 45(1) 12-19.

[22]

Buckley, C, Salton, G, Allan, J and Singhal, A, 1995, "Automatic query expansion using SMART: TREC-3" Proceedings of the Third Text Retrieval Conference (TREC-3) 69-80.

[23]

Callan, JP, Croft, WB and Harding, SM, 1992, "The INQUERY retrieval system" Database and Expert Systems Applications (DEXA) 78-83.

[24]

Campbell, I, 1995, "Supporting information needs by ostensive definition in an adaptive information space" in Ian Ruthven (ed.) MIRO'95. Electronic Workshops in Computing Springer Verlag.

[25]

Campbell, I, 1999, "Interactive evaluation of the ostensive model, using a new test-collection of images with multiple relevance assessments" Journal of Information Retrieval 2(1) 89-114.

[26]

Campbell, I and Van Rijsbergen, CJ, 1996, "Ostensive model of information needs" Proceedings of the Second International Conference on Conceptions of Library and Information Science: Integration in Perspective (CoLIS 2) 251-268.

[27]

Chang, YK, Cirillo, C and Razon, J, 1971, "Evaluation of feedback retrieval using modified freezing, residual collection & test and control groups" in G Salton (ed.) The SMART Retrieval System: Experiments in Automatic Document Processing Prentice-Hall Inc., Englewood Cliffs, NL.

[28]

Cool, C, Park, S, Belkin, NJ, Koenemann, J and Ng, KB, 1996., "Information seeking behavior in new searching environment" Proceedings of the Second International Conference on Conceptions of Library and Information Science: Integration in Perspective (CoLIS 2) 403-416.

[29]

Crestani, F, Lalmas, M and Van Rijsbergen, CJ, 1998, Information Retrieval: Uncertainty and Logics - Advanced Models for the Representation and Retrieval of Information Kluwer Academic Publishers.

[30]

Crestani, F, Ruthven, I, Sanderson, M and Van Rijsbergen, CJ, 1995, "The troubles with using a logical model of IR on a large collection of documents" Proceedings of the Fourth Text Retrieval Conference (TREC-4) 509-525.

[31]

Croft, W and Harper, D, 1979, "Using probabilistic models of information retrieval without relevance information" Journal of Documentation 35(4) 285-295.

[32]

Dennis, S, McArthur, R and Bruza, P, 1998, "Searching the WWW made easy? The Cognitive Load imposed by Query Refinement Mechanisms" Proceedings of the Third Australian Document Computing Symposium.

[33]

Denos, N, Berrut, C and Mechkour, M, 1997, "An image retrieval system based on the visualization of system relevance via documents" Database and Expert Systems Applications (DEXA) 214-224.

[34]

Dunlop, MD, 1997, "The effect of accessing non-matching documents on relevance feedback" ACM Transactions on Information Systems 15(2) 137-153.

Digital Library

[35]

Efthimiadis, EN, 1993, "A user-centred evaluation of ranking algorithms for interactive query expansion" Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 146-159.

[36]

Efthimiadis, EN, 1995, "User-choices: a new yardstick for the evaluation of ranking algorithms for interactive query expansion" Information Processing and Management 31(4) 605-620.

Digital Library

[37]

Efthimiadis, E and Biron, P, 1994, "UCLA-Okapi at TREC-2: query expansion experiments" Proceedings of the Second Text Retrieval Conference (TREC-2) 279-290.

[38]

Eisenberg, M and Barry, C, 1988, "Order effects: a study of the possible influence of presentation order on user judgements of document relevance" Journal of the American Society of Information Science 39(5) 293-300.

[39]

Ellis, D, 1989, "A behavioural approach to information system design" Journal of Documentation 45(3) 171-212.

Digital Library

[40]

Fants, VI, Shapiro, J, Taksa, I and Voiskunskii, VG, 1999, "Boolean search: current state and perspectives" Journal of the American Society of Information Science 50(1) 86-95.

[41]

Fidel, R, 1991, "Searchers' selection of search keys: I" Journal of the American Society of Information Science 34.

[42]

Florance, V and Marchionini, G, 1995, "Information processing in the context of medical care" Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 158-163.

[43]

Fowkes, H and Beaulieu, M, 2000, "Interactive searching behaviour: Okapi experiment for TREC-8" IRSG 2000 Colloquium on IR Research.

[44]

Frei, HP, Meienberg, S and Schauble, P, 1991, "The perils of interpreting recall and precision values" in N Fuhr (ed.) Information Retrieval Springer Verlag.

[45]

Fuhr, N and Buckley, C, 1991, "A probabilistic learning approach for document indexing" ACM Transactions on Information Systems 9(3) 223-248.

Digital Library

[46]

Haines, D and Croft, WB, 1993, "Relevance feedback and inference networks" Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2-11.

[47]

Harman, D, 1988, "Towards interactive query expansion" Proceedings of the Eleventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 321-331.

[48]

Harman, D, 1992a, "Ranking algorithms" in WB Frakes and R Baeza-Yates (eds) Information Retrieval: Data Structures and Algorithms Prentice Hall.

[49]

Harman, D, 1992b, "Relevance feedback revisited" Proceedings of the Fifteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1-10.

[50]

Harman, D, 1992c, "Relevance feedback and other query modification techniques" in WB Frakes and R Baeza-Yates (eds) Information Retrieval: Data Structures and Algorithms Prentice Hall.

[51]

Harman, D, 1993, "Overview of the first text retrieval conference (TREC-1)" Proceedings of the First Text Retrieval Conference (TREC-1) 1-20.

[52]

Hearst, M, 1999, "User interfaces and visualisation" in R Baeza-Yates and B Riberio-Nelo (eds) Modern information retrieval Addison-Wesley/ACM Press.

[53]

Heuer, RJ Jr, 1999, Psychology of Intelligence Analysis Center for the Study of Intelligence, Central Intelligence Agency.

[54]

Hsieh-Yee, I, 1993, "Effects of searcher experience and subject knowledge on the search tactics of novice and experienced searchers" Journal of the American Society for Information Science 44(3) 161-174.

[55]

Huibers, T, 1996, "An axiomatic theory for information retrieval" Ph.D. thesis, Utrecht University.

[56]

Ide, E, 1971, "New experiments in relevance feedback" in G Salton (ed.) The SMART Retrieval System: Experiments in Automatic Document Processing Prentice-Hall Inc., Englewood Cliffs, NL.

[57]

Ide, E and Salton, G, 1971, "Interactive search strategies and dynamic file organization in information retrieval" in G Salton (ed.) The SMART Retrieval System: Experiments in Automatic Document Processing Prentice-Hall Inc., Englewood Cliffs, NL.

[58]

Ingwersen, P, 1992, Information Retrieval Interaction Taylor-Graham.

[59]

Ingwersen, P, 1994, "Polyrepresentation of information needs and semantic entities: elements of a cognitive theory for information retrieval interaction" Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 101-110.

[60]

Ingwersen, P, 1996, "Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory" Journal of Documentation 52(1) 3-50.

[61]

Iwayama, M, 2000, "Relevance feedback with a small number of relevance judgements: incremental relevance feedback vs. document clustering" Proceedings of the Twenty-Third Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 10-16.

[62]

Janes, JW, 1991, "Relevance judgements and the incremental presentation of document representations" Information Processing and Management 27(6) 629-646.

[63]

Khoo, CSG and Poo, DCC, 1994, "An expert system approach to online catalog subject searching" Information Processing and Management 30(2) 223-238.

Digital Library

[64]

Koenemann, J and Belkin, NJ, 1996, "A case for interaction: a study of interactive information retrieval behavior and effectiveness" Proceedings of the Human Factors in Computing Systems Conference (CHI'96) 205-212.

[65]

Koenemann, J, Quatrain, R, Cool, C and Belkin, NJ, 1995, "New tools and old habits: the interactive searching behavior of expert online searchers using INQUERY" Proceedings of the Third Text Retrieval Conference (TREC-3) 145-178.

[66]

Kuhlthau, CC, 1991, "Inside the search process: information seeking from the user's perspective" Journal of the American Society of Information Science 42(5) 361-371.

[67]

Kuhlthau, CC, 1993, "Principle for uncertainty for information seeking" Journal of Documentation 49(4) 339-355.

[68]

Lalmas, M, 1996, "Modelling information retrieval with Dempster-Shafer's theory of evidence: a case study" ECAI Workshop on Uncertainty in Information Systems: Questions of Viability 29-36.

[69]

Lalmas, M and Bruza, PD, 1998, "The use of logic in information retrieval modelling" Knowledge Engineering Review 13(2) 1-33.

[70]

Lee, JH, 1998, "Combining the evidence of different relevance feedback methods for information retrieval" Information Processing and Management 34(6) 681-691.

Digital Library

[71]

Lundquist, C, Grossman, DA and Frieder, O, 1997, "Improving relevance feedback in the vector space model" Proceedings of the sixth international conference on Information and knowledge management (CIKM'97) Las Vegas. 16-23.

[72]

Magennis, M and Van Rijsbergen, CJ, 1997, "The potential and actual effectiveness of interactive query expansion" Proceedings of the Twentieth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 324-331.

[73]

Maron, ME and Kuhns, JL, 1960, "On relevance, probabilistic indexing and information retrieval" Journal of the Association for Computing Machinery 15 8-36; reprinted in 1997 in K Sparck Jones and P Willet (eds) Readings in Information Retrieval Morgan Kaufman.

[74]

Maron, ME, 1964, "Mechanized documentation: the logic behind a probabilistic interpretation" in ME Stevens, VE Guiliano and LB Heilprin (eds) Statistical Association Methods For Mechanized Documentation National Bureau of Standards Miscellaneous Publications 269.

[75]

Martin, WA, 1982, "Helping the less experienced user" Proceedings of the 6th International Online Meeting 67-76.

[76]

Mitra, M, Singhal, A and Buckley, C, 1998, "Improving automatic query expansion" Proceedings of the Twenty-First Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 206-214.

[77]

Müller, A, 1998, "A flexible framework for multimedia information retrieval" in F Crestani, M Lalmas and CJ Van Rijsbergen (eds) Information Retrieval: Uncertainty and Logics: Advanced Models for the Representation and Retrieval of Information Kluwer Academic Publishers.

[78]

Nie, J, 1989, "An information retrieval model based on modal logic" Information Processing and Management 25(5) 471-490.

[79]

Peat, HJ and Willett, P, 1991, "The limitations of term co-occurrence data for query expansion in document retrieval systems" Journal of the American Society for Information Science 42(5) 378-383.

[80]

Peters, TA, 1989, "When smart people fail: an analysis of the transaction log of an online public access catalog" The Journal of Academic Librarianship 15(5) 267-273.

[81]

Porter, M and Galpin, V, 1988, "Relevance feedback in a public access catalogue for a research library: Muscat at the Scott Polar Research Institute" Program 22(1) 1-20.

Digital Library

[82]

Porter, MF, 1980, "An algorithm for suffix stripping" Program 14 130-137.

[83]

Robertson, SE, 1977, "The probability ranking principle in IR" Journal of Documentation 33(4) 294-304.

[84]

Robertson, SE, 1986, "On relevance weight estimation and query expansion" Journal of Documentation 42(3) 182-188.

[85]

Robertson, SE, 1990, "On term selection for query expansion" Journal of Documentation 46(4) 359-364.

Digital Library

[86]

Robertson, SE and Belkin, NJ, 1978, "Ranking in principle" Journal of Documentation 34(2) 93-100.

[87]

Robertson, SE and Sparck Jones, K, 1976, "Relevance weighting of search terms" Journal of the American Society for Information Science 27(3) 129-146.

[88]

Robertson, SE and Walker, S, 1994, "Some simple effective approximations to the 2 Poission model for probabilistic weighted retrieval" Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 232-241.

[89]

Robertson, SE, Walker, S, Hancock-Beaulieu, M, Gull, A and Lau, M, 1993, "Okapi at TREC" Proceedings of the First Text Retrieval Conference (TREC-1) 21-30.

[90]

Robertson, SE, Walker, S, Jones, S, Hancock-Beaulieu, MM and Gatford, M, 1995, "Okapi at TREC-3" Proceedings of the Third Text Retrieval Conference (TREC-3) 109-126.

[91]

Rocchio, JJ, 1971, "Relevance feedback in information retrieval" in G Salton (ed.) The Smart Retrieval System: Experiments in Automatic Document Processing Prentice-Hall Inc., Englewood Cliffs, NL.

[92]

Ruthven, I, 2002, "On the use of explanations as a mediating device for relevance feedback" Proceedings of the 6th European Conference on Digital Libraries. (ECDL 2002) 338-345.

[93]

Ruthven, I, Lalmas, M and Van Rijsbergen, CJ, 2001, "Empirical investigations on query modification using abductive explanations" Proceedings of the Twenty-Fourth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 181-189.

[94]

Ruthven, I, Lalmas, M and Van Rijsbergen, CJ, 2002a, "Combining and selecting characteristics of information use" Journal of the American Society for Information Science and Technology 53(5) 378-396.

Digital Library

[95]

Ruthven, I, Lalmas, M and Van Rijsbergen, CJ, 2002b, "Ranking expansion terms using partial and ostensive evidence" Proceedings of the 4th International Conference on Conceptions of Library and Information Science. CoLIS 4 199-220.

[96]

Ruthven, I, Lalmas, M and Van Rijsbergen, CJ, 2003, "Incorporating user search behaviour into relevance feedback" Journal of the American Society for Information Science and Technology 54(6) 528-548.

Digital Library

[97]

Ruthven, I, Tombros, A and Jose, J, 2001, "A study on the use of summaries and summary-based query expansion for a question-answering task" 23rd BCS European Annual Colloquium on Information Retrieval Research (ECIR'01).

[98]

Salton, G (ed), 1971, The SMART Retrieval System: Experiments in Automatic Document Processing.

[99]

Salton, G and Buckley, C, 1990, "Improving retrieval performance by relevance feedback" Journal of the American Society for Information Science 41(4) 288-297.

[100]

Sebastiani, F, 1994, "A probabilistic terminological logic for modelling information retrieval" Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 122-130.

[101]

Shenouda, W, 1991, "Online bibliographic searching: how end-users modify their search strategies" Proceedings of the 53rd Annual Meeting of the American Society for Information Science 26 3-48.

[102]

Simonnot, B, 1996, "Modélisation multi-agents d'un système de recherche d'information multimédia à forte composante vidéo (Multi-Agent Modelling of a multimedia information retrieval system for still images and video collections)" Ph.D. thesis. Henri Poincaré University.

[103]

Smeaton, A and Van Rijsbergen, CJ, 1983, "The retrieval effects of query expansion on a feedback document retrieval system" The Computer Journal 26(3) 239-246.

[104]

Smeaton, A, 1998, "Independence of contributing retrieval strategies in data fusion for effective information retrieval" Proceedings of the 20th BCS-IRSG Colloquium.

[105]

Sparck Jones, K, 1972, "A statistical interpretation of term specificity and its application in retrieval" Journal of Documentation 28(1) 11-20.

[106]

Sparck Jones, K, 1979, "Search term relevance weighting given little relevance information" Journal of Documentation 35(1) 30-48.

[107]

Sparck Jones, K, Walker, S and Robertson, SE, 2000a, "A probabilistic model of information retrieval: development and comparative experiments - Part 1" Information Processing and Management 36(6) 779-808.

Digital Library

[108]

Sparck Jones, K, Walker, S and Robertson, SE, 2000b, "A probabilistic model of information retrieval: development and comparative experiments - Part 2" Information Processing and Management 36(6) 809-840.

Digital Library

[109]

Spiegel, J and Bennett, E, 1964, "A modified statistical association procedure for automatic document content analysis and retrieval" in ME Stevens, VE Guiliano and LB Heilprin (eds) Statistical Association Methods For Mechanized Documentation National Bureau of Standards Miscellaneous Publications 269.

[110]

Spink, A, 1996, "Multiple search sessions model of end-user behavior: an exploratory study" Journal of the American Society for Information Science 47(8) 603-609.

Digital Library

[111]

Spink, A, 1997, "Study of interactive feedback during mediated information retrieval" Journal of the American Society for Information Science 48(5) 382-394.

[112]

Spink, A, Greisdorf, H and Bateman, J, 1998, "From highly relevant to not relevant: examining different regions of relevance" Information Processing and Management 34(5) 599-621.

Digital Library

[113]

Spink, A, and Saracevic, T, 1993, "Dynamics of search term selection process in mediated online searching" Proceedings of the 56th Annual Meeting of the American Society for Information Science 30 63-72.

[114]

Spink, A and Saracevic, T, 1997, "Interaction in information retrieval: selection and effectiveness of search terms" Journal of the American Society for Information Science 48(8) 741-761.

Digital Library

[115]

Spink, A and Wilson, TD, 1999, "Toward a theoretical framework for information retrieval (IR) evaluation in an information seeking context" in S Draper, M Dunlop, I Ruthven and CJ Van Rijsbergen (eds) Mira'99: Evaluating Information Retrieval Electronic Workshops in Computing.

[116]

Su, LT, 1994, "The relevance of recall and precision in user evaluation" Journal of the American Society for Information Science 45(3) 207-217.

Digital Library

[117]

Sumner, RG Jr, Yang, K, Akers, R and Shaw, WM Jr, 1998, "Interactive retrieval using IRIS: TREC-6 experiments" Proceedings of the Sixth Text Retrieval Conference (TREC-6) 711-734.

[118]

Tiamiyu, MA and Ajiferuke, IY, 1988, "A total relevance and document interaction effects model for the evaluation of information retrieval processes" Information Processing and Management 24(4) 391-404.

Digital Library

[119]

Vakkari, P, 2000, "Relevance and contributing information types of searched documents in task performance" Proceedings of the Twenty-Third Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2-9.

[120]

Vakkari, P, 2001, "Cognition and changes of search terms and tactics during task performance" Proceedings of RIAO Conference on Content-Based Multimedia Information Access 894-907.

[121]

Van Rijsbergen, CJ, 1979, Information Retrieval 2nd edition, Butterworths.

[122]

Van Rijsbergen, CJ, 1986, "A non-classical logic for information retrieval" The Computer Journal 29(6) 48-485.

[123]

Van Rijsbergen, CJ, Harper, D and Porter, M, 1981, "The selection of good search terms" Information Processing and Management 17(2) 77-91.

[124]

Voorhees, EH and Harman, D, 2000, "Overview of the sixth Text Retrieval Conference (TREC-6)" Information Processing and Management 36(1) 3-35.

Digital Library

[125]

Voorhees, EM and Harman, D, 1996, "Overview of the fifth Text Retrieval Conference (TREC-5)" Proceedings of the 5th Text Retrieval Conference 1-29.

[126]

White, RW, Jose, J and Ruthven, I, 2003, "A task-oriented study on the influencing effects of query-biased summarisation in web searching" Information Processing and Management 39(5) 707-723.

Digital Library

[127]

Willie, S and Bruza, P, 1995, "Users' models of the information space: the case for two search models" Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 205-210.

Cited By

Fitzgerald Kde la Harpe AUys C(2023)The hybridised indexing method for research-based information retrievalJournal of Information Science10.1177/016555152199980049:2(319-334)Online publication date: 22-Mar-2023
https://dl.acm.org/doi/10.1177/0165551521999800
Ye ZXie XAi QLiu YWang ZSu WZhang M(2023)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 18-Dec-2023
https://dl.acm.org/doi/10.1145/3637874
Sheetrit ERaiber FKurland OYoshioka MKiseleva JAliannejadi M(2023)Entity-Based Relevance Feedback for Document RetrievalProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605128(177-187)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.1145/3578337.3605128
Show More Cited By

A survey on the use of relevance feedback for information access systems
1. Information systems
  1. Information retrieval

Recommendations

Does pseudo-relevance feedback improve distributed information retrieval systems?

This paper presents a thorough analysis of the capabilities of the pseudo-relevance feedback (PRF) technique applied to distributed information retrieval (DIR). Previous studies have researched the application of PRF to improve the selection process of ...
A Relevance Feedback Architecture for Content-based Multimedia Information Retrieval Systems
CAIVL '97: Proceedings of the 1997 Workshop on Content-Based Access of Image and Video Libraries (CBAIVL '97)

Content-based multimedia information retrieval (MIR) has become one of the most active research areas in the past few years. Many retrieval approaches based on extracting and representing visual properties of multimedia data have been developed. While ...
Re-examining the effects of adding relevance information in a relevance feedback environment

This paper presents an investigation about how to automatically formulate effective queries using full or partial relevance information (i.e., the terms that are in relevant documents) in the context of relevance feedback (RF). The effects of adding ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image The Knowledge Engineering Review

The Knowledge Engineering Review Volume 18, Issue 2

June 2003

98 pages

ISSN:0269-8889

Issue’s Table of Contents

Publisher

Cambridge University Press

United States

Publication History

Published: 01 June 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

150
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fitzgerald Kde la Harpe AUys C(2023)The hybridised indexing method for research-based information retrievalJournal of Information Science10.1177/016555152199980049:2(319-334)Online publication date: 22-Mar-2023
https://dl.acm.org/doi/10.1177/0165551521999800
Ye ZXie XAi QLiu YWang ZSu WZhang M(2023)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 18-Dec-2023
https://dl.acm.org/doi/10.1145/3637874
Sheetrit ERaiber FKurland OYoshioka MKiseleva JAliannejadi M(2023)Entity-Based Relevance Feedback for Document RetrievalProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605128(177-187)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.1145/3578337.3605128
Wang WDumont FNiu NHorton G(2022)Detecting Software Security Vulnerabilities Via Requirements Dependency AnalysisIEEE Transactions on Software Engineering10.1109/TSE.2020.303074548:5(1665-1675)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1109/TSE.2020.3030745
Kieffer SGouze AVanderdonckt J(2022)A Multimodal, Usable, and Flexible Clinical Decision-Support System for Breast Cancer Diagnosis and ReportingSN Computer Science10.1007/s42979-022-01451-z4:1Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1007/s42979-022-01451-z
Di Nunzio GVezzani F(2022)Did I Miss Anything? A Study on Ranking Fusion and Manual Query Rewriting in Consumer Health SearchExperimental IR Meets Multilinguality, Multimodality, and Interaction10.1007/978-3-031-13643-6_17(217-229)Online publication date: 5-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-13643-6_17
Breuer TFuhr NSchaer P(2022)Validating Simulations of User Query VariantsAdvances in Information Retrieval10.1007/978-3-030-99736-6_6(80-94)Online publication date: 10-Apr-2022
https://dl.acm.org/doi/10.1007/978-3-030-99736-6_6
Yang EMacAvaney SLewis DFrieder O(2022)Goldilocks: Just-Right Tuning of BERT for Technology-Assisted ReviewAdvances in Information Retrieval10.1007/978-3-030-99736-6_34(502-517)Online publication date: 10-Apr-2022
https://dl.acm.org/doi/10.1007/978-3-030-99736-6_34
Claveau V(2021)Neural text generation for query expansion in information retrievalIEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology10.1145/3486622.3493957(202-209)Online publication date: 14-Dec-2021
https://dl.acm.org/doi/10.1145/3486622.3493957
Han XLiu YLin JHasibi FFang YAizawa A(2021)The Simplest Thing That Can Possibly Work: (Pseudo-)Relevance Feedback via Text ClassificationProceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3471158.3472261(123-129)Online publication date: 11-Jul-2021
https://dl.acm.org/doi/10.1145/3471158.3472261
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents