Article

Iterative residual rescaling

Authors:

Rie Kubota Ando,

Lillian LeeAuthors Info & Claims

SIGIR '01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 154 - 162

https://doi.org/10.1145/383952.383981

Published: 01 September 2001 Publication History

Abstract

We consider the problem of creating document representations in which inter-document similarity measurements correspond to semantic similarity. We first present a novelsubspace-basedframework for formalizing this task. Using this framework, we derive a new analysis ofLatent Semantic Indexing(LSI), showing a precise relationship between its performance and theuniformityof the underlying distribution of documents over topics. This analysis helps explain the improvements gained by Ando's (2000)Iterative Residual Rescaling(\ours) algorithm: \ours\ can compensate for distributional non-uniformity. A further benefit of our framework is that it provides a well-motivated, effective method for automatically determining the rescaling factor \ours\ depends on, leading to further improvements. A series of experiments over various settings and with several evaluation metrics validates our claims.

References

[1]

R.K.Ando.Latent semantic space:Iterative scaling improves inter-document similarity measurement.In Proceedings of the 23rd SIGIR pages 216 -223,2000.

Digital Library

[2]

R.K.Ando.The Document Representation Problem: An Analysis of LSI and Iterative Residual Rescaling PhD thesis,Cornell University,2001.Forthcoming.

Digital Library

[3]

Y.Azar,A.Fiat,A.Karlin,F.McSherry,and J.Saia. Spectral analysis of data.In Proceedings of the ACM Symposium on Theory of Computing (STOC),2001.

Digital Library

[4]

B.T.Bartell,G.W.Cottrell,and R.K.Belew.Latent Semantic Indexing is an optimal special case of Multidimensional Scaling.In Proceedings of the 15th SIGIR pages 161 -167,1992.

Digital Library

[5]

M.W.Berry,S.T.Dumais,andG.W.O 'Brien. Using linear algebra for intelligent information retrieval.SIAM Review 37(4):573 -595,1995.

Digital Library

[6]

B.Boguraev and M.Ne .Discourse segmentation in aid of document summarization.In Proceedings of the Hawaii International Conference on System Sciences 2000.

Digital Library

[7]

J.Carletta.Assessing agreement on classi .cation tasks:The kappa statistic.Computational Linguistics 22(2):249 -254,1996.

Digital Library

[8]

C.Davis and W.M.Kahan.The rotation of eigenvectors y a perturbation.III.SIAM Journal on Numerical Analysis 7(1):1 -46,March 1970.

[9]

S.Deerwester,S.Dumais,G.Furnas,T.Landauer, and R.Harshman.Indexing y Latent Semantic Analysis.Journal of the American Society for Information Science 41(6):391 -407,1990.

[10]

C.H.Ding.A similarity-ased probability model for Latent Semantic Indexing.In Proceedings of the 22nd SIGIR pages 58 -65,1999.

Digital Library

[11]

S.T.Dumais.Improving the retrieval of information from external sources.Behavior Research Methods, Instruments, & Computers 23(2):229 -236,1991.

[12]

S.T.Dumais and J.Nielsen.Automating the assignment of su mitted manuscripts to reviewers.In Proceedings of SIGIR '92 pages 233 -244,1992.

Digital Library

[13]

P.W.Foltz and S.T.Dumais.Personalized information delivery:An analysis of information .ltering methods.Communications of the ACM 35(12):51 -60,1992.

Digital Library

[14]

P.W.Foltz,W.Kintsch,and T.K.Landauer.The measurement of textual coherence with Latent Semantic Analysis.Discourse Processes 25(2-3):285 -307,1998.

[15]

G.H.Golu and C.F.Van Loan.Matrix Computations The Johns Hopkins University Press, third edition,1996.

[16]

C.H.Papadimitriou,P.Raghavan,H.Tamaki,and S.Vempala.Latent Semantic Indexing:A probabilistic analysis.Journal of Computer and System Sciences 61(2):217 -235,2000.

Digital Library

[17]

S.Siegel and N.J.Castellan,Jr.Nonparametric Statistics for the Behavioral Sciences McGraw Hill, second edition,1988.

[18]

N.Slonim and N.Tish y.Document clustering using word clusters via the information ottleneck method. In Proceedings of the 23rd SIGIR pp.208 -215,2000.

Digital Library

[19]

G.W.Stewart and J.Sun.Matrix Perturbation Theory Computer Science and Scienti .c Computing. Academic Press,San Diego,1990.

[20]

R.E.Story.An explanation of the e .ectiveness of Latent Semantic Indexing y means of a Bayesian regression model.Information Processing & Management 32(3):329 -344,1996.

Digital Library

[21]

M.B.W.Wolfe,M.E.Schreiner,B.Rehder, D.Laham,P.Foltz,W.Kintsch,and T.K.Landauer. Learning from text:Matching readers and text y Latent Semantic Analysis.Discourse Processes 25:309 -336,1998.

[22]

H.Zha,O.Marques,and H.D.Simon.Large-scale SVD and su space-ased methods for information retrieval.In Solving Irregularly Structured Problems in Paral l el, Proceedings of 5th International Symposium (IRREGULAR'98),num er 1457 in Lecture Notes in Computer Science,pages 29 -42.Springer-Verlag,1998.

Digital Library

Cited By

Khalpada VKoringa PMitra S(2019)Document Representation using Extended Locality Preserving Indexing2019 IEEE 16th India Council International Conference (INDICON)10.1109/INDICON47234.2019.9030348(1-4)Online publication date: Dec-2019
https://doi.org/10.1109/INDICON47234.2019.9030348
Sartori EVelegrakis YGuerra F(2016)Entity-Based Keyword Search in Web DocumentsTransactions on Computational Collective Intelligence XXI - Volume 963010.5555/3090176.3090178(21-49)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.5555/3090176.3090178
Sartori EVelegrakis YGuerra F(2016)Entity-Based Keyword Search in Web DocumentsTransactions on Computational Collective Intelligence XXI10.1007/978-3-662-49521-6_2(21-49)Online publication date: 2016
https://doi.org/10.1007/978-3-662-49521-6_2
Show More Cited By

Index Terms

Iterative residual rescaling
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document analysis
2. Information systems
  1. Information retrieval

Recommendations

The Document Representation Problem: An Analysis of LSI and Iterative Residual Rescaling
Visualization-enabled multi-document summarization by Iterative Residual Rescaling

This paper describes a novel approach to multi-document summarization, which explicitly addresses the problem of detecting, and retaining for the summary, multiple themes in document collections. We place equal emphasis on the processes of theme ...
Iterative Search using Query Aspects
CIKM '16: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management

Pseudo-relevance feedback (PRF) via query expansion has proven to be effective in many information retrieval tasks. In most existing work, the top-ranked documents from an initial search are assumed to be relevant and used for feedback. There are some ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval

September 2001

454 pages

ISBN:1581133316

DOI:10.1145/383952

Chairmen:
Donald H. Kraft
Louisiana State Univ.
,
W. Bruce Croft
University of Massachusetts, (For the Americas)
,
David J. Harper
The Robert Gordon University, (For Europe and Africa)
,
Justin Zobel
RMIT University, (For Asia and Australasia)

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGIR01

Sponsor:

SIGIR

SIGIR01: 24th ACM/SIGIR International Conference on Research and Development in Information Retrieval

Louisiana, New Orleans, USA

Acceptance Rates

SIGIR '01 Paper Acceptance Rate 47 of 201 submissions, 23%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
506
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Khalpada VKoringa PMitra S(2019)Document Representation using Extended Locality Preserving Indexing2019 IEEE 16th India Council International Conference (INDICON)10.1109/INDICON47234.2019.9030348(1-4)Online publication date: Dec-2019
https://doi.org/10.1109/INDICON47234.2019.9030348
Sartori EVelegrakis YGuerra F(2016)Entity-Based Keyword Search in Web DocumentsTransactions on Computational Collective Intelligence XXI - Volume 963010.5555/3090176.3090178(21-49)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.5555/3090176.3090178
Sartori EVelegrakis YGuerra F(2016)Entity-Based Keyword Search in Web DocumentsTransactions on Computational Collective Intelligence XXI10.1007/978-3-662-49521-6_2(21-49)Online publication date: 2016
https://doi.org/10.1007/978-3-662-49521-6_2
Fahsi MBenslimane S(2014)Studying the effects of conflicting tokenization on LSA dimension reduction2014 International Conference on Multimedia Computing and Systems (ICMCS)10.1109/ICMCS.2014.6911367(542-546)Online publication date: Apr-2014
https://doi.org/10.1109/ICMCS.2014.6911367
Na SLee J(2014)Partial-update dimensionality reduction for accumulating co-occurrence eventsPattern Recognition Letters10.1016/j.patrec.2013.08.03236(62-73)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1016/j.patrec.2013.08.032
Morchid MDufour RNiaz UBouvier Fde Groc Cde Loupy CLinarès GMerialdo BPeralta B(2014)SuMACC Project’s CorpusText, Speech and Dialogue10.1007/978-3-319-10816-2_4(29-36)Online publication date: 2014
https://doi.org/10.1007/978-3-319-10816-2_4
Morchid MDufour RLinares G(2013)Event detection from image hosting services by slightly-supervised multi-span context models2013 11th International Workshop on Content-Based Multimedia Indexing (CBMI)10.1109/CBMI.2013.6576563(103-107)Online publication date: Jun-2013
https://doi.org/10.1109/CBMI.2013.6576563
Steinberger JJežek KBorghoff UChidlovskii B(2009)Update summarization based on novel topic distributionProceedings of the 9th ACM symposium on Document engineering10.1145/1600193.1600239(205-213)Online publication date: 16-Sep-2009
https://dl.acm.org/doi/10.1145/1600193.1600239
Yan HGrosky WFotouhi F(2008)Augmenting the power of LSI in text retrievalData & Knowledge Engineering10.1016/j.datak.2007.10.00565:1(108-125)Online publication date: 1-Apr-2008
https://dl.acm.org/doi/10.1016/j.datak.2007.10.005
Stein BKraaij Wde Vries AClarke CFuhr NKando N(2007)Principles of hash-based text retrievalProceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval10.1145/1277741.1277832(527-534)Online publication date: 23-Jul-2007
https://dl.acm.org/doi/10.1145/1277741.1277832
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents