Article

Free access

Constructing semantic space models from parsed corpora

Authors:

Sebastian Padó,

Mirella LapataAuthors Info & Claims

ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1

Pages 128 - 135

https://doi.org/10.3115/1075096.1075113

Published: 07 July 2003 Publication History

Abstract

Traditional vector-based models use word co-occurrence counts from large corpora to represent lexical meaning. In this paper we present a novel approach for constructing semantic spaces that takes syntactic relations into account. We introduce a formalisation for this class of models and evaluate their adequacy on two modelling tasks: semantic priming and automatic discrimination of lexical relations.

References

[1]

Balota, David A. and Robert Lorch, Jr. 1986. Depth of automatic spreading activation: Mediated priming effects in pronunciation but not in lexical decision. Journal of Experimental Psychology: Learning, Memory and Cognition 12(3):336--45.

[2]

Burnard, Lou. 1995. Users Guide for the British National Corpus. British National Corpus Consortium, Oxford University Computing Service.

[3]

Choi, Freddy, Peter Wiemer-Hastings, and Johanna Moore. 2001. Latent Semantic Analysis for text segmentation. In Proceedings of EMNLP 2001. Seattle, WA.

[4]

Dunning, Ted. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 19:61--74.

Digital Library

[5]

Grefenstette, Gregory. 1994. Explorations in Automatic Thesaurus Discovery. Kluwer Academic Publishers.

Digital Library

[6]

Hodgson, James M. 1991. Informational constraints on pre-lexical priming. Language and Cognitive Processes 6:169--205.

[7]

Jones, Michael P. and James H. Martin. 1997. Contextual spelling correction using Latent Semantic Analysis. In Proceedings of the ANLP 97.

Digital Library

[8]

Keenan, E. and B. Comrie. 1977. Noun phrase accessibility and universal grammar. Linguistic Inquiry (8):62--100.

[9]

Kilgarriff, Adam and Colin Yallop. 2000. What's in a thesaurus. In Proceedings of LREC 2000. pages 1371--1379.

[10]

Landauer, T. and S. Dumais. 1997. A solution to Platos problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104(2):211--240.

[11]

Lee, Lillian. 1999. Measures of distributional similarity. In Proceedings of ACL '99. pages 25--32.

Digital Library

[12]

Lin, Dekang. 1998. Automatic retrieval and clustering of similar words. In Proceedings of COLING-ACL 1998. Montréal, Canada, pages 768--511.

Digital Library

[13]

Lin, Dekang. 2001. LaTaT: Language and text analysis tools. In J. Allan, editor, Proceedings of HLT 2001. Morgan Kaufmann, San Francisco.

Digital Library

[14]

Livesay, K. and C. Burgess. 1997. Mediated priming in high-dimensional meaning space: What is "mediated" in mediated priming? In Proceedings of COGSCI 1997. Lawrence Erlbaum Associates.

[15]

Lowe, Will. 2001. Towards a theory of semantic space. In Proceedings of COGSCI 2001. Lawrence Erlbaum Associates, pages 576--81.

[16]

Lowe, Will and Scott McDonald. 2000. The direct route: Mediated priming in semantic space. In Proceedings of COGSCI 2000. Lawrence Erlbaum Associates, pages 675--80.

[17]

Lund, Kevin and Curt Burgess. 1996. Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instruments, and Computers 28:203--8.

[18]

McDonald, Scott. 2000. Environmental Determinants of Lexical Processing Effort. Ph.D. thesis, University of Edinburgh.

[19]

Patel, Malti, John A. Bullinaria, and Joseph P. Levy. 1998. Extracting semantic representations from large text corpora. In Proceedings of the 4th Neural Computation and Psychology Workshop. London, pages 199--212.

[20]

Salton, G, A Wang, and C Yang. 1975. A vector-space model for information retrieval. Journal of the American Society for Information Science 18(613--620).

Digital Library

[21]

Schütze, Hinrich. 1998. Automatic word sense discrimination. Computational Linguistics 24(1):97--124.

Digital Library

[22]

Tesnière, Lucien. 1959. Elements de syntaxe structurale. Klincksieck, Paris.

Cited By

Cordeiro SVillavicencio AIdiart MRamisch C(2019)Unsupervised compositionality prediction of nominal compoundsComputational Linguistics10.1162/coli_a_0034145:1(1-57)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1162/coli_a_00341
Symonds MBruza PSitbon LTurner IChen XLebanon GWang HZaki M(2012)A tensor encoding model for semantic processingProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398617(2267-2270)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2398617
Ó Séaghdha DCopestake AGregoire NEvert SKim S(2007)Co-occurrence contexts for noun compound interpretationProceedings of the Workshop on a Broader Perspective on Multiword Expressions10.5555/1613704.1613712(57-64)Online publication date: 28-Jun-2007
https://dl.acm.org/doi/10.5555/1613704.1613712
Show More Cited By

Constructing semantic space models from parsed corpora
1. Computing methodologies
  1. Artificial intelligence
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Using Parsed Corpora for Structural Disambiguation in the TRAINS Domain
Constructing lexicon with morpho-syntactic features from untagged corpora
ECC'09: Proceedings of the 3rd international conference on European computing conference

This article presents a computational method of morpho-syntactic rules which automatically creates a lexicon with morphological features after disambiguation and PoS tagging in large non annotated corpora. The method is tested and implemented in two ...
Using parsed corpora for structural disambiguation in the TRAINS domain
ACL '96: Proceedings of the 34th annual meeting on Association for Computational Linguistics

This paper describes a prototype disambiguation module, KANKEI, which was tested on two corpora of the TRAINS project. In ambiguous verb phrases of form V ... NP PP or V ... NP adverb(s), the two corpora have very different PP and adverb attachment ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1

July 2003

571 pages

Program Chairs:
Erhard W. Hinrichs,
Dan Roth

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 07 July 2003

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
349
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)10

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cordeiro SVillavicencio AIdiart MRamisch C(2019)Unsupervised compositionality prediction of nominal compoundsComputational Linguistics10.1162/coli_a_0034145:1(1-57)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1162/coli_a_00341
Symonds MBruza PSitbon LTurner IChen XLebanon GWang HZaki M(2012)A tensor encoding model for semantic processingProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398617(2267-2270)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2398617
Ó Séaghdha DCopestake AGregoire NEvert SKim S(2007)Co-occurrence contexts for noun compound interpretationProceedings of the Workshop on a Broader Perspective on Multiword Expressions10.5555/1613704.1613712(57-64)Online publication date: 28-Jun-2007
https://dl.acm.org/doi/10.5555/1613704.1613712
Hachey BNerbonne JHinrichs E(2006)Comparison of similarity models for the relation discovery taskProceedings of the Workshop on Linguistic Distances10.5555/1641976.1641981(25-34)Online publication date: 23-Jul-2006
https://dl.acm.org/doi/10.5555/1641976.1641981
Abdalla RTeufel S(2006)A bootstrapping approach to unsupervised detection of cue phrase variantsProceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics10.3115/1220175.1220291(921-928)Online publication date: 17-Jul-2006
https://dl.acm.org/doi/10.3115/1220175.1220291
Stevenson MGreenwood MKnight K(2005)A semantic approach to IE pattern inductionProceedings of the 43rd Annual Meeting on Association for Computational Linguistics10.3115/1219840.1219887(379-386)Online publication date: 25-Jun-2005
https://dl.acm.org/doi/10.3115/1219840.1219887
Geffet MDagan IKnight K(2005)The distributional inclusion hypotheses and lexical entailmentProceedings of the 43rd Annual Meeting on Association for Computational Linguistics10.3115/1219840.1219854(107-114)Online publication date: 25-Jun-2005
https://dl.acm.org/doi/10.3115/1219840.1219854
Pekar VZock MDizier P(2004)Linguistic preprocessing for distributional classification of wordsProceedings of the Workshop on Enhancing and Using Electronic Dictionaries10.5555/1610042.1610046(15-21)Online publication date: 29-Aug-2004
https://dl.acm.org/doi/10.5555/1610042.1610046

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents