Article

Free access

Kernel methods for relation extraction

Authors:

Dmitry Zelenko,

Anthony RichardellaAuthors Info & Claims

EMNLP '02: Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

Pages 71 - 78

https://doi.org/10.3115/1118693.1118703

Published: 06 July 2002 Publication History

Abstract

We present an application of kernel methods to extracting relations from unstructured natural language sources. We introduce kernels defined over shallow parse representations of text, and design efficient algorithms for computing the kernels. We use the devised kernels in conjunction with Support Vector Machine and Voted Perceptron learning algorithms for the task of extracting person-affiliation and organization-location relations from text. We experimentally evaluate the proposed methods and compare them with feature-based learning algorithms, with promising results.

References

[1]

C. Aone and M. Ramos-Santacruz. 2000. REES: A large-scale relation and event extraction system. In Proceedings of ANLP-2000.

Digital Library

[2]

C. Aone, L. Halverson, T. Hampton, and M. Ramos-Santacruz. 1998. SRA: Description of the IE2 system used for MUC-7. In Proceedings of MUC-7.

[3]

D. Bikel, R. Schwartz, and R. Weischedel. 1999. An algorithm that learns what's in a name. Machine Learning, 34(1-3):211--231.

Digital Library

[4]

M. Collins and N. Duffy. 2001. Convolution kernels for natural language. In Proceedings of NIPS-2001.

[5]

C. Cortes and V. Vapnik. 1995. Support-vector networks. Machine Learning, 20(3):273--297.

[6]

N. Cristianini and J. Shawe-Taylor. 2000. An Introduction to Support Vector Machines (and Other Kernel-Based Learning Methods). CUP

Digital Library

[7]

R. O. Duda and P. E. Hart. 1973. Pattern Classification and Scene Analysis. John Wiley, New York.

[8]

Y. Freund and R. Schapire. 1999. Large margin classification using the perceptron algorithm. Machine Learning, 37(3):277--296.

Digital Library

[9]

T. Furey, N. Cristianini, N. Duffy, D. Bednarski, M. Schummer, and D. Haussler. 2000. Support vector machine classification and validation of cancer tissue samples using microarray expression. Bioinformatics, 16.

[10]

D. Haussler. 1999. Convolution kernels on discrete structures. UC Santa Cruz Technical Report UCS-99-10.

[11]

T. Joachims. 1998. Text categorization with support vector machines: learning with many relevant features. Proceedings of ECML-98.

Digital Library

[12]

T. Joachims. 2002. Learning Text Classifiers with Support Vector Machines. Kluwer Academic Publishers, Dordrecht, NL.

Digital Library

[13]

J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML-2001.

Digital Library

[14]

N. Littlestone. 1987. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 2:285.

Digital Library

[15]

H. Lodhi, C. Saunders, J. Shawe-Taylor, N. Cristianini, and C. Watkins. 2002. Text classification using string kernels. Journal of Machine Learning Research.

Digital Library

[16]

A. McCallum, D. Freitag, and F. Pereira. 2000. Maximum entropy Markov models for information extraction and segmentation. In Proceedings of International Conference on Machine Learning, 2000.

Digital Library

[17]

S. Miller, M. Crystal, H. Fox, L. Ramshaw, R. Schwartz, R. Stone, and R. Weischedel. 1998. Algorithms that learn to extract information - BBN: Description of the SIFT system. In Proceedings of MUC-7.

[18]

M. Munoz, V. Punyakanok, D. Roth, and D. Zimak. 1999. A learning approach to shallow parsing. TR-2087, University of Illinois at Urbana-Champaign.

Digital Library

[19]

D. Roth and W. Yih. 2001. Relational learning via propositional algorithms: An information extraction case study. In Proceedings of IJCAI-01.

Digital Library

[20]

D. Roth. 1999. Learning in natural language. In Proceedings of IJCAI-99.

Digital Library

[21]

V. Vapnik. 1998. Statistical Learning Theory. John Wiley.

Cited By

Li QYao NZhou NZhao J(2025)Entity and relationship extraction based on span contribution evaluation and focusing frameworkComputer Speech and Language10.1016/j.csl.2024.10174490:COnline publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1016/j.csl.2024.101744
Liu SChen XMeng JLukač N(2025)Improved relation extraction through key phrase identification using community detection on dependency treesComputer Speech and Language10.1016/j.csl.2024.10170689:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.csl.2024.101706
Wang LAmrouch HHu JGarg SLin Y(2024)LLM-Assisted Analytics in Semiconductor Test (Invited)Proceedings of the 2024 ACM/IEEE International Symposium on Machine Learning for CAD10.1145/3670474.3685974(1-7)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3670474.3685974
Show More Cited By

Recommendations

Kernel methods for relation extraction

We present an application of kernel methods to extracting relations from unstructured natural language sources. We introduce kernels defined over shallow parse representations of text, and design efficient algorithms for computing the kernels. We use ...
Exploring syntactic structured features over parse trees for relation extraction using kernel methods

Extracting semantic relationships between entities from text documents is challenging in information extraction and important for deep information processing and management. This paper proposes to use the convolution kernel over parse trees together with ...
Study of kernel-based methods for Chinese relation extraction
AIRS'08: Proceedings of the 4th Asia information retrieval conference on Information retrieval technology

In this paper, we mainly explore the effectiveness of two kernel-based methods, the convolution tree kernel and the shortest path dependency kernel, in which parsing information is directly applied to Chinese relation extraction on ACE 2007 corpus. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

EMNLP '02: Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

July 2002

328 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 06 July 2002

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 73 of 234 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

48
Total Citations
View Citations
931
Total Downloads

Downloads (Last 12 months)139
Downloads (Last 6 weeks)21

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li QYao NZhou NZhao J(2025)Entity and relationship extraction based on span contribution evaluation and focusing frameworkComputer Speech and Language10.1016/j.csl.2024.10174490:COnline publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1016/j.csl.2024.101744
Liu SChen XMeng JLukač N(2025)Improved relation extraction through key phrase identification using community detection on dependency treesComputer Speech and Language10.1016/j.csl.2024.10170689:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.csl.2024.101706
Wang LAmrouch HHu JGarg SLin Y(2024)LLM-Assisted Analytics in Semiconductor Test (Invited)Proceedings of the 2024 ACM/IEEE International Symposium on Machine Learning for CAD10.1145/3670474.3685974(1-7)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3670474.3685974
Wei PHuang ZOuyang HHu QZeng BFeng GGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)CGI-MRE: A Comprehensive Genetic-Inspired Model For Multimodal Relation ExtractionProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658103(524-532)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658103
Dai QYang WWang LWei FTuo M(2024)SOIRPNeurocomputing10.1016/j.neucom.2024.127492580:COnline publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.neucom.2024.127492
Wang GLiu JXie JZhu ZZhou F(2024)Joint multimodal entity-relation extraction based on temporal enhancement and similarity-gated attentionKnowledge-Based Systems10.1016/j.knosys.2024.112504304:COnline publication date: 25-Nov-2024
https://dl.acm.org/doi/10.1016/j.knosys.2024.112504
Sun XGuo QGe S(2024)GFNKnowledge-Based Systems10.1016/j.knosys.2024.112137300:COnline publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1016/j.knosys.2024.112137
Shang WWang BZhu PDing LWang S(2024)A Span-based Multivariate Information-aware Embedding Network for joint relational triplet extraction of threat intelligenceKnowledge-Based Systems10.1016/j.knosys.2024.111829295:COnline publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1016/j.knosys.2024.111829
Liu BSong HLin YWeng XSu ZZhao XYang J(2024)PRTAComputers in Biology and Medicine10.1016/j.compbiomed.2024.108539176:COnline publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1016/j.compbiomed.2024.108539
Yan QDing RLu L(2023)RPnet: A Relation Perception based Entity-relation Extraction MethodProceedings of the 2023 International Conference on Artificial Intelligence, Systems and Network Security10.1145/3661638.3661642(16-22)Online publication date: 22-Dec-2023
https://dl.acm.org/doi/10.1145/3661638.3661642
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten