Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2806416.2806513acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Large-scale Knowledge Base Completion: Inferring via Grounding Network Sampling over Selected Instances

Published: 17 October 2015 Publication History

Abstract

Constructing large-scale knowledge bases has attracted much attention in recent years, for which Knowledge Base Completion (KBC) is a key technique. In general, inferring new facts in a large-scale knowledge base is not a trivial task. The large number of inferred candidate facts has resulted in the failure of the majority of previous approaches. Inference approaches can achieve high precision for formulas that are accurate, but they are required to infer candidate instances one by one, and extremely large candidate sets bog them down in expensive calculations. In contrast, the existing embedding-based methods can easily calculate similarity-based scores for each candidate instance as opposed to using inference, so they can handle large-scale data. However, this type of method does not consider explicit logical semantics and usually has unsatisfactory precision. To resolve the limitations of the above two types of methods, we propose an approach through Inferring via Grounding Network Sampling over Selected Instances. We first employ an embedding-based model to make the instance selection and generate much smaller candidate sets for subsequent fact inference, which not only narrows the candidate sets but also filters out part of the noise instances. Then, we only make inferences within these candidate sets by running a data-driven inference algorithm on the Markov Logic Network (MLN), which is called Inferring via Grounding Network Sampling (INS). In this process, we especially incorporate the similarity priori generated by embedding-based models into INS to promote the inference precision. The experimental results show that our approach improved Hits@1 from 32.911% to 71.692% on the FB15K dataset and achieved much better AP@n evaluations than state-of-the-art methods.

References

[1]
M. Al Hasan and M. J. Zaki. Output space sampling for graph patterns. In VLDB, 2009.
[2]
K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor. Freebase: a collaboratively created graph database for structuring human knowledge. In SIGMOD, 2008.
[3]
A. Bordes, X. Glorot, J. Weston, and Y. Bengio. A semantic matching energy function for learning with multi-relational data. Machine Learning, 2013.
[4]
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko. Translating embeddings for modeling multi-relational data. In NIPS, 2013.
[5]
A. Bordes, J. Weston, R. Collobert, Y. Bengio, et al. Learning structured embeddings of knowledge bases. In AAAI, 2011.
[6]
A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. Hruschka Jr, and T. M. Mitchell. Toward an architecture for never-ending language learning. In AAAI, 2010.
[7]
X. L. Dong, K. Murphy, E. Gabrilovich, G. Heitz, W. Horn, N. Lao, T. Strohmann, S. Sun, and W. Zhang. Knowledge vault: A web-scale approach to probabilistic knowledge fusion. In KDD, 2014.
[8]
L. A. Galrraága, C. Teioudi, K. Hose, and F. Suchanek. Amie: association rule mining under incomplete evidence in ontological knowledge bases. In WWW, 2013.
[9]
A. Garcáa-Duran, A. Bordes, and N. Usunier. Effective blending of two and three-way interactions for modeling multi-relational data. In ECML/PKDD. 2014.
[10]
J. Hoffart, F. M. Suchanek, K. Berberich, and G. Weikum. Yago2: a spatially and temporally enhanced knowledge base from wikipedia. Artificial Intelligence, 2013.
[11]
T. N. Huynh and R. J. Mooney. Discriminative structure and parameter learning for markov logic networks. In ICML, 2008.
[12]
R. Jenatton, N. L. Roux, A. Bordes, and G. R. Obozinski. A latent factor model for highly multi-relational data. In NIPS, 2012.
[13]
T. Khot, S. Natarajan, K. Kersting, and J. Shavlik. Learning markov logic networks via functional gradient boosting. In ICDM, 2011.
[14]
S. Kok and P. Domingos. Learning the structure of markov logic networks. In ICML, 2005.
[15]
S. Kok and P. Domingos. Learning markov logic networks using structural motifs. In ICML, 2010.
[16]
N. Lao, T. Mitchell, and W. W. Cohen. Random walk inference and learning in a large scale knowledge base. In EMNLP, 2011.
[17]
C.-H. Lee, X. Xu, and D. Y. Eun. Beyond random walk and metropolis-hastings samplers: why you should not backtrack for unbiased graph sampling. In SIGMETRICS, 2012.
[18]
Y. Lin, Z. Liu, M. Sun, Y. Liu, and X. Zhu. Learning entity and relation embeddings for knowledge graph completion. In AAAI, 2015.
[19]
L. Mihalkova and R. J. Mooney. Bottom-up learning of markov logic network structure. In ICML, 2007.
[20]
B. Min, R. Grishman, L. Wan, C. Wang, and D. Gondek. Distant supervision for relation extraction with an incomplete knowledge base. In HLT-NAACL, 2013.
[21]
M. Nickel, V. Tresp, and H.-P. Kriegel. A three-way model for collective learning on multi-relational data. In ICML, 2011.
[22]
M. Richardson and P. Domingos. Markov logic networks. Machine learning, 2006.
[23]
R. Socher, D. Chen, C. D. Manning, and A. Ng. Reasoning with neural tensor networks for knowledge base completion. In NIPS, 2013.
[24]
Z. Sun, Z. Wei, J. Wang, and H. Hao. Scalable learning for structure in markov logic networks. In AAAI 2014 Workshop on StarAI, 2014.
[25]
W. Y. Wang, K. Mazaitis, and W. W. Cohen. Programming with personalized pagerank: a locally groundable first-order probabilistic logic. In CIKM, 2013.
[26]
Z. Wang, J. Zhang, J. Feng, and Z. Chen. Knowledge graph embedding by translating on hyperplanes. In AAAI, 2014.

Cited By

View all
  • (2024)Advancing Chatbot Conversations: A Review of Knowledge Update ApproachesJournal of the Brazilian Computer Society10.5753/jbcs.2024.288230:1(55-68)Online publication date: 25-Apr-2024
  • (2024)Neural-Symbolic Methods for Knowledge Graph Reasoning: A SurveyACM Transactions on Knowledge Discovery from Data10.1145/368680618:9(1-44)Online publication date: 12-Aug-2024
  • (2022)A Systematic Review of Deep Knowledge Graph-Based Recommender Systems, with Focus on Explainable EmbeddingsData10.3390/data70700947:7(94)Online publication date: 12-Jul-2022
  • Show More Cited By

Index Terms

  1. Large-scale Knowledge Base Completion: Inferring via Grounding Network Sampling over Selected Instances

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management
    October 2015
    1998 pages
    ISBN:9781450337946
    DOI:10.1145/2806416
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 October 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. embedding
    2. inference
    3. knowledge base completion

    Qualifiers

    • Research-article

    Funding Sources

    • National High Technology Research and Development Program of China
    • National Natural Science Foundation of China

    Conference

    CIKM'15
    Sponsor:

    Acceptance Rates

    CIKM '15 Paper Acceptance Rate 165 of 646 submissions, 26%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)13
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Advancing Chatbot Conversations: A Review of Knowledge Update ApproachesJournal of the Brazilian Computer Society10.5753/jbcs.2024.288230:1(55-68)Online publication date: 25-Apr-2024
    • (2024)Neural-Symbolic Methods for Knowledge Graph Reasoning: A SurveyACM Transactions on Knowledge Discovery from Data10.1145/368680618:9(1-44)Online publication date: 12-Aug-2024
    • (2022)A Systematic Review of Deep Knowledge Graph-Based Recommender Systems, with Focus on Explainable EmbeddingsData10.3390/data70700947:7(94)Online publication date: 12-Jul-2022
    • (2022)Association Rules Enhanced Knowledge Graph Attention NetworkKnowledge-Based Systems10.1016/j.knosys.2021.108038239:COnline publication date: 5-Mar-2022
    • (2021)A survey on knowledge graph embeddings with literalsSemantic Web10.3233/SW-20040412:4(617-647)Online publication date: 1-Jan-2021
    • (2021)Taking a Closed-Book ExaminationComputational Intelligence and Neuroscience10.1155/2021/66897402021Online publication date: 1-Jan-2021
    • (2021)A Scheme for Kinship Reasoning based on Ontology2021 IEEE International Conference on Big Knowledge (ICBK)10.1109/ICKG52313.2021.00038(222-229)Online publication date: Dec-2021
    • (2021)Relation Path Modeling with Entity Types for Knowledge Graph Completion2021 International Conference on Computer Engineering and Application (ICCEA)10.1109/ICCEA53728.2021.00049(209-215)Online publication date: Jun-2021
    • (2021)A Probabilistic Inference Based Approach for Querying Associative Entities in Knowledge GraphWeb and Big Data10.1007/978-3-030-85899-5_6(75-89)Online publication date: 23-Aug-2021
    • (2020)Hybrid reasoning in knowledge graphsSemantic Web10.3233/SW-19037511:1(53-62)Online publication date: 1-Jan-2020
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media