Abstract
Current knowledge graph completion suffers from two major issues: data sparsity and false negatives. To address these challenges, we propose an ontology-guided joint embedding framework that utilizes dual data augmentation channels and a joint loss function to learn embeddings of knowledge graphs. Our approach spontaneously generates positive and negative instances from two distinct ontology axiom sets, leading to improved completion rates for originally sparse knowledge graphs while also producing true-negative samples. Additionally, we propose two novel metrics for evaluating a model’s reasoning capabilities in predicting relations or links using KG and ontology data, thus avoiding incorrect predictions. Empirical results demonstrate that our framework outperforms existing models in most tasks and datasets, with significantly better performance in many cases for reasoning capability evaluation metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Balažević, I., Allen, C., Hospedales, T.: Tucker: tensor factorization for knowledge graph completion. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5185–5194 (2019)
Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems 26, pp. 2787–2795 (2013)
Chao, L., He, J., Wang, T., Chu, W.: PairRE: knowledge graph embeddings via paired relation vectors. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 4360–4369. Association for Computational Linguistics (2021)
Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence (2018)
Gao, C., Sun, C., Shan, L., Lin, L., Wang, M.: Rotate3D: representing relations as rotations in three-dimensional space for knowledge graph embedding. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 385–394 (2020)
Guo, Q., et al.: A survey on knowledge graph-based recommender systems (2020)
Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pp. 687–696. Association for Computational Linguistics (2015)
Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Advances in Neural Information Processing Systems 31 (2018)
Kipf, T., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of ICLR, pp. 1–14 (2017)
Lan, Y., He, G., Jiang, J., Jiang, J., Zhao, W.X., Wen, J.R.: A survey on complex knowledge base question answering: methods, challenges and solutions (2021)
Li, Z., et al.: Efficient non-sampling knowledge graph embedding. In: Proceedings of the Web Conference 2021, pp. 1727–1736. WWW 2021, Association for Computing Machinery (2021)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence, pp. 2181–2187 (2015)
Mahdisoltani, F., Biega, J., Suchanek, F.M.: YAGO3: a knowledge base from multilingual wikipedias. In: Proceedings of CIDR 2015 (2015)
Mintz, M., Bills, S., Snow, R., Jurafsky, D.: Distant supervision for relation extraction without labeled data, pp. 1003–1011 (2009)
Motik, B., Grau, B.C., Horrocks, I., Wu, Z., Fokoue, A., Lutz, C.: OWL 2 web ontology language profiles (second edition). W3C Recommendation 11 December 2012 (2012)
Nathani, D., Chauhan, J., Sharma, C., Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4710–4723. Association for Computational Linguistics (2019)
Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., Phung, D.: A novel embedding model for knowledge base completion based on convolutional neural network, vol. 2, pp. 327–333 (2018)
Nickel, M., Tresp, V., Kriegel, H.P.: A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th International Conference on International Conference on Machine Learning, pp. 809–816. ICML2011, Omnipress (2011)
Pujara, J., Augustine, E., Getoor, L.: Sparsity and noise: where knowledge graph embeddings fall short. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 1751–1756. Association for Computational Linguistics, Copenhagen, Denmark (2017)
Reiter, R.: Deductive question-answering on relational data bases. In: Gallaire, H., Minker, J. (eds.) Logic and Data Bases, pp. 149–177. Springer, US, Boston, MA (1978). https://doi.org/10.1007/978-1-4684-3384-5_6
Saxena, A., Tripathi, A., Talukdar, P.: Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 4498–4507. Association for Computational Linguistics (2020)
Schlichtkrull, M., Kipf, T.N., Bloem, P., Berg, R.V.D., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: ESWC, pp. 593–607 (2018)
Schneider, P., Schopf, T., Vladika, J., Galkin, M., Simperl, E., Matthes, F.: A decade of knowledge graphs in natural language processing: a survey (2022)
Shang, C., Tang, Y., Huang, J., Bi, J., He, X., Zhou, B.: End-to-end structure-aware convolutional networks for knowledge base completion. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3060–3067 (2019)
Song, T., Luo, J., Huang, L.: Rot-Pro: modeling transitivity by projection in knowledge graph embedding. In: Proceedings of the Thirty-Fifth Annual Conference on Advances in Neural Information Processing Systems (NeurIPS) (2021)
Sun, Z., Deng, Z.H., Nie, J.Y., Tang, J.: Rotate: Knowledge graph embedding by relational rotation in complex space. In: International Conference on Learning Representations, pp. 1–18 (2019)
Sun, Z., Vashishth, S., Sanyal, S., Talukdar, P., Yang, Y.: A re-evaluation of knowledge graph completion methods. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5516–5522. Association for Computational Linguistics (2020)
Tang, Z., et al.: Positive-unlabeled learning with adversarial data augmentation for knowledge graph completion. In: Raedt, L.D. (ed.) Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, pp. 2248–2254. International Joint Conferences on Artificial Intelligence Organization (2022)
Toutanova, K., Chen, D.: Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 57–66 (2015)
Trouillon, T., Welbl, J., S. Riedel, E.G., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of 33rd International Conference Machine Learning, pp. 2071–2080 (2016)
Wang, H., et al.: Knowledge-aware graph neural networks with label smoothness regularization for recommender systems, pp. 968–977. KDD 2019, Association for Computing Machinery, New York, NY, USA (2019)
Wang, X., et al.: KEPLER: a Unified Model for Knowledge Embedding and Pre-trained Language Representation. Trans. Assoc. Comput. Linguist. 9, 176–194 (2021)
Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI Conference on Artificial Intelligence, pp. 1112–1119 (2014)
Xiong, T.H.W., Wang, W.Y.: DeepPath: a reinforcement learning method for knowledge graph reasoning. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2017)
Yang, B., Yih, W., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: ICLR, pp. 1–13 (2015)
Zhang, S., Tay, Y., Yao, L., Liu, Q.: Quaternion knowledge graph embedding. Adv. Neural. Inf. Process. Syst. 32, 2731–2741 (2019)
Acknowledgement
This work was supported by the National Key R &D Program of China (Grant No. 2021ZD0112901) and National Natural Science Foundation of China (Grant No. 62276014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Song, T., Yin, L., Ma, X., Luo, J. (2023). Dual Channel Knowledge Graph Embedding with Ontology Guided Data Augmentation. In: Jin, Z., Jiang, Y., Buchmann, R.A., Bi, Y., Ghiran, AM., Ma, W. (eds) Knowledge Science, Engineering and Management. KSEM 2023. Lecture Notes in Computer Science(), vol 14117. Springer, Cham. https://doi.org/10.1007/978-3-031-40283-8_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-40283-8_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40282-1
Online ISBN: 978-3-031-40283-8
eBook Packages: Computer ScienceComputer Science (R0)