Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

A new relational reflection graph convolutional network for the knowledge representation

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

The goal of the knowledge representation is to embed entities and relationships in the facts into consecutive low-dimensional dense vectors. Although shallow embedding methods can directly map entities or relations into vectors, they lose information about the structure of the knowledge graph network during the learning process. Alternatively, deep embedding methods can be used to learn rich structural information. As a practical matter, existing deep embedding methods rely too heavily on simple logical operations, such as subtraction and multiplication, between entities and relations. This paper proposes a method for deep embedding, RRGCN. Unlike the traditional method of knowledge graph convolution, this method does not rely on logical transformations to determine aggregation information. In RRGCN, aggregation information is defined as a mapping projection of neighboring features on a unique hyperplane that corresponds to the relation. Furthermore, RRGCN constructs a residual neural network between two graph convolution layers in order to reduce the amount of information loss as a consequence of superimposing graph convolution layers on top of each other. Results from experiments show that RRGCN is capable of performing well on the publicly available benchmark datasets FB15k-237 and WN18RR in the knowledge graph link prediction task, which outerforms the state-of-the-art relevent models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Amin S, Varanasi S, Ann Dunfield K, Neumann G (2020) Lowfer: Low-rank bilinear pooling for link prediction. In: International Conference on Machine Learning, pages 257–268. PMLR,

  • Balažević I, Allen C, Hospedales TM (2019) Tucker: Tensor factorization for knowledge graph completion. In the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5188–5197,

  • Bo D, Wang X, Shi C, Shen Huawei (2021) Beyond low-frequency information in graph convolutional networks. Natl Conf Artificial Intell 35:3950–3957

    Google Scholar 

  • Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: the 2008 ACM SIGMOD international conference on Management of data, pages 1247–1250,

  • Bordes A, Usunier, N Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: 27nd Conference on Neural Information Processing Systems (NIPS), pages 2787–2795,

  • Cai Hongyun, Zheng Vincent W, Chang Kevin Chen-Chuan (2018) A comprehensive survey of graph embedding: Problems, techniques, and applications. IEEE Trans Knowl Data Eng 30(9):1616–1637

    Article  Google Scholar 

  • Chami I, Ying Z, Ré C, Leskovec J(2019) Hyperbolic graph convolutional neural networks. Adv Neural Inform Process Syst 32

  • Chang Xiaojun, Nie Feiping, Wang Sen, Yang Yi, Zhou Xiaofang, Zhang Chengqi (2015) Compound rank-\( k \) projections for bilinear analysis. IEEE Trans Neural Netw Learni Syst 27(7):1502–1513

    Article  MathSciNet  Google Scholar 

  • Chen Kaixuan, Yao Lina, Zhang Dalin, Wang Xianzhi, Chang Xiaojun, Nie Feiping (2019) A semisupervised recurrent convolutional attention model for human activity recognition. IEEE Trans Neural Netw Learn Syst 31(5):1747–1756

    Article  Google Scholar 

  • Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel (2018) Convolutional 2d knowledge graph embeddings. In: 32nd AAAI Conference on Artificial Intelligence, pages 1811–1818,

  • Gesese GA, Biswas R, Sack H (2019) A comprehensive survey of knowledge graph embeddings with literals: Techniques and applications. In DL4KG2019-Workshop on Deep Learning for Knowledge Graphs, pages 31–40,

  • Leskovec AGJ (2016) node2vec: Scalable feature learning for networks. In: the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pages 855–864,

  • Jiang X, Wang Q, Wang B (2019) Adaptive convolution for multi-relational learning. In: the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, volume 1, pages 978–987,

  • Kazemi SM, Poole D (2018) Simple embedding for link prediction in knowledge graphs. In: the 32nd International Conference on Neural Information Processing Systems, pages 4289–4300,

  • Kipf T, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (ICLR),

  • Lacroix T, Usunier N, Obozinski G (2018) Canonical tensor decomposition for knowledge base completion. In: International Conference on Machine Learning (ICML), pages 2863–2872. PMLR,

  • Li Zhihui, Nie Feiping, Chang Xiaojun, Nie Liqiang, Zhang Huaxiang, Yang Yi (2018) Rank-constrained spectral clustering with flexible embedding. IEEE Trans Neural Netwk Learn Syst 29(12):6073–6082

    Article  MathSciNet  Google Scholar 

  • Li Z, Nie F, Chang X, Yang Yi, Zhang Chengqi, Sebe Nicu (2018) Dynamic affinity graph construction for spectral clustering using multiple features. IEEE Trans Neural Netwk Learn Syst 29(12):6323–6332

    Article  MathSciNet  Google Scholar 

  • Luo Minnan, Chang Xiaojun, Nie Liqiang, Yang Yi, Hauptmann Alexander G, Zheng Qinghua (2017) An adaptive semisupervised feature analysis for video semantic recognition. IEEE Trans Cybernet 48(2):648–660

    Article  Google Scholar 

  • X Mao, Wang W, Xu H, Wu Y, Lan M (2020) Relational reflection entity alignment. In the 29th ACM International Conference on Information & Knowledge Management, pages 1095–1104,

  • Nathani D, Chauhan J, Sharma C, Kaul M (2019) Learning attention-based embeddings for relation prediction in knowledge graphs. In: 57th Annual Meeting of the Association-for-Computational-Linguistics (ACL), pages 4710–4723, 2019

  • Nickel Maximilian, Rosasco Lorenzo, Poggio Tomaso (2016) Holographic embeddings of knowledge graphs. Natl Conf Artificial Intell 30:1955–1961

    Google Scholar 

  • Bryan Perozzi, Rami Al-Rfou, Steven Skiena (2014) Deepwalk: Online learning of social representations. In the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’14, pages 701–710. ACM,

  • Ren F, Li J, Zhang H, Liu S, Li B, Ming R, Bai Y (2020) Knowledge graph embedding with atrous convolution and residual learning. In the 28th International Conference on Computational Linguistics, pages 1532–1543,

  • Rossi Andrea, Barbosa Denilson, Firmani Donatella, Matinata Antonio, Merialdo Paolo (2021) Knowledge graph embedding for link prediction: a comparative analysis. ACM Trans Knowl Discovery from Data (TKDD) 15(2):1–49

    Article  Google Scholar 

  • Schlichtkrull M, Kipf TN, Bloem P, Van Den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: European Semantic Web conference, pages 593–607. Springer,

  • Sun Z, Deng Z-H, Nie J-Y, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International Conference on Learning Representations (ICLR),

  • Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In the 2016 International Conference on Machine Learning. International Conference on Machine Learning (ICML),

  • Vashishth S, Sanyal S, Nitin V, Agrawal N, Talukdar PP (2020a) Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. In 34nd AAAI Conference on Artificial Intelligence, pages 3009–3016,

  • Vashishth S, Sanyal S, Nitin V, Talukdar P (2020b) Composition-based multi-relational graph convolutional networks. In: International Conference on Learning Representations, ICLR,

  • Velickovic Petar, Cucurull Guillem, Casanova Arantxa, Romero Adriana, Lio Pietro, Bengio Yoshua (2017) Graph attention networks. Stat Sci 1050:20

    Google Scholar 

  • Wang Quan, Mao Zhendong, Wang Bin, Guo Li (2017) Knowledge graph embedding: a survey of approaches and applications. IEEE Trans Knowl Data Eng 29(12):2724–2743

    Article  Google Scholar 

  • Wang Zhen, Zhang Jianwen, Feng Jianlin, Chen Zheng (2014) Knowledge graph embedding by translating on hyperplanes. Natl Conf Artificial Intell 28:1112–1119

    Google Scholar 

  • Wang Zikang, Li Linjing, Zeng Daniel (2021) Srgcn: Graph-based multi-hop reasoning on knowledge graphs. Neurocomputing 454:280–290

    Article  Google Scholar 

  • Yang B, Yih W-t, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: 3rd International Conference on Learning Representations, ICLR,

  • Ye R, Li X, Fang Y, Zang H, Wang M (2019) A vectorized relational graph convolutional network for multi-relational network alignment. In: International Joint Conferences on Artificial Intelligence (IJCAI), pages 4135–4141

  • Yuan D, Chang X, Li Z, He Z (2022) Learning adaptive spatial-temporal context-aware correlation filters for uav tracking. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 18(3):1–18

  • Zhang W, Paudel B, Zhang W, Bernstein A, Chen H (2019) Interaction embeddings for prediction and explanation in knowledge graphs. In the Twelfth ACM International Conference on Web Search and Data Mining, pages 96–104

  • Zhu G, Iglesias CA (2018) Exploiting semantic similarity for named entity disambiguation in knowledge graphs. Expert Systems with Applications, 101 (JUL.):8–24,

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pi Dechang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shuanglong, Y., Dechang, P. A new relational reflection graph convolutional network for the knowledge representation. J Ambient Intell Human Comput 14, 4191–4200 (2023). https://doi.org/10.1007/s12652-023-04516-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-023-04516-w

Keywords

Navigation