Abstract
Most of the previous knowledge graph question answering (KGQA) methods focus on question parsing and ignore the knowledge graph information. In order to improve the utilization of knowledge graph structure information, based on the good performance of graph networks in the field of knowledge graph embedding, this paper proposes to utilize relational graph attention networks to pre-train the knowledge graph Q&A database. Entity and relation representations are obtained by fusing multi-hop information and the results are used to initialize the vector representation of nodes and edges in the graph. Inference is then performed using a multi-hop Q&A network based on relational paths. Since most current inference models do not consider path-level information, LSTM is introduced to encode paths in the model fusion process. In order to improve the reliability of inference, a multilayer attention mechanism is introduced to calculate the similarity between the paths and the original problem, so as to obtain the weight coefficients of the paths, which are fused into the relation and entity scores. Experiments demonstrate that the optimized Q&A inference method outperforms the original and baseline models on the MetaQA, WebQSP and CWQ datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Liang, C., Berant, J., Le, Q., Forbus, K., Lao, N.: Neural symbolic machines: Learning semantic parsers on freebase with weak supervision. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers), pp. 23–33 (2017)
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: Dbpedia: a nucleus for a web of open data. In: Aberer, K. (ed.) ASWC/ISWC -2007. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76298-0_52
Mahdisoltani, F., Biega, J., Suchanek, F.M.: Yago3: a knowledge base from multilingual wikipedias. In: CIDR (2013)
Thambi, S.V., Reghu Raj, P.C.: A novel technique using graph neural networks and relevance scoring to improve the performance of knowledge graph-based question answering systems. J. Intell. Inf. Syst. 62(3), 809–832 (2024). https://doi.org/10.1007/s10844-023-00839-4
Miller, A., Fisch, A., Dodge, J., Karimi, A.H., Bordes, A., Weston, J.: Key-value memory networks for directly reading documents. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1400–1409 (2016)
Xu, K., Lai, Y., Feng, Y., Wang, Z.: Enhancing key-value memory neural networks for knowledge based question answering. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 2937–2947 (2019)
Zeng, L., et al.: KBQA: accelerate fuzzy path query on knowledge graph. In: Strauss, C., Amagasa, T., Gabriele Kotsis, A., Tjoa, M., Khalil, I. (eds.) Database and Expert Systems Applications: 34th International Conference, DEXA 2023, Penang, Malaysia, August 28–30, 2023, Proceedings, Part I, pp. 462–477. Springer Nature Switzerland, Cham (2023). https://doi.org/10.1007/978-3-031-39847-6_37
Zhang, Y., Dai, H., Kozareva, Z., Smola, A., Song, L.: Variational reasoning for question answering with knowledge graph. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Zhou, M., Huang, M., Zhu, X.: An interpretable reasoning network for multi-relation question answering. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 2010–2022 (2018)
He, G., Lan, Y., Jiang, J., Zhao, W.X., Wen, J.R.: Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 553–561 (2021)
Wang, P., Xie, X., Wang, X., Zhang, N.: Reasoning through memorization: nearest neighbor knowledge graph embeddings. In: Liu, F., Duan, N., Qingting, X., Hong, Y. (eds.) Natural Language Processing and Chinese Computing: 12th National CCF Conference, NLPCC 2023, Foshan, China, October 12–15, 2023, Proceedings, Part I, pp. 111–122. Springer Nature Switzerland, Cham (2023). https://doi.org/10.1007/978-3-031-44693-1_9
Sun, H., Dhingra, B., Zaheer, M., Mazaitis, K., Salakhutdinov, R., Cohen, W.: Open domain question answering using early fusion of knowledge bases and text. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4231–4242 (2018)
Yih, W.t., Richardson, M., Meek, C., Chang, M.W., Suh, J.: The value of semantic parse labeling for knowledge base question answering. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 2: Short Papers), pp. 201–206 (2016)
Talmor, A., Berant, J.: The web as a knowledge-base for answering complex questions. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long Papers), pp. 641–651 (2018)
Shi, J., Cao, S., Hou, L., Li, J., Zhang, H.: Transfernet: an effective and transparent framework for multi-hop question answering over relation graph. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 4149–4158 (2021)
Acknowledgements
The authors would like to thank the two anonymous reviewers for their comments on this paper. This research was supported by the National Natural Science Foundation of China (Nos. 62276177 and 62376181), and Key R&D Plan of Jiangsu Province (BE2021048).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Cao, S., Zhu, X., Li, P. (2024). A Knowledge Graph Question Answering Approach Based on Graph Attention Networks and Relational Path Encoding. In: Huang, DS., Si, Z., Zhang, Q. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science(), vol 14877. Springer, Singapore. https://doi.org/10.1007/978-981-97-5669-8_7
Download citation
DOI: https://doi.org/10.1007/978-981-97-5669-8_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5668-1
Online ISBN: 978-981-97-5669-8
eBook Packages: Computer ScienceComputer Science (R0)