Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

A hierarchical interactive multi-channel graph neural network for technological knowledge flow forecasting

Published: 01 July 2022 Publication History

Abstract

Technological advancement can provide new and more cost-effective solutions to challenges in critical areas. Therefore, as one of the important sources for technological progress, technological knowledge flow (TKF) forecasting, i.e., predicting the directional flows of knowledge from one technological field to another, has become a hot issue of widespread concern. However, existing researches either rely on labor-intensive empirical analysis or ignore the intrinsic characteristics inherent in TKF. To this end, we present a data-driven solution in this article, namely a hierarchical interactive multi-channel graph neural network (HIMTKF). Specifically, HIMTKF generates final predictions using two types of vector representations for each technology node (a diffusion vector and an absorption vector), which is realized by four components: high-order interaction module (HOI), co-occurrence module (CO), improved hierarchical delivery module (IHD) and technological knowledge flow tracing module (TFT). For one thing, HOI and CO are designed to represent high-order network relationships and co-occurrence relationships between technologies on the same hierarchy level. For another, IHD is aimed to model the hierarchical relationships between technologies while also taking their personalities into account. Then, TFT is intended for capturing the dynamic feature evolution of technologies with the above relations involved. Additionally, we develop a hybrid loss function and propose a new evaluation metric for better forecasting the unprecedented knowledge flows between technologies. Finally, we conduct extensive experiments on a large dataset of real-world patents. The results validate the effectiveness of our approach and shed light on several intriguing phenomena about technological knowledge flow trends.

References

[1]
Aaldering LJ, Leker J, and Song CH Competition or collaboration?—analysis of technological knowledge ecosystem within the field of alternative powertrain systems: a patent-based approach J Clean Prod 2019 212 362-371
[2]
Zhang L, Zhu H, Xu T, et al ( 2019) Large-scale talent flow forecast with dynamic latent factor model. In: The world wide web conference, pp 2312–2322
[3]
Song CH, Elvers D, and Leker J Anticipation of converging technology areas—a refined approach for the identification of attractive fields of innovation Technol Forecast Soc Chang 2017 116 98-115
[4]
Song K, Kim K, and Lee S Discovering new technology opportunities based on patents: text-mining and f-term analysis Technovation 2017 60–61 1-14
[5]
Abramo G, D’Angelo CA, Di Costa F (2020) The role of geographical proximity in knowledge diffusion, measured by citations to scientific literature. J Inform 14(1):101010
[6]
Emmanuel D, Megan M (2005) How well do patent citations measure flows of technology? Evidence from French innovation surveys. Dev Comput Syst 14(5):375–393
[7]
Zhang L, Li L, and Li T Patent mining: A survey ACM SIGKDD Explorations Newsl 2015 16 2 1-19
[8]
Liu Y, Wu H, Huang Z et al (2020) Technical phrase extraction for patent mining: a multi-level approach. In: ICDM. IEEE, Sorrento, pp 1142–1147
[9]
Magerman T, Looy BV, and Song X Exploring the feasibility and accuracy of latent semantic analysis based text mining techniques to detect similarity between patent documents and scientific publications Scientometrics 2010 82 2 289-306
[10]
Rui LI On the framing of patent citations and academic paper citations in reflecting knowledge linkage: a discussion of the discrepancy of their divergent value-orientations Chin J Libr Inf Sci 2010 3 37-45
[11]
Chen L Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations J Informetr 2017 11 1 63-79
[12]
Wu H, Zhang K, Lv G et al (2019) Deep technology tracing for high-tech companies. In: ICDM. IEEE, New York, pp 1396–1401
[13]
Kim J, Magee CL (2017) Dynamic patterns of knowledge flows across technological domains: empirical results and link prediction. SSRN Electron J
[14]
Alcacer J and Gittelman M Patent citations as a measure of knowledge flows: the influence of examiner citations Rev Econ Stat 2006 88 4 774-779
[15]
Goodman CM The Delphi technique: a critique J Adv Nurs 1987 12 6 729-734
[16]
Ko N, Yoon J, and Seo W Analyzing interdisciplinarity of technology fusion using knowledge flows of patents Expert Syst Appl 2014 41 4 1955-1963
[17]
Smojver V et al (2020) Exploring knowledge flow within a technology domain by conducting a dynamic analysis of a patent co-citation network. J Knowl Manag 25
[18]
Liu H, Wu H, Zhang L et al (2021) Technological knowledge flow forecasting through a hierarchical interactive graph neural network. In: ICDM. IEEE, Auckland, New Zealand, pp 389–398
[19]
Acemoglu D, Akcigit U, and Kerr WR Innovation network Proc Natl Acad Sci 2016 113 41 11483-11488
[20]
Porter A and Cunningham S Tech mining: exploiting new technologies for competitive advantage Technol Forecast Soc Chang 2006 73 91-93
[21]
Harb YA and Abu-Shanab E A descriptive framework for the field of knowledge management Knowl Inf Syst 2020 62 12 4481-4508
[22]
Verhaegen PA, D’Hondt J, Vertommen J, et al. Relating properties and functions from patents to TRIZ trends CIRP J Manuf Sci Technol 2009 1 3 126-130
[23]
Cho Y, Kim E, and Kim W Strategy transformation under technological convergence: evidence from the printed electronics industry Soc Sci Electron Publ 2015 674 67 106-131
[24]
Park I and Yoon B Technological opportunity discovery for technological convergence based on the prediction of technology knowledge flow in a citation network J Informetr 2018 12 4 1199-1222
[25]
Lee J, Kim C, and Shin J Technology opportunity discovery to R &D planning: key technological performance analysis Technol Forecast Soc Chang 2017 119 53-63
[26]
Lü L and Zhou T Link prediction in complex networks: a survey Physica A 2011 390 6 1150-1170
[27]
Zhou T et al. Predicting missing links via local information Eur Phys J B 2009 71 4 623-630
[28]
Adamic LA and Adar E Friends and neighbors on the web Soc Netw 2003 25 3 211-230
[29]
Sasaki H, Sakata I (2020) Identifying potential technological spin-offs using hierarchical information in international patent classification. Technovation 102192
[30]
Lee WS, Han EJ, and Sohn SY Predicting the pattern of technology convergence using big-data technology on large-scale triadic patents Technol Forecast Soc Chang 2015 100 317-329
[31]
Yang C, Huang C, and Su J An improved SAO network-based method for technology trend analysis: a case study of graphene J Informetr 2018 12 1 271-286
[32]
Yoon B and Park Y A text-mining-based patent network: analytical tool for high-technology trend J High Technol Manag Res 2004 15 1 37-50
[33]
Gori M, Monfardini G, Scarselli F (2005) A new model for learning in graph domains. In: IJCNN, vol. 2. IEEE, Montreal, QC, Canada, pp 729–734
[34]
Estrach JB, Zaremba W, Szlam A et al (2014) Spectral networks and deep locally connected networks on graphs. In: ICLR
[35]
Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: NeurIPS, pp 3844–3852
[36]
Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR
[37]
Velikovi P, Cucurull G, Casanova A et al (2018) Graph attention networks. In: ICLR
[38]
Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: NeurIPS, Long Beach, CA, USA, pp 1025–1035
[39]
Wang X, Zhu M, Bo D et al (2020) AM-GCN: adaptive multi-channel graph convolutional networks. In: ACM SIGKDD. Association for Computing Machinery, New York, pp 1243–1253
[40]
Guo X, Zhao L, Homayoun H, et al. Deep graph transformation for attributed, directed, and signed networks Knowl Inf Syst 2021 63 6 1305-1337
[41]
Schlichtkrull M, Kipf TN, Bloem P et al (2018) Modeling relational data with graph convolutional networks. In: European semantic web conference. Springer, Cham, pp 593–607
[42]
Toujani R and Akaichi J An approach based on mixed hierarchical clustering and optimization for graph analysis in social media network: toward globally hierarchical community structure Knowl Inf Syst 2019 60 2 907-947
[43]
Sankar A, Wu Y, Gou L et al (2020) Dysat: deep neural representation learning on dynamic graphs via self-attention networks. In: WSDM, pp 519–527
[44]
Zhang J, Li M, Gao K, et al. Word and graph attention networks for semi-supervised classification Knowl Inf Syst 2021 63 11 2841-2859
[45]
Li W, Xiao X, Liu J et al (2020) Leveraging graph to improve abstractive multi-document summarization. arXiv preprint arXiv:2005.10043
[46]
Wang H, Lian D, Tong H, et al. Hypersorec: exploiting hyperbolic user and item representations with multiple aspects for social-aware recommendation ACM Trans Inf Syst (TOIS) 2021 40 2 1-28
[47]
Mauw S, Ramírez-Cruz Y, and Trujillo-Rasua R Conditional adjacency anonymity in social graphs under active attacks Knowl Inf Syst 2019 61 1 485-511
[48]
You H et al. Development trend forecasting for coherent light generator technology based on patent citation network analysis Scientometrics 2017 111 1 297-315
[49]
Clough JR, Gollings J, Loach TV, et al. Transitive reduction of citation networks J Complex Netw 2015 3 2 189-203
[50]
Liu Q, Wu H, Ye Y et al (2018) Patent litigation prediction: a convolutional tensor factorization approach. In: IJCAI. AAAI Press, Stockholm
[51]
Lobo J et al. Sources of inventive novelty: two patent classification schemas, same story Scientometrics 2019 120 1 19-37
[52]
Kapoor R, Karvonen M, Ranaei S, et al. Patent portfolios of European wind industry: new insights using citation categories World Patent Inf 2015 41 4-10
[53]
Liu Q, Ge Y, Li Z et al (2011) Personalized travel package recommendation. In: 2011 IEEE 11th international conference on data mining. IEEE, Vancouver, pp 407–416
[54]
Ernst H (1999) Evaluation of dynamic technological developments by means of patent data. In: The dynamics of innovation. Springer, Berlin, pp 103–132
[55]
He X, Deng K, Wang X et al (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: ACM SIGIR, pp 639–648
[56]
Jeon J, Suh Y (2019) Multiple patent network analysis for identifying safety technology convergence. Data Technol Appl
[57]
Shi C, Han X, Song L, et al. Deep collaborative filtering with multi-aspect information in heterogeneous networks IEEE Trans Knowl Data Eng 2021 33 4 1413-1425
[58]
Hochreiter S and Schmidhuber J Long short-term memory Neural Comput 1997 9 8 1735-1780
[59]
Liu Q, Huang Z, Yin Y, et al. EKT: exercise-aware knowledge tracing for student performance prediction IEEE Trans Knowl Data Eng 2021 33 1 100-115
[60]
Kipf TN, Welling M (2016) Variational graph auto-encoders. In: Bayesian deep learning workshop, NeurIPS (2016)
[61]
Caviggioli F Technology fusion: identification and analysis of the drivers of technology convergence using patent data Technovation 2016 55–56 22-32
[62]
Lee DD and Seung HS Learning the parts of objects by non-negative matrix factorization Nature 1999 401 6755 788-791
[63]
Yu R, Liu Q, Ye Y et al (2020) Collaborative list-and-pairwise filtering from implicit feedback. IEEE Trans Knowl Data Eng
[64]
Hu W, Gao J, Li B, et al. Anomaly detection using local kernel density estimation and context-based regression IEEE Trans Knowl Data Eng 2020 32 2 218-233
[65]
Glorot X and Bengio Y Understanding the difficulty of training deep feed forward neural networks J Mach Learn Res 2010 9 249-256
[66]
Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: ICLR
[67]
Zhao H, Liu Q, Zhu H, et al. A sequential approach to market state modeling and analysis in online P2P lending IEEE Trans Syst Man Cybern Syst 2018 48 1 21-33

Cited By

View all
  • (2023)Cognitive Evolutionary Search to Select Feature Interactions for Click-Through Rate PredictionProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599277(3151-3161)Online publication date: 6-Aug-2023
  • (2023)Tracking and predicting technological knowledge interactions between artificial intelligence and wind powerAdvanced Engineering Informatics10.1016/j.aei.2023.10217758:COnline publication date: 1-Oct-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Knowledge and Information Systems
Knowledge and Information Systems  Volume 64, Issue 7
Jul 2022
363 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 July 2022
Accepted: 14 May 2022
Revision received: 12 May 2022
Received: 27 January 2022

Author Tags

  1. Technological knowledge flow
  2. Graph neural network
  3. Patent mining
  4. Cooperative patent classification
  5. Link prediction

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 24 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Cognitive Evolutionary Search to Select Feature Interactions for Click-Through Rate PredictionProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599277(3151-3161)Online publication date: 6-Aug-2023
  • (2023)Tracking and predicting technological knowledge interactions between artificial intelligence and wind powerAdvanced Engineering Informatics10.1016/j.aei.2023.10217758:COnline publication date: 1-Oct-2023

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media