Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3447548.3467328acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

H2MN: Graph Similarity Learning with Hierarchical Hypergraph Matching Networks

Published: 14 August 2021 Publication History

Abstract

Graph similarity learning, which measures the similarities between a pair of graph-structured objects, lies at the core of various machine learning tasks such as graph classification, similarity search, etc. In this paper, we devise a novel graph neural network based framework to address this challenging problem, motivated by its great success in graph representation learning. As the vast majority of existing graph neural network models mainly concentrate on learning effective node or graph level representations of a single graph, little effort has been made to jointly reason over a pair of graph-structured inputs for graph similarity learning. To this end, we propose Hierarchical Hypergraph Matching Networks (H2sup>MN) to calculate the similarities between graph pairs with arbitrary structure. Specifically, our proposed H2MN learns graph representation from the perspective of hypergraph, and takes each hyperedge as a subgraph to perform subgraph matching, which could capture the rich substructure similarities across the graph. To enable hierarchical graph representation and fast similarity computation, we further propose a hyperedge pooling operator to transform each graph into a coarse graph of reduced size. Then, a multi-perspective cross-graph matching layer is employed on the coarsened graph pairs to extract the inter-graph similarity. Comprehensive experiments on five public datasets empirically demonstrate that our proposed model can outperform state-of-the-art baselines with different gains for graph-graph classification and regression tasks.

Supplementary Material

MP4 File (h2mn_graph_similarity_learning_with-zhen_zhang-jiajun_bu-38957902-IKPk.mp4)
This is our KDD 2021 research track paper "H2MN: Graph Similarity Learning with Hierarchical Hypergraph Matching Networks" by Zhen Zhang, Jiajun Bu, Martin Ester, Zhao Li, Chengwei Yao, Zhi Yu, Can Wang.

References

[1]
Song Bai, Feihu Zhang, and Philip HS Torr. 2019 b. Hypergraph convolution and hypergraph attention. arXiv:1901.08150 (2019).
[2]
Yunsheng Bai, Hao Ding, Song Bian, Ting Chen, Yizhou Sun, and Wei Wang. 2019 a. Simgnn: A neural network approach to fast graph similarity computation. In WSDM. 384--392.
[3]
Yunsheng Bai, Hao Ding, Ken Gu, Yizhou Sun, and Wei Wang. 2020. Learning-Based Efficient Graph Similarity Computation via Multi-Scale Convolutional Set Matching. In AAAI. 3219--3226.
[4]
David B Blumenthal and Johann Gamper. 2020. On the exact computation of the graph edit distance. Pattern Recognition Letters, Vol. 134 (2020), 46--57.
[5]
Andrew P Bradley. 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern recognition, Vol. 30, 7 (1997), 1145--1159.
[6]
Jane Bromley, Isabelle Guyon, Yann LeCun, Eduard S"ackinger, and Roopak Shah. 1994. Signature verification using a "siamese" time delay neural network. In NIPS. 737--744.
[7]
Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2013. Spectral networks and locally connected networks on graphs. arXiv:1312.6203 (2013).
[8]
Horst Bunke. 1997. On a relation between graph edit distance and maximum common subgraph. Pattern Recognition Letters, Vol. 18, 8 (1997), 689--694.
[9]
Horst Bunke and Kim Shearer. 1998. A graph distance metric based on the maximal common subgraph. Pattern recognition letters, Vol. 19, 3--4 (1998), 255--259.
[10]
Lu Chen, Yunjun Gao, Yuanliang Zhang, Sibo Wang, and Baihua Zheng. 2018. Scalable hypergraph-based image retrieval and tagging system. In ICDE. 257--268.
[11]
Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016. Convolutional neural networks on graphs with fast localized spectral filtering. In NIPS. 3844--3852.
[12]
Frederik Diehl. 2019. Edge contraction pooling for graph neural networks. arXiv:1905.10990 (2019).
[13]
Stefan Fankhauser, Kaspar Riesen, and Horst Bunke. 2011. Speeding up graph edit distance computation through fast bipartite matching. In International Workshop on Graph-Based Representations in Pattern Recognition. 102--111.
[14]
Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. 2019. Hypergraph neural networks. In AAAI, Vol. 33. 3558--3565.
[15]
Matthias Fey and Jan Eric Lenssen. 2019. Fast graph representation learning with PyTorch Geometric. arXiv:1903.02428 (2019).
[16]
Andreas Fischer, Ching Y Suen, Volkmar Frinken, Kaspar Riesen, and Horst Bunke. 2015. Approximation of graph edit distance based on Hausdorff matching. Pattern Recognition, Vol. 48, 2 (2015), 331--343.
[17]
Hongyang Gao and Shuiwang Ji. 2019. Graph u-nets. arXiv:1905.05178 (2019).
[18]
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural Message Passing for Quantum Chemistry. In ICML. 1263--1272.
[19]
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In NIPS. 1024--1034.
[20]
Taher H Haveliwala. 2003. Topic-sensitive pagerank: A context-sensitive ranking algorithm for web search. TKDE, Vol. 15, 4 (2003), 784--796.
[21]
Tamás Horváth, Thomas Gärtner, and Stefan Wrobel. 2004. Cyclic pattern kernels for predictive graph mining. In SIGKDD. 158--167.
[22]
Jingjia Huang, Zhangheng Li, Nannan Li, Shan Liu, and Ge Li. 2019. Attpool: Towards hierarchical feature representation in graph convolutional networks via attention mechanism. In ICCV. 6480--6489.
[23]
Jianwen Jiang, Yuxuan Wei, Yifan Feng, Jingxuan Cao, and Yue Gao. 2019. Dynamic Hypergraph Neural Networks. In IJCAI. 2635--2641.
[24]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980 (2014).
[25]
Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv:1609.02907 (2016).
[26]
Johannes Klicpera, Aleksandar Bojchevski, and Stephan Günnemann. 2018. Predict then propagate: Graph neural networks meet personalized pagerank. arXiv:1810.05997 (2018).
[27]
Junhyun Lee, Inyeop Lee, and Jaewoo Kang. 2019. Self-attention graph pooling. arXiv:1904.08082 (2019).
[28]
Yujia Li, Chenjie Gu, Thomas Dullien, Oriol Vinyals, and Pushmeet Kohli. 2019. Graph Matching Networks for Learning the Similarity of Graph Structured Objects. In ICML. 3835--3845.
[29]
Yongzhi Li, Duo Zhang, and Yadong Mu. 2020. Visual-Semantic Matching by Exploring High-Order Attention and Distraction. In CVPR. 12786--12795.
[30]
Xiang Ling, Lingfei Wu, Saizhuo Wang, Tengfei Ma, Fangli Xu, Alex X Liu, Chunming Wu, and Shouling Ji. 2020. Hierarchical graph matching networks for deep graph similarity learning. arXiv:2007.04395 (2020).
[31]
Guixiang Ma, Nesreen K Ahmed, Theodore L Willke, Dipanjan Sengupta, Michael W Cole, Nicholas B Turk-Browne, and Philip S Yu. 2019 b. Deep graph similarity learning for brain data analysis. In CIKM. 2743--2751.
[32]
Guixiang Ma, Nesreen K Ahmed, Theodore L Willke, and Philip S Yu. 2019 a. Deep Graph Similarity Learning: A Survey. arXiv:1912.11615 (2019).
[33]
Yao Ma, Suhang Wang, Charu C Aggarwal, and Jiliang Tang. 2019 c. Graph convolutional networks with eigenpooling. In SIGKDD. 723--731.
[34]
Jonas Mueller and Aditya Thyagarajan. 2016. Siamese recurrent architectures for learning sentence similarity. In AAAI.
[35]
Michel Neuhaus, Kaspar Riesen, and Horst Bunke. 2006. Fast suboptimal algorithms for the computation of graph edit distance. In SSPR. 163--172.
[36]
Giannis Nikolentzos, Polykarpos Meladianos, and Michalis Vazirgiannis. 2017. Matching node embeddings for graph similarity. In AAAI.
[37]
Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The PageRank citation ranking: Bringing order to the web. Technical Report. Stanford InfoLab.
[38]
Kaspar Riesen and Horst Bunke. 2009. Approximate graph edit distance computation by means of bipartite graph matching. Image and Vision computing, Vol. 27, 7 (2009), 950--959.
[39]
Kaspar Riesen, Sandro Emmenegger, and Horst Bunke. 2013. A novel software toolkit for graph edit distance computation. In International Workshop on Graph-Based Representations in Pattern Recognition. 142--151.
[40]
Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. In NIPS. 926--934.
[41]
Charles Spearman. 1987. The proof and measurement of association between two things. The American journal of psychology, Vol. 100, 3/4 (1987), 441--471.
[42]
Qingyun Sun, Jianxin Li, Hao Peng, Jia Wu, Yuanxing Ning, Phillip S Yu, and Lifang He. 2021. Sugar: Subgraph neural network with reinforcement pooling and self-supervised mutual information mechanism. arXiv preprint arXiv:2101.08170 (2021).
[43]
Rahul Rama Varior, Mrinal Haloi, and Gang Wang. 2016. Gated siamese convolutional neural network architecture for human re-identification. In ECCV. 791--808.
[44]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NIPS. 5998--6008.
[45]
Petar Velivc ković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv:1710.10903 (2017).
[46]
Shen Wang, Zhengzhang Chen, Xiao Yu, Ding Li, Jingchao Ni, Lu-An Tang, Jiaping Gui, Zhichun Li, Haifeng Chen, and S Yu Philip. 2019. Heterogeneous Graph Matching Networks for Unknown Malware Detection. In IJCAI. 3762--3770.
[47]
Stanley Wasserman, Katherine Faust, et almbox. 1994. Social network analysis: Methods and applications. Vol. 8.
[48]
Haoyan Xu, Runjian Chen, Yunsheng Bai, Jie Feng, Ziheng Duan, Ke Luo, Yizhou Sun, and Wei Wang. 2020 a. Hierarchical and Fast Graph Similarity Computation via Graph Coarsening and Deep Graph Learning. arXiv:2005.07115 (2020).
[49]
Haoyan Xu, Ziheng Duan, Jie Feng, Runjian Chen, Yida Huang, and Yueyang Wang. 2020 b. Graph Partitioning and Graph Neural Network based Hierarchical Graph Matching for Graph Similarity Computation. arXiv:2005.08008 (2020).
[50]
Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation Learning on Graphs with Jumping Knowledge Networks. In ICML. 5453--5462.
[51]
Kun Xu, Liwei Wang, Mo Yu, Yansong Feng, Yan Song, Zhiguo Wang, and Dong Yu. 2019. Cross-lingual knowledge graph alignment via graph matching neural network. arXiv:1905.11605 (2019).
[52]
Xiaojun Xu, Chang Liu, Qian Feng, Heng Yin, Le Song, and Dawn Song. 2017. Neural network-based graph embedding for cross-platform binary code similarity detection. In SIGSAC. 363--376.
[53]
Naganand Yadati, Madhav Nimishakavi, Prateek Yadav, Vikram Nitin, Anand Louis, and Partha Talukdar. 2019. Hypergcn: A new method for training graph convolutional networks on hypergraphs. In NIPS. 1511--1522.
[54]
Junchi Yan, Changsheng Li, Yin Li, and Guitao Cao. 2017. Adaptive discrete hypergraph matching. IEEE transactions on cybernetics, Vol. 48 (2017), 765--779.
[55]
Xifeng Yan and Jiawei Han. 2002. gspan: Graph-based substructure pattern mining. In ICDM. IEEE, 721--724.
[56]
Pinar Yanardag and SVN Vishwanathan. 2015. Deep graph kernels. In SIGKDD. 1365--1374.
[57]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018a. Graph convolutional neural networks for web-scale recommender systems. In SIGKDD. 974--983.
[58]
Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. 2018b. Hierarchical graph representation learning with differentiable pooling. In NIPS. 4800--4810.
[59]
Jiaxuan You, Bowen Liu, Zhitao Ying, Vijay Pande, and Jure Leskovec. 2018. Graph convolutional policy network for goal-directed molecular graph generation. In NIPS. 6410--6421.
[60]
Zhiping Zeng, Anthony KH Tung, Jianyong Wang, Jianhua Feng, and Lizhu Zhou. 2009. Comparing stars: On approximating graph edit distance. VLDB, Vol. 2, 1 (2009), 25--36.
[61]
Ruochi Zhang, Yuesong Zou, and Jian Ma. 2019 b. Hyper-SAGNN: a self-attention based graph neural network for hypergraphs. arXiv:1911.02613 (2019).
[62]
Zhen Zhang, Jiajun Bu, Martin Ester, Jianfeng Zhang, Chengwei Yao, Zhi Yu, and Can Wang. 2019 a. Hierarchical graph pooling with structure learning. arXiv:1911.05954 (2019).
[63]
Zhen Zhang, Hongxia Yang, Jiajun Bu, Sheng Zhou, Pinggang Yu, Jianwei Zhang, Martin Ester, and Can Wang. 2018. ANRL: Attributed Network Representation Learning via Deep Neural Networks. In IJCAI, Vol. 18. 3155--3161.
[64]
Wei Zhao, Shulong Tan, Ziyu Guan, Boxuan Zhang, Maoguo Gong, Zhengwen Cao, and Quan Wang. 2018. Learning to map social network users by unified manifold alignment on hypergraph. TNNLS (2018), 5834--5846.
[65]
Dengyong Zhou, Jiayuan Huang, and Bernhard Schölkopf. 2007. Learning with hypergraphs: Clustering, classification, and embedding. In NIPS. 1601--1608.

Cited By

View all
  • (2025)Hypergraph contrastive attention networks for hyperedge prediction with negative samples evaluationNeural Networks10.1016/j.neunet.2024.106807181(106807)Online publication date: Jan-2025
  • (2024)Code Similarity Prediction Model for Industrial Management Features Based on Graph Neural NetworksEntropy10.3390/e2606050526:6(505)Online publication date: 9-Jun-2024
  • (2024)Collaborate to Adapt: Source-Free Graph Domain Adaptation via Bi-directional AdaptationProceedings of the ACM on Web Conference 202410.1145/3589334.3645507(664-675)Online publication date: 13-May-2024
  • Show More Cited By

Index Terms

  1. H2MN: Graph Similarity Learning with Hierarchical Hypergraph Matching Networks

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '21: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
    August 2021
    4259 pages
    ISBN:9781450383325
    DOI:10.1145/3447548
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 August 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. graph neural networks
    2. graph similarity learning
    3. hypergraphs

    Qualifiers

    • Research-article

    Funding Sources

    • the National Key Research and Development Program
    • National Natural Science Foundation of China

    Conference

    KDD '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)356
    • Downloads (Last 6 weeks)33
    Reflects downloads up to 16 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Hypergraph contrastive attention networks for hyperedge prediction with negative samples evaluationNeural Networks10.1016/j.neunet.2024.106807181(106807)Online publication date: Jan-2025
    • (2024)Code Similarity Prediction Model for Industrial Management Features Based on Graph Neural NetworksEntropy10.3390/e2606050526:6(505)Online publication date: 9-Jun-2024
    • (2024)Collaborate to Adapt: Source-Free Graph Domain Adaptation via Bi-directional AdaptationProceedings of the ACM on Web Conference 202410.1145/3589334.3645507(664-675)Online publication date: 13-May-2024
    • (2024)More Interpretable Graph Similarity Computation via Maximum Common Subgraph InferenceIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.338704436:11(6588-6599)Online publication date: Nov-2024
    • (2024)Forecasting the molecular interactions: A hypergraph-based neural network for molecular relational learningKnowledge-Based Systems10.1016/j.knosys.2024.112177300(112177)Online publication date: Sep-2024
    • (2024)Unveiling the potential of long-range dependence with mask-guided structure learning for hypergraphKnowledge-Based Systems10.1016/j.knosys.2023.111254284:COnline publication date: 17-Apr-2024
    • (2024)Graph-based substructure pattern mining with edge-weightApplied Intelligence10.1007/s10489-024-05356-754:5(3756-3785)Online publication date: 8-Mar-2024
    • (2024)Graph pooling in graph neural networks: methods and their applications in omics studiesArtificial Intelligence Review10.1007/s10462-024-10918-957:11Online publication date: 16-Sep-2024
    • (2023)Conditional graph information bottleneck for molecular relational learning18871Proceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619186(18852-18871)Online publication date: 23-Jul-2023
    • (2023)Evolution of artificial intelligence for application in contemporary materials scienceMRS Communications10.1557/s43579-023-00433-313:5(754-763)Online publication date: 16-Aug-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media