short-paper

GraphPAS: Parallel Architecture Search for Graph Neural Networks

Authors:

Moctard Babatounde Oloulade,

Zhao LiAuthors Info & Claims

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

Pages 2182 - 2186

https://doi.org/10.1145/3404835.3463007

Published: 11 July 2021 Publication History

Abstract

Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the huge search space is too time-consuming or impossible for big graph data. In this paper, we propose a parallel graph architecture search (GraphPAS) framework for graph neural networks. In GraphPAS, we explore the search space in parallel by designing a sharing-based evolution learning, which can improve the search efficiency without losing the accuracy. Additionally, architecture information entropy is adopted dynamically for mutation selection probability, which can reduce space exploration. The experimental result shows that GraphPAS outperforms state-of-art models with efficiency and accuracy simultaneously.

References

[1]

Feng Yu, Yanqiao Zhu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. Tagnn: Target attentive graph neural networks for session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1921--1924, 2020.

Digital Library

[2]

Thomas Elsken, Jan Hendrik Metzen, Frank Hutter, et al. Neural architecture search: A survey. Journal of Machine Learning Research, 20(55):1--21, 2019.

[3]

Yang Gao, Hong Yang, Peng Zhang, Chuan Zhou, and Yue Hu. Graph neural architecture search. In Proceedings of the 29th International Joint Conference on Artificial Intelligence, volume 20, pages 1403--1409, 2020.

[4]

Min Shi, David A Wilson, Xingquan Zhu, Yu Huang, Yuan Zhuang, Jianxun Liu,and Yufei Tang. Evolutionary architecture search for graph neural networks. arXiv preprint arXiv:2009.10199, 2020.

[5]

Jiaxuan You, Rex Ying, and Jure Leskovec. Position-aware graph neural networks. In International Conference on Machine Learning, pages 7134--7143, 2019.

[6]

William L Hamilton, Rex Ying, and Jure Leskovec. Inductive representation learning on large graphs. In Annual Conference on Neural Information Processing Systems, pages 1024--1034, 2017.

[7]

Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, PietroLio, and Yoshua Bengio. Graph attention networks. In 6th International Conference on Learning Representations, 2018.

[8]

Michael Hahsler, Bettina Grun, and Kurt Hornik. Introduction to arules--mining association rules and frequent item sets. ACM SIGKDD Explorations, 2(4):1--28,2007.

[9]

Prithviraj Sen, Galileo Namata, Mustafa Bilgic, Lise Getoor, Brian Galligher, and Tina Eliassi-Rad. Collective classification in network data.AI magazine, 29(3):93--93, 2008.

Digital Library

[10]

Michael Defferrard, Xavier Bresson, and Pierre Vandergheynst. Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems, pages 3837--3845, 2016.

Digital Library

[11]

Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In5th International Conference on Learning Representations, 2017.

[12]

Hongyang Gao, Zhengyang Wang, and Shuiwang Ji. Large-scale learnable graph convolutional networks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1416--1424, 2018.

Digital Library

[13]

Bingbing Xu, Junjie Huang, Liang Hou, Huawei Shen, Jinhua Gao, and Xueqi Cheng. Label-consistency based graph neural networks for semi-supervised node classification. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1897--1900, 2020.

Digital Library

[14]

Kaixiong Zhou, Qingquan Song, Xiao Huang, and Xia Hu. Auto-gnn: Neural architecture search of graph neural networks. arXiv preprint arXiv:1909.03184,2019.

[15]

Matthias Fey and Jan Eric Lenssen. Fast graph representation learning with pytorch geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds, 2019.

Cited By

Gao JChen JOloulade BAl-Sabri RLyu TZhang JLi Z(2024)CommGNAS: Unsupervised Graph Neural Architecture Search for Community DetectionIEEE Transactions on Emerging Topics in Computing10.1109/TETC.2023.327018112:2(444-454)Online publication date: Apr-2024
https://doi.org/10.1109/TETC.2023.3270181
Gao JWu ZAl-Sabri ROloulade BChen J(2024)AutoDDI: Drug–Drug Interaction Prediction With Automated Graph Neural NetworkIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2024.334957028:3(1773-1784)Online publication date: Mar-2024
https://doi.org/10.1109/JBHI.2024.3349570
Wu ZChen JAl-Sabri ROloulade BGao J(2024)Depth-adaptive graph neural architecture search for graph classificationKnowledge-Based Systems10.1016/j.knosys.2024.112321301(112321)Online publication date: Oct-2024
https://doi.org/10.1016/j.knosys.2024.112321
Show More Cited By

Index Terms

GraphPAS: Parallel Architecture Search for Graph Neural Networks
1. Computing methodologies
  1. Artificial intelligence
    1. Search methodologies

Recommendations

Pooling Architecture Search for Graph Classification
CIKM '21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management

Graph classification is an important problem with applications across many domains, like chemistry and bioinformatics, for which graph neural networks (GNNs) have been state-of-the-art (SOTA) methods. GNNs are designed to learn node-level representation ...
DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks
KDD '21: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining

In this paper, we propose a novel framework to automatically utilize task-dependent semantic information which is encoded in heterogeneous information networks (HINs). Specifically, we search for a meta graph, which can capture more complex semantic ...
Graph neural architecture prediction
Abstract
Graph neural networks (GNNs) have shown their superiority in the modeling of graph data. Recently, increasing attention has been paid to automatic graph neural architecture search, aiming to overcome the shortcomings of manually constructing GNN ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 2021

2998 pages

ISBN:9781450380379

DOI:10.1145/3404835

General Chairs:
Fernando Diaz
(Google)
,
Chirag Shah
University of Washington
,
Torsten Suel
New York University
,
Program Chairs:
Pablo Castells
Universidad Autónoma de Madrid, Amazon
,
Rosie Jones
Spotify
,
Tetsuya Sakai
Waseda University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

National Natural Science Foundation of China
Hunan Key Laboratory for Internet of Things in Electricity
Zhejiang Lab
CAAI-Huawei MindSpore Open Fund

Conference

SIGIR '21

Sponsor:

SIGIR

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 11 - 15, 2021

Virtual Event, Canada

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
357
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao JChen JOloulade BAl-Sabri RLyu TZhang JLi Z(2024)CommGNAS: Unsupervised Graph Neural Architecture Search for Community DetectionIEEE Transactions on Emerging Topics in Computing10.1109/TETC.2023.327018112:2(444-454)Online publication date: Apr-2024
https://doi.org/10.1109/TETC.2023.3270181
Gao JWu ZAl-Sabri ROloulade BChen J(2024)AutoDDI: Drug–Drug Interaction Prediction With Automated Graph Neural NetworkIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2024.334957028:3(1773-1784)Online publication date: Mar-2024
https://doi.org/10.1109/JBHI.2024.3349570
Wu ZChen JAl-Sabri ROloulade BGao J(2024)Depth-adaptive graph neural architecture search for graph classificationKnowledge-Based Systems10.1016/j.knosys.2024.112321301(112321)Online publication date: Oct-2024
https://doi.org/10.1016/j.knosys.2024.112321
Wu ZChen JAl-Sabri ROloulade BGao J(2023)Adaptive graph contrastive learning with joint optimization of data augmentation and graph encoderKnowledge and Information Systems10.1007/s10115-023-01979-366:3(1657-1681)Online publication date: 12-Oct-2023
https://dl.acm.org/doi/10.1007/s10115-023-01979-3
Gao JAl-Sabri ROloulade BChen JLyu TWu Z(2023)GM2NAS: multitask multiview graph neural architecture searchKnowledge and Information Systems10.1007/s10115-023-01886-765:10(4021-4054)Online publication date: 15-May-2023
https://dl.acm.org/doi/10.1007/s10115-023-01886-7
Yuan PSun YWang H(2022)Heterogeneous Information Network-Based Recommendation with Metapath Search and Memory Network Architecture SearchMathematics10.3390/math1016289510:16(2895)Online publication date: 12-Aug-2022
https://doi.org/10.3390/math10162895
Wei LZhao HHe Z(2022)Designing the Topology of Graph Neural Networks: A Novel Feature Fusion PerspectiveProceedings of the ACM Web Conference 202210.1145/3485447.3512185(1381-1391)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3485447.3512185
Al-Sabri RGao JChen JOloulade BLyu T(2022)Multi-View Graph Neural Architecture Search for Biomedical Entity and Relation ExtractionIEEE/ACM Transactions on Computational Biology and Bioinformatics10.1109/TCBB.2022.320511320:2(1221-1233)Online publication date: 8-Sep-2022
https://dl.acm.org/doi/10.1109/TCBB.2022.3205113
Chen JGao JLyu TOloulade BHu X(2022)AutoMSR: Auto Molecular Structure Representation Learning for Multi-label Metabolic Pathway PredictionIEEE/ACM Transactions on Computational Biology and Bioinformatics10.1109/TCBB.2022.319811920:6(3430-3439)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1109/TCBB.2022.3198119
Xu ALiu WZhou D(2022)Research on Algorithm of Intelligent Keyboard Routing Based on Line Priority Strategy2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS)10.1109/ISPDS56360.2022.9874023(386-389)Online publication date: 22-Jul-2022
https://doi.org/10.1109/ISPDS56360.2022.9874023
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents