Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3589335.3651534acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
short-paper
Open access

LLaCE: Locally Linear Contrastive Embedding

Published: 13 May 2024 Publication History

Abstract

Node embedding is one of the most widely adopted techniques in numerous graph analysis tasks, such as node classification. Methods for node embedding can be broadly classified into three categories: proximity matrix factorization approaches, sampling methods, and deep learning strategies. Among the deep learning strategies, graph contrastive learning has attracted significant interest. Yet, it has been observed that existing graph contrastive learning approaches do not adequately preserve the local topological structure of the original graphs, particularly when neighboring nodes belong to disparate categories. To address this challenge, this paper introduces a novel node embedding approach named Locally Linear Contrastive Embedding (LLaCE). LLaCE is designed to maintain the intrinsic geometric structure of graph data by utilizing locally linear formulation, thereby ensuring that the local topological characteristics are accurately reflected in the embedding space. Experimental results on one synthetic dataset and five real-world datasets validate the effectiveness of our proposed method.

Supplemental Material

MP4 File
Supplemental video

References

[1]
J. Bruna, W. Zaremba, A. Szlam, and Y. LeCun. 2013. Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203 (2013).
[2]
J. Chen and G. Kou. 2023. Attribute and structure preserving graph contrastive learning. In AAAI, Vol. 37. 7024--7032.
[3]
A. Grover and J. Leskovec. 2016. node2vec: Scalable feature learning for networks. In SIGKDD. 855--864.
[4]
W. Hamilton, Z. Ying, and J. Leskovec. 2017. Inductive representation learning on large graphs. NIPS, Vol. 30 (2017).
[5]
D. Jin, B. Zhang, Y. Song, D. He, Z. Feng, S. Chen, W. Li, and K. Musial. 2020. ModMRF: A modularity-based Markov Random Field method for community detection. Neurocomputing, Vol. 405 (2020), 218--228.
[6]
W. Liu, Y. Zhang, J. Wang, Y. He, J. Caverlee, P. P. K. Chan, D. S. Yeung, and P. A. Heng. 2021. Item relationship graph neural networks for e-commerce. IEEE Trans. Neural Netw. Learn. Syst., Vol. 33, 9 (2021), 4785--4799.
[7]
T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).
[8]
B. Perozzi, R. Al-Rfou, and S. Skiena. 2014. Deepwalk: Online learning of social representations. In SIGKDD. 701--710.
[9]
A. Rossi, D. Barbosa, D. Firmani, A. Matinata, and P. Merialdo. 2021. Knowledge graph embedding for link prediction: A comparative analysis. TKDD, Vol. 15, 2 (2021), 1--49.
[10]
S. T. Roweis and L. K. Saul. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science, Vol. 290, 5500 (2000), 2323--2326.
[11]
H. Sun, F. He, J. Huang, Y. Sun, Y. Li, C. Wang, L. He, Z. Sun, and X. Jia. 2020. Network embedding for community detection in attributed networks. TKDD, Vol. 14, 3 (2020), 1--25.
[12]
L. Torres, K. S. Chan, and T. Eliassi-Rad. 2020. GLEE: geometric Laplacian eigenmap embedding. J. Complex Netw., Vol. 8, 2 (2020), cnaa007.
[13]
K. Xu, C. Li, Y. Tian, T. Sonobe, K. Kawarabayashi, and S. Jegelka. 2018. Representation learning on graphs with jumping knowledge networks. In ICML. 5453--5462.
[14]
H. Zhang, Q. Wu, Y. Wang, S. Zhang, J. Yan, and P. S. Yu. 2022. Localized Contrastive Learning on Graphs. arXiv preprint arXiv:2212.04604 (2022).
[15]
X. Zhang, K. Xie, S. Wang, and Z. Huang. 2021. Learning based proximity matrix factorization for node embedding. In SIGKDD. 2243--2253.
[16]
H. Zhu and P. Koniusz. 2022. Generalized Laplacian Eigenmaps. NeurIPS, Vol. 35 (2022), 30783--30797.
[17]
J. Zhu, Y. Yan, L. Zhao, M. Heimann, L. Akoglu, and D. Koutra. 2020. Beyond homophily in graph neural networks: Current limitations and effective designs. NeurIPS, Vol. 33 (2020), 7793--7804. io

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '24: Companion Proceedings of the ACM Web Conference 2024
May 2024
1928 pages
ISBN:9798400701726
DOI:10.1145/3589335
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Check for updates

Author Tags

  1. convex optimization
  2. graph contrastive learning
  3. locally linear contrastive embedding
  4. node classification
  5. node embedding

Qualifiers

  • Short-paper

Funding Sources

  • Guangdong Basic and Applied Basic Research Foundation
  • University Grants Committee (UGC) of Hong Kong, General Research Fund (GRF)

Conference

WWW '24
Sponsor:
WWW '24: The ACM Web Conference 2024
May 13 - 17, 2024
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 189
    Total Downloads
  • Downloads (Last 12 months)189
  • Downloads (Last 6 weeks)70
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media