Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3616855.3635754acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Motif-based Prompt Learning for Universal Cross-domain Recommendation

Published: 04 March 2024 Publication History

Abstract

Cross-Domain Recommendation (CDR) stands as a pivotal technology addressing issues of data sparsity and cold start by transferring general knowledge from the source to the target domain. However, existing CDR models suffer limitations in adaptability across various scenarios due to their inherent complexity. To tackle this challenge, recent advancements introduce universal CDR models that leverage shared embeddings to capture general knowledge across domains and transfer it through "Multi-task Learning'' or "Pre-train, Fine-tune'' paradigms. However, these models often overlook the broader structural topology that spans domains and fail to align training objectives, potentially leading to negative transfer. To address these issues, we propose a motif-based prompt learning framework, MOP, which introducesmotif-based shared embeddings to encapsulate generalized domain knowledge, catering to both intra-domain and inter-domain CDR tasks. Specifically, we devise three typical motifs: butterfly, triangle, and random walk, and encode them through a Motif-based Encoder to obtain motif-based shared embeddings. Moreover, we train MOP under the "Pre-training & Prompt Tuning'' paradigm. By unifying pre-training and recommendation tasks as a common motif-based similarity learning task and integrating adaptable prompt parameters to guide the model in downstream recommendation tasks, MOP excels in transferring domain knowledge effectively. Experimental results on four distinct CDR tasks demonstrate the effectiveness of MOP than the state-of-the-art models.

Supplementary Material

MP4 File (MOP.mp4)
Video of Motif-based Prompt Learning for Universal Cross-domain Recommendation

References

[1]
Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, and Furu Wei. 2022. VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. In NeurIPS?22.
[2]
Austin R. Benson, David F. Gleich, and Jure Leskovec. 2016. Higher-order organization of complex networks. Science, Vol. 353, 6295 (2016), 163--166.
[3]
Alain Bretto. 2013. Hypergraph theory. An introduction. Mathematical Engineering. Cham: Springer (2013).
[4]
Tom Brown, Benjamin Mann, et al. 2020. Language models are few-shot learners. In NIPS'20, Vol. 33. 1877--1901.
[5]
Jiangxia Cao, Xin Cong, Tingwen Liu, and Bin Wang. 2022a. Item Similarity Mining for Multi-Market Recommendation. In SIGIR'22. 2249--2254.
[6]
Jiangxia Cao, Shaoshuai Li, Bowen Yu, Xiaobo Guo, Tingwen Liu, and Bin Wang. 2023. Towards Universal Cross-Domain Recommendation. In WSDM'23. 78--86.
[7]
Jiangxia Cao, Xixun Lin, Xin Cong, Jing Ya, Tingwen Liu, and Bin Wang. 2022b. DisenCDR: Learning Disentangled Representations for Cross-Domain Recommendation. In SIGIR'22. 267--277.
[8]
Jiangxia Cao, Jiawei Sheng, Xin Cong, Tingwen Liu, and Bin Wang. 2022c. Cross-Domain Recommendation to Cold-Start Users via Variational Information Bottleneck. In ICDE'22. 2209--2223.
[9]
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey E. Hinton. 2020. A Simple Framework for Contrastive Learning of Visual Representations. In ICML'20, Vol. 119. 1597--1607.
[10]
Tianyu Gao, Adam Fisch, and Danqi Chen. 2021. Making Pre-trained Language Models Better Few-shot Learners. In ACL/IJCNLP'21. 3816--3830.
[11]
Shijie Geng, Shuchang Liu, Zuohui Fu, Yingqiang Ge, and Yongfeng Zhang. 2022. Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5). In RecSys '22. 299--315.
[12]
Lei Guo, Li Tang, Tong Chen, Lei Zhu, et al. 2021. DA-GCN: A Domain-aware Attentive Graph Convolution Network for Shared-account Cross-domain Sequential Recommendation. In IJCAI'21. 2483--2489.
[13]
Lei Guo, Jinyu Zhang, Tong Chen, Xinhua Wang, and Hongzhi Yin. 2023. Reinforcement Learning-Enhanced Shared-Account Cross-Domain Sequential Recommendation. IEEE Trans. Knowl. Data Eng., Vol. 35, 7 (2023), 7397--7411.
[14]
Lei Guo, Jinyu Zhang, Li Tang, Tong Chen, Lei Zhu, and Hongzhi Yin. 2022. Time interval-enhanced graph neural network for shared-account cross-domain sequential recommendation. IEEE Trans Neural Netw Learn Syst (2022).
[15]
Michael Gutmann and Aapo Hyv"a rinen. 2010. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In AISTATS'10.
[16]
Bowen Hao, Hongzhi Yin, Jing Zhang, Cuiping Li, and Hong Chen. 2023. A Multi-strategy-based Pre-training Method for Cold-start Recommendation. ACM Trans. Inf. Syst., Vol. 41, 2 (2023), 31:1--31:24.
[17]
Bowen Hao, Jing Zhang, Hongzhi Yin, Cuiping Li, and Hong Chen. 2021. Pre-Training Graph Neural Networks for Cold-Start Users and Items Representation. In WSDM'21. 265--273.
[18]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yong-Dong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In SIGIR'20. 639--648.
[19]
Guangneng Hu, Yu Zhang, and Qiang Yang. 2018. CoNet: Collaborative Cross Networks for Cross-Domain Recommendation. In CIKM'19. 667--676.
[20]
Robert L. Logan IV, Ivana Balazevic, Eric Wallace, Fabio Petroni, Sameer Singh, and Sebastian Riedel. 2022. Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models. In Findings of the ACL'22. 2824--2835.
[21]
Heishiro Kanagawa, Hayato Kobayashi, Nobuyuki Shimizu, Yukihiro Tagami, and Taiji Suzuki. 2019. Cross-Domain Recommendation via Deep Domain Adaptation. In ECIR'19, Vol. 11438. 20--29.
[22]
SeongKu Kang, Junyoung Hwang, Dongha Lee, and Hwanjo Yu. 2019. Semi-Supervised Learning for Cross-Domain Recommendation to Cold-Start Users. In CIKM'19. 1563--1572.
[23]
Walid Krichene and Steffen Rendle. 2020. On Sampled Metrics for Item Recommendation. In KDD'20. 1748--1757.
[24]
Chenglin Li, Yuanzhen Xie, Chenyun Yu, Bo Hu, Zang Li, Guoqiang Shu, Xiaohu Qie, and Di Niu. 2023 a. One for All, All for One: Learning and Transferring User Embeddings for Cross-Domain Recommendation. In WSDM'23. 366--374.
[25]
Lei Li, Yongfeng Zhang, and Li Chen. 2023 b. Personalized Prompt Learning for Explainable Recommendation. ACM Trans. Inf. Syst., Vol. abs/2202.07371 (2023).
[26]
Jianxun Lian, Fuzheng Zhang, Xing Xie, and Guangzhong Sun. 2017. CCCFNet: A Content-Boosted Collaborative Filtering Neural Network for Cross Domain Recommender Systems. In WWW'17. 817--818.
[27]
Meng Liu, Jianjun Li, Guohui Li, and Peng Pan. 2020. Cross Domain Recommendation via Bi-directional Transfer Graph Collaborative Filtering Networks. In CIKM'20. 885--894.
[28]
Weiming Liu, Xiaolin Zheng, Mengling Hu, and Chaochao Chen. 2022. Collaborative Filtering with Attribution Alignment for Review-based Non-overlapped Cross Domain Recommendation. In WWW'22. 1181--1190.
[29]
Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, and Jie Tang. 2021. GPT Understands, Too. CoRR, Vol. abs/2103.10385 (2021).
[30]
Zemin Liu, Xingtong Yu, Yuan Fang, and Xinming Zhang. 2023. GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks. In WWW'23. 417--428.
[31]
J. Loughry, J.I. van Hemert, and L. Schoofs. 2002. Efficiently Enumerating the Subsets of a Set. applied math (2002).
[32]
Ron Milo, Shai Shen-Orr, Shalev Itzkovitz, Nadav Kashtan, Dmitri Chklovskii, and Uri Alon. 2002. Network motifs: simple building blocks of complex networks. Science, Vol. 298, 5594 (2002), 824--827.
[33]
Orly Moreno, Bracha Shapira, Lior Rokach, and Guy Shani. 2012. TALMUD: transfer learning for multiple domains. In CIKM'12. 425--434.
[34]
Long Ouyang, Jeff Wu, Xu Jiang, and et al. 2022. Training language models to follow instructions with human feedback. CoRR, Vol. abs/2203.02155 (2022).
[35]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In KDD'14. 701--710.
[36]
Dimitrios Rafailidis and Fabio Crestani. 2017. A Collaborative Ranking Model for Cross-Domain Recommendations. In CIKM'17. 2263--2266.
[37]
Seyed-Vahid Sanei-Mehri, Ahmet Erdem Sariyü ce, and Srikanta Tirthapura. 2018. Butterfly Counting in Bipartite Networks. In KDD'18. 2150--2159.
[38]
Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace, and Sameer Singh. 2020. AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. In EMNLP?20. 4222--4235.
[39]
Damien Sileo, Wout Vossen, and Robbe Raymaekers. 2022. Zero-Shot Recommendation as Language Modeling. In ECIR'22 (Lecture Notes in Computer Science, Vol. 13186). 223--230.
[40]
Harald Steck. 2019. Embarrassingly Shallow Autoencoders for Sparse Data. In WWW'19. 3251--3257.
[41]
Mingchen Sun, Kaixiong Zhou, Xin He, Ying Wang, and Xin Wang. 2022. GPPT: Graph Pre-training and Prompt Tuning to Generalize Graph Neural Networks. In KDD'22. 1717--1727.
[42]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In NIPS'17.
[43]
Kai Wang, Xuemin Lin, Lu Qin, Wenjie Zhang, and Ying Zhang. 2019. Vertex Priority Based Butterfly Counting for Large-scale Bipartite Networks. VLDB'19 (2019), 1139--1152.
[44]
Yiqing Wu, Ruobing Xie, Yongchun Zhu, Fuzhen Zhuang, Xiang Ao, Xu Zhang, Leyu Lin, and Qing He. 2022. Selective Fairness in Recommendation via Prompts. In SIGIR '22. 2657--2662.
[45]
Chunfeng Yang, Huan Yan, Donghan Yu, Yong Li, and Dah Ming Chiu. 2017. Multi-site User Behavior Modeling and Its Application in Video Recommendation. In SIGIR'17. 175--184.
[46]
Hongzhi Yin, Qinyong Wang, Kai Zheng, Zhixu Li, Jiali Yang, and Xiaofang Zhou. 2019. Social Influence-Based Group Representation Learning for Group Recommendation. In ICDE'19. IEEE, 566--577.
[47]
Junliang Yu, Hongzhi Yin, Min Gao, Xin Xia, Xiangliang Zhang, and Nguyen Quoc Viet Hung. 2021a. Socially-Aware Self-Supervised Tri-Training for Recommendation. In KDD'21. ACM, 2084--2092.
[48]
Junliang Yu, Hongzhi Yin, Jundong Li, Qinyong Wang, Nguyen Quoc Viet Hung, and Xiangliang Zhang. 2021b. Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation. In WWW'21. 413--424.
[49]
Junliang Yu, Hongzhi Yin, Xin Xia, Tong Chen, Jundong Li, and Zi Huang. 2023. Self-Supervised Learning for Recommender Systems: A Survey. IEEE Trans. Knowl. Data Eng. (2023).
[50]
Feng Yuan, Lina Yao, and Boualem Benatallah. 2019. DARec: Deep Domain Adaptation for Cross-Domain Recommendation via Transferring Rating Patterns. In IJCAI?19. 4227--4233.
[51]
Zizhuo Zhang and Bang Wang. 2023. Prompt Learning for News Recommendation. In SIGIR'23. 227--237.
[52]
Lili Zhao, Sinno Jialin Pan, Evan Wei Xiang, Erheng Zhong, Zhongqi Lu, and Qiang Yang. 2013. Active Transfer Learning for Cross-System Recommendation. In AAAI'13.
[53]
Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, and Ji-Rong Wen. 2020. S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization. In CIKM'20.
[54]
Yongchun Zhu, Kaikai Ge, Fuzhen Zhuang, Ruobing Xie, Dongbo Xi, Xu Zhang, Leyu Lin, and Qing He. 2021. Transfer-Meta Framework for Cross-domain Recommendation to Cold-Start Users. In SIGIR'21. 1813--1817.
[55]
Yongchun Zhu, Zhenwei Tang, Yudan Liu, Fuzhen Zhuang, Ruobing Xie, Xu Zhang, Leyu Lin, and Qing He. 2022. Personalized Transfer of User Preferences for Cross-domain Recommendation. In WSDM'22. 1507--1515. io

Cited By

View all
  • (2024)Preference Prototype-Aware Learning for Universal Cross-Domain RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679774(3290-3299)Online publication date: 21-Oct-2024
  • (2024)Channel-Enhanced Contrastive Cross-Domain Sequential RecommendationData Science and Engineering10.1007/s41019-024-00250-19:3(325-340)Online publication date: 14-Jun-2024

Index Terms

  1. Motif-based Prompt Learning for Universal Cross-domain Recommendation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WSDM '24: Proceedings of the 17th ACM International Conference on Web Search and Data Mining
    March 2024
    1246 pages
    ISBN:9798400703713
    DOI:10.1145/3616855
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 March 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cross-domain recommendation
    2. motif
    3. prompt learning

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    WSDM '24

    Acceptance Rates

    Overall Acceptance Rate 498 of 2,863 submissions, 17%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)345
    • Downloads (Last 6 weeks)43
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Preference Prototype-Aware Learning for Universal Cross-Domain RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679774(3290-3299)Online publication date: 21-Oct-2024
    • (2024)Channel-Enhanced Contrastive Cross-Domain Sequential RecommendationData Science and Engineering10.1007/s41019-024-00250-19:3(325-340)Online publication date: 14-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media