Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3292500.3330906acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

DAML: Dual Attention Mutual Learning between Ratings and Reviews for Item Recommendation

Published: 25 July 2019 Publication History

Abstract

Despite the great success of many matrix factorization based collaborative filtering approaches, there is still much space for improvement in recommender system field. One main obstacle is the cold-start and data sparseness problem, requiring better solutions. Recent studies have attempted to integrate review information into rating prediction. However, there are two main problems: (1) most of existing works utilize a static and independent method to extract the latent feature representation of user and item reviews ignoring the correlation between the latent features, which may fail to capture the preference of users comprehensively. (2) there is no effective framework that unifies ratings and reviews. Therefore, we propose a novel d ual a ttention m utual l earning between ratings and reviews for item recommendation, named DAML. Specifically, we utilize local and mutual attention of the convolutional neural network to jointly learn the features of reviews to enhance the interpretability of the proposed DAML model. Then the rating features and review features are integrated into a unified neural network model, and the higher-order nonlinear interaction of features are realized by the neural factorization machines to complete the final rating prediction. Experiments on the five real-world datasets show that DAML achieves significantly better rating prediction accuracy compared to the state-of-the-art methods. Furthermore, the attention mechanism can highlight the relevant information in reviews to increase the interpretability of rating prediction.

References

[1]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. J. Mach. Learn. Res. 3 (Jan. 2003), 993--1022.
[2]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural Attentional Rating Regression with Review-level Explanations. In Proceedings of the 2018 World WideWeb Conference. InternationalWorld WideWeb Conferences Steering Committee, 1583--1592.
[3]
Zhiyong Cheng, Ying Ding, Xiangnan He, Lei Zhu, Xuemeng Song, and Mohan Kankanhalli. 2018. A3NCF: An Adaptive Aspect Attention Model for Rating Prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. AAAI Press, 3748--3754.
[4]
Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan Kankanhalli. 2018. Aspect- Aware Latent Factor Model: Rating Prediction with Ratings and Reviews. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, 639--648.
[5]
Ronan Collobert, JasonWeston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. J. Mach. Learn. Res. 12 (Nov. 2011), 2493--2537.
[6]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 507--517.
[7]
Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 355--364.
[8]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173--182.
[9]
Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional Matrix Factorization for Document Context-Aware Recommendation. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 233--240.
[10]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980 (2014).
[11]
Weiwei Liu and IvorW. Tsang. 2017. Making Decision Trees Feasible in Ultrahigh Feature and Label Dimensions. Journal of Machine Learning Research 18 (2017), 81:1--81:36.
[12]
Weiwei Liu, Ivor W. Tsang, and Klaus-Robert Müller. 2017. An Easy-to-hard Learning Paradigm for Multiple Classes and Multiple Labels. Journal of Machine Learning Research 18 (2017), 94:1--94:38.
[13]
Weiwei Liu, Donna Xu, Ivor W. Tsang, and Wenjie Zhang. 2019. Metric Learning for Multi-Output Tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 2 (2019), 408--422.
[14]
Yichao Lu, Ruihai Dong, and Barry Smyth. 2018. Coevolutionary Recommendation Model: Mutual Learning Between Ratings and Reviews. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, 773--782.
[15]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global Vectors for Word Representation. In Proceedings of the 2014 conference on empirical methods in natural language processing. 1532--1543.
[16]
Steffen Rendle. 2010. Factorization Machines. In Proceedings of the 2010 IEEE International Conference on Data Mining. IEEE Computer Society, 995--1000.
[17]
Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. In Proceedings of the 20th International Conference on Neural Information Processing Systems. Curran Associates Inc., 1257--1264.
[18]
Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction. In Proceedings of the Eleventh ACM Conference on Recommender Systems. ACM, 297--305.
[19]
Ying Shan, T. Ryan Hoens, Jian Jiao, Haijing Wang, Dong Yu, and JC Mao. 2016. Deep Crossing: Web-Scale Modeling Without Manually Crafted Combinatorial Features. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 255--262.
[20]
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. J. Mach. Learn. Res. 15, 1 (Jan. 2014), 1929--1958.
[21]
Nitish Srivastava and Ruslan R Salakhutdinov. 2012. Multimodal Learning with Deep Boltzmann Machines. In Advances in Neural Information Processing Systems 25. Curran Associates, Inc., 2222--2230.
[22]
Yunzhi Tan, Min Zhang, Yiqun Liu, and Shaoping Ma. 2016. Rating-boosted Latent Topics: Understanding Users and Items with Ratings and Reviews. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. 2640-- 2646.
[23]
Cunchao Tu, Han Liu, Zhiyuan Liu, and Maosong Sun. 2017. CANE: Context- Aware Network Embedding for Relation Modeling. 1722--1731.
[24]
Chong Wang and David M. Blei. 2011. Collaborative Topic Modeling for Recommending Scientific Articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 448--456.
[25]
HaoWang, NaiyanWang, and Dit-Yan Yeung. 2015. Collaborative Deep Learning for Recommender Systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1235--1244.
[26]
LibingWu, Cong Quan, Chenliang Li, QianWang, Bolong Zheng, and Xiangyang Luo. 2019. A Context-Aware User-Item Representation Learning for Item Recommendation. ACM Trans. Inf. Syst. 37, 2 (Jan. 2019), 1--29.
[27]
Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua. 2017. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. AAAI Press, 3119--3125.
[28]
Wenpeng Yin, Hinrich Schütze, Bing Xiang, and Bowen Zhou. 2015. ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. Transactions of the Association for Computational Linguistics 4 (12 2015).
[29]
Wei Zhang, Quan Yuan, Jiawei Han, and Jianyong Wang. 2016. Collaborative Multi-level Embedding Learning from Reviews for Rating Prediction. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. AAAI Press, 2986--2992.
[30]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. ACM, 425--434.
[31]
Yu Zheng. 2015. Methodologies for Cross-Domain Data Fusion: An Overview. IEEE Transactions on Big Data 1 (03 2015), 1--1.

Cited By

View all
  • (2024)Robust QoS Prediction Based on Reputation Integrated Graph Convolution NetworkIEEE Transactions on Services Computing10.1109/TSC.2023.331764217:3(1154-1167)Online publication date: May-2024
  • (2024)Dynamic and Static Representation Learning Network for RecommendationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.317761135:1(831-841)Online publication date: Jan-2024
  • (2024)Knowledge-Aware Collaborative Filtering With Pre-Trained Language Model for Personalized Review-Based Rating PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.330188436:3(1170-1182)Online publication date: Mar-2024
  • Show More Cited By

Index Terms

  1. DAML: Dual Attention Mutual Learning between Ratings and Reviews for Item Recommendation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
    July 2019
    3305 pages
    ISBN:9781450362016
    DOI:10.1145/3292500
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. attention mechanism
    2. neural factorization machines
    3. neural network
    4. rating prediction
    5. recommender systems

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    KDD '19
    Sponsor:

    Acceptance Rates

    KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)275
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 26 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Robust QoS Prediction Based on Reputation Integrated Graph Convolution NetworkIEEE Transactions on Services Computing10.1109/TSC.2023.331764217:3(1154-1167)Online publication date: May-2024
    • (2024)Dynamic and Static Representation Learning Network for RecommendationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.317761135:1(831-841)Online publication date: Jan-2024
    • (2024)Knowledge-Aware Collaborative Filtering With Pre-Trained Language Model for Personalized Review-Based Rating PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.330188436:3(1170-1182)Online publication date: Mar-2024
    • (2024)Joint inter-word and inter-sentence multi-relation modeling for summary-based recommender systemInformation Processing & Management10.1016/j.ipm.2023.10363161:3(103631)Online publication date: May-2024
    • (2024)Prompt2RecInformation Sciences: an International Journal10.1016/j.ins.2024.121046678:COnline publication date: 1-Sep-2024
    • (2024)UIFRS-HAN: User interests-aware food recommender system based on the heterogeneous attention networkEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108766135(108766)Online publication date: Sep-2024
    • (2024)Fusion learning of preference and bias from ratings and reviews for item recommendationData & Knowledge Engineering10.1016/j.datak.2024.102283150(102283)Online publication date: Mar-2024
    • (2024)Deep learning with the generative models for recommender systems: A surveyComputer Science Review10.1016/j.cosrev.2024.10064653(100646)Online publication date: Aug-2024
    • (2024)Key attribute generation from review texts based on in-context learning for recommender systemsApplied Intelligence10.1007/s10489-024-05698-254:20(10194-10205)Online publication date: 1-Oct-2024
    • (2024)Hierarchical Review-Based Recommendation with Contrastive CollaborationWeb and Big Data10.1007/978-981-97-7235-3_1(3-17)Online publication date: 28-Aug-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media