Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Attentive Aspect Modeling for Review-Aware Recommendation

Published: 27 March 2019 Publication History

Abstract

In recent years, many studies extract aspects from user reviews and integrate them with ratings for improving the recommendation performance. The common aspects mentioned in a user’s reviews and a product’s reviews indicate indirect connections between the user and product. However, these aspect-based methods suffer from two problems. First, the common aspects are usually very sparse, which is caused by the sparsity of user-product interactions and the diversity of individual users’ vocabularies. Second, a user’s interests on aspects could be different with respect to different products, which are usually assumed to be static in existing methods. In this article, we propose an Attentive Aspect-based Recommendation Model (AARM) to tackle these challenges. For the first problem, to enrich the aspect connections between user and product, besides common aspects, AARM also models the interactions between synonymous and similar aspects. For the second problem, a neural attention network which simultaneously considers user, product, and aspect information is constructed to capture a user’s attention toward aspects when examining different products. Extensive quantitative and qualitative experiments show that AARM can effectively alleviate the two aforementioned problems and significantly outperforms several state-of-the-art recommendation methods on the top-N recommendation task.

References

[1]
Konstantin Bauman, Bing Liu, and Alexander Tuzhilin. 2017. Aspect based recommendations: Recommending items with the most valuable aspects based on user reviews. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 717--725.
[2]
Da Cao, Xiangnan He, Lianhai Miao, Yahui An, Chao Yang, and Richang Hong. 2018. Attentive group recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, 645--654.
[3]
Da Cao, Xiangnan He, Liqiang Nie, Xiaochi Wei, Xia Hu, Shunxiang Wu, and Tat-Seng Chua. 2017. Cross-platform app recommendation by jointly modeling ratings and texts. ACM Transactions on Information Systems 35, 4 (2017), Article 37, 37:1--37:27 pages.
[4]
Rose Catherine and William Cohen. 2017. Transnets: Learning to transform for recommendation. In Proceedings of the 11th ACM Conference on Recommender Systems. ACM, 288--296.
[5]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 1583--1592.
[6]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2019. Social attentional memory network: Modeling aspect- and friend-level differences in recommendation. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining.
[7]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 335--344.
[8]
Li Chen, Guanliang Chen, and Feng Wang. 2015. Recommender systems based on user reviews: The state of the art. User Modeling and User-Adapted Interaction 25, 2 (2015), 99--154.
[9]
Xu Chen, Zheng Qin, Yongfeng Zhang, and Tao Xu. 2016. Learning to rank features for recommendation over multiple categories. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 305--314.
[10]
Zhiyong Cheng, Xiaojun Chang, Lei Zhu, Rose C. Kanjirathinkal, and Mohan Kankanhalli. 2019. MMALFM: Explainable recommendation by leveraging reviews and images. ACM Transactions on Information Systems (TOIS) 37, 2 (2019), 16.
[11]
Zhiyong Cheng, Ying Ding, Xiangnan He, Lei Zhu, Xuemeng Song, and Mohan Kankanhalli. 2018. A<sup>3</sup> NCF: An adaptive aspect attention model for rating prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, 3748--3754.
[12]
Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan Kankanhalli. 2018. Aspect-aware latent factor model: Rating prediction with ratings and reviews. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, 639--648.
[13]
Jin Yao Chin, Kaiqi Zhao, Shafiq Joty, and Gao Cong. 2018. ANR: Aspect-based neural recommender. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 147--156.
[14]
Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-N recommendation tasks. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 39--46.
[15]
Ruihai Dong and Barry Smyth. 2017. User-based opinion-based recommendation. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. AAAI Press, 4821--4825.
[16]
Travis Ebesu, Bin Shen, and Yi Fang. 2018. Collaborative memory network for recommendation systems. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’18). ACM, New York, 515--524.
[17]
Gayatree Ganu, Yogesh Kakodkar, and AméLie Marian. 2013. Improving the quality of predictions using textual information in online user reviews. Information Systems 38, 1 (2013), 1--15.
[18]
Yoav Goldberg. 2017. Neural network methods for natural language processing. Synthesis Lectures on Human Language Technologies 10, 1 (2017), 1--309.
[19]
Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Xin-Shun Xu, and Mohan Kankanhalli. 2018. Multi-modal preference modeling for product search. In Proceedings of the 2018 ACM on Multimedia Conference. ACM.
[20]
Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 507--517.
[21]
Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware explainable recommendation by modeling aspects. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 1661--1670.
[22]
Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 355--364.
[23]
Xiangnan He, Zhenkui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. NAIS: Neural attentive item similarity model for recommendation. IEEE Transactions on Knowledge and Data Engineering 30, 12 (2018), 2354–2366.
[24]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173--182.
[25]
Richang Hong, Lei Li, Junjie Cai, Dapeng Tao, Meng Wang, and Qi Tian. 2017. Coherent semantic-visual indexing for large-scale image retrieval in the cloud. IEEE Transactions on Image Processing 26, 9 (2017), 4128--4138.
[26]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980.
[27]
Y. Koren, R. Bell, and C. Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30--37.
[28]
Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the International Conference on Machine Learning. 1188--1196.
[29]
Tie-Yan Liu. 2009. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval 3, 3 (March 2009), 225--331.
[30]
Xin Luo, Ye Wu, and Xin-Shun Xu. 2018. Scalable supervised discrete hashing for large-scale search. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 1603--1612.
[31]
Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: Understanding rating dimensions with review text. In Proceedings of the 7th ACM Conference on Recommender Systems. ACM, 165--172.
[32]
Xuying Meng, Suhang Wang, Huan Liu, and Yujun Zhang. 2018. Exploiting emotion on reviews for recommender systems. In Proceedings of the AAAI Conference on Artificial Intelligence.
[33]
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv:1301.3781.
[34]
Weike Pan, Qiang Yang, Wanling Cai, Yaofeng Chen, Qing Zhang, Xiaogang Peng, and Zhong Ming. 2019. Transfer to rank for heterogeneous one-class collaborative filtering. ACM Transactions on Information Systems 37, 1 (Jan. 2019), Article 10, 20 pages.
[35]
Štefan Pero and Tomáš Horváth. 2013. Opinion-driven matrix factorization for rating prediction. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 1--13.
[36]
Steffen Rendle. 2010. Factorization machines. In Proceedings of the 2010 IEEE International Conference on Data Mining. IEEE Computer Society, 995--1000.
[37]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461.
[38]
Gerard Salton, Anita Wong, and Chung-Shu Yang. 1975. A vector space model for automatic indexing. Communications of the ACM 18, 11 (1975), 613--620.
[39]
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15, 1 (2014), 1929--1958.
[40]
Jiwei Tan, Xiaojun Wan, Hui Liu, and Jianguo Xiao. 2018. QuoteRec: Toward quote recommendation for writing. ACM Transactions on Information Systems 36, 3 (2018), 34:1--34:36.
[41]
Yunzhi Tan, Min Zhang, Yiqun Liu, and Shaoping Ma. 2016. Rating-boosted latent topics: Understanding users and items with ratings and reviews. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. AAAI Press, 2640--2646.
[42]
Shuaiqiang Wang, Shanshan Huang, Tie-Yan Liu, Jun Ma, Zhumin Chen, and Jari Veijalainen. 2016. Ranking-oriented collaborative filtering: A listwise approach. ACM Transactions on Information Systems 35, 2 (2016), 10:1--10:28.
[43]
Xiang Wang, Xiangnan He, Fuli Feng, Liqiang Nie, and Tat-Seng Chua. 2018. TEM: Tree-enhanced embedding model for explainable recommendation. In Proceedings of the 2018 World Wide Web Conference (WWW’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 1543--1552.
[44]
Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua. 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. AAAI Press, 3119--3125.
[45]
Yinqing Xu, Wai Lam, and Tianyi Lin. 2014. Collaborative filtering incorporating review text and co-clusters of hidden user communities and item groups. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. ACM, 251--260.
[46]
Longqi Yang, Cheng-Kang Hsieh, Hongjian Yang, John P. Pollak, Nicola Dell, Serge Belongie, Curtis Cole, and Deborah Estrin. 2017. Yum-Me: A personalized nutrient-based meal recommender system. ACM Transactions on Information Systems 36, 1 (2017), 7:1--7:31.
[47]
Wei Zhang and Jianyong Wang. 2016. Integrating topic and latent factors for scalable personalized review-based rating prediction. IEEE Transactions on Knowledge and Data Engineering 28, 11 (2016), 3013--3027.
[48]
Yongfeng Zhang, Qingyao Ai, Xu Chen, and W. Bruce Croft. 2017. Joint representation learning for top-N recommendation with heterogeneous information sources. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM, 1449--1458.
[49]
Yongfeng Zhang, Guokun Lai, Min Zhang, Yi Zhang, Yiqun Liu, and Shaoping Ma. 2014. Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 83--92.
[50]
Yongfeng Zhang, Haochen Zhang, Min Zhang, Yiqun Liu, and Shaoping Ma. 2014. Do users rate or review?: Boost phrase-level sentiment labeling with review-level sentiment classification. In Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1027--1030.
[51]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint deep modeling of users and items using reviews for recommendation. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. ACM, 425--434.

Cited By

View all
  • (2024)Explicitly Exploiting Implicit User and Item Relations in Graph Convolutional Network (GCN) for RecommendationElectronics10.3390/electronics1314281113:14(2811)Online publication date: 17-Jul-2024
  • (2024)DIRECT: Dual Interpretable Recommendation with Multi-aspect Word AttributionACM Transactions on Intelligent Systems and Technology10.1145/366348315:5(1-21)Online publication date: 6-May-2024
  • (2024)Knowledge-Aware Collaborative Filtering With Pre-Trained Language Model for Personalized Review-Based Rating PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.330188436:3(1170-1182)Online publication date: 1-Mar-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems
ACM Transactions on Information Systems  Volume 37, Issue 3
July 2019
335 pages
ISSN:1046-8188
EISSN:1558-2868
DOI:10.1145/3320115
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 March 2019
Accepted: 01 January 2019
Revised: 01 December 2018
Received: 01 September 2018
Published in TOIS Volume 37, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Top-N recommendation
  2. aspects
  3. attention mechanism
  4. neural network

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • China Scholarship Council (CSC)
  • National Research Foundation, Prime Minister's Office, Singapore under its IRC@SG Funding Initiative
  • National Natural Science Foundation of China
  • NExT research centre

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)108
  • Downloads (Last 6 weeks)11
Reflects downloads up to 13 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Explicitly Exploiting Implicit User and Item Relations in Graph Convolutional Network (GCN) for RecommendationElectronics10.3390/electronics1314281113:14(2811)Online publication date: 17-Jul-2024
  • (2024)DIRECT: Dual Interpretable Recommendation with Multi-aspect Word AttributionACM Transactions on Intelligent Systems and Technology10.1145/366348315:5(1-21)Online publication date: 6-May-2024
  • (2024)Knowledge-Aware Collaborative Filtering With Pre-Trained Language Model for Personalized Review-Based Rating PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.330188436:3(1170-1182)Online publication date: 1-Mar-2024
  • (2024)A Focus on Female Consumer Review-Based Recommender Systems2024 IEEE 4th International Conference on Power, Electronics and Computer Applications (ICPECA)10.1109/ICPECA60615.2024.10470983(656-659)Online publication date: 26-Jan-2024
  • (2024)An Attentive Aspect-Based Recommendation Model With Deep Neural NetworkIEEE Access10.1109/ACCESS.2023.334929112(5781-5791)Online publication date: 2024
  • (2024)Exploiting deep transformer models in textual review based recommender systemsExpert Systems with Applications10.1016/j.eswa.2023.121120235(121120)Online publication date: Jan-2024
  • (2024)Review-based recommendation under preference uncertainty: An asymmetric deep learning frameworkEuropean Journal of Operational Research10.1016/j.ejor.2024.01.042316:3(1044-1057)Online publication date: Aug-2024
  • (2024)Deep shared learning and attentive domain mapping for cross-domain recommendationUser Modeling and User-Adapted Interaction10.1007/s11257-024-09416-yOnline publication date: 27-Sep-2024
  • (2023)Dual-Track Lifelong Machine Learning-Based Fine-Grained Product Quality AnalysisApplied Sciences10.3390/app1303124113:3(1241)Online publication date: 17-Jan-2023
  • (2023)Asymmetric multilevel interactive attention network integrating reviews for item recommendationIntelligent Data Analysis10.3233/IDA-230128(1-18)Online publication date: 29-Jun-2023
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media