Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

An Unsupervised Aspect-Aware Recommendation Model with Explanation Text Generation

Published: 29 November 2021 Publication History

Abstract

Review based recommendation utilizes both users’ rating records and the associated reviews for recommendation. Recently, with the rapid demand for explanations of recommendation results, reviews are used to train the encoder–decoder models for explanation text generation. As most of the reviews are general text without detailed evaluation, some researchers leveraged auxiliary information of users or items to enrich the generated explanation text. Nevertheless, the auxiliary data is not available in most scenarios and may suffer from data privacy problems. In this article, we argue that the reviews contain abundant semantic information to express the users’ feelings for various aspects of items, while these information are not fully explored in current explanation text generation task. To this end, we study how to generate more fine-grained explanation text in review based recommendation without any auxiliary data. Though the idea is simple, it is non-trivial since the aspect is hidden and unlabeled. Besides, it is also very challenging to inject aspect information for generating explanation text with noisy review input. To solve these challenges, we first leverage an advanced unsupervised neural aspect extraction model to learn the aspect-aware representation of each review sentence. Thus, users and items can be represented in the aspect space based on their historical associated reviews. After that, we detail how to better predict ratings and generate explanation text with the user and item representations in the aspect space. We further dynamically assign review sentences which contain larger proportion of aspect words with larger weights to control the text generation process, and jointly optimize rating prediction accuracy and explanation text generation quality with a multi-task learning framework. Finally, extensive experimental results on three real-world datasets demonstrate the superiority of our proposed model for both recommendation accuracy and explainability.

References

[1]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. In ICLR.
[2]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. JMLR 3, Jan (2003), 993–1022.
[3]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural attentional rating regression with review-level explanations. In WWW. 1583–1592.
[4]
Hanxiong Chen, Xu Chen, Shaoyun Shi, and Yongfeng Zhang. 2021. Generate natural language explanations for recommendation. In EARS.
[5]
Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In AAAI. Vol. 34, 27–34.
[6]
Xu Chen, Hanxiong Chen, Hongteng Xu, Yongfeng Zhang, Yixin Cao, Zheng Qin, and Hongyuan Zha. 2019. Personalized fashion recommendation with visual explanations based on multimodal attention network: Towards visually explainable recommendation. In SIGIR. 765–774.
[7]
Yifan Chen, Yang Wang, Xiang Zhao, Jie Zou, and Maarten De Rijke. 2020. Block-Aware item similarity models for top-n recommendation. TOIS 38, 4 (2020), 1–26.
[8]
Zhongxia Chen, Xiting Wang, Xing Xie, Tong Wu, Guoqing Bu, Yining Wang, and Enhong Chen. 2019. Co-Attentive multi-task learning for explainable recommendation. In IJCAI. 2137–2143.
[9]
Zhiyong Cheng, Xiaojun Chang, Lei Zhu, Rose C. Kanjirathinkal, and Mohan Kankanhalli. 2019. MMALFM: Explainable recommendation by leveraging reviews and images. TOIS 37, 2 (2019), 1–28.
[10]
Zhiyong Cheng, Ying Ding, Xiangnan He, Lei Zhu, Xuemeng Song, and Mohan Kankanhalli. 2018. A: An adaptive aspect attention model for rating prediction. In IJCAI. 3748–3754.
[11]
Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan Kankanhalli. 2018. Aspect-aware latent factor model: Rating prediction with ratings and reviews. In WWW. 639–648.
[12]
Jin Yao Chin, Kaiqi Zhao, Shafiq Joty, and Gao Cong. 2018. ANR: Aspect-based neural recommender. In CIKM. 147–156.
[13]
Felipe Costa, Sixun Ouyang, Peter Dolog, and Aonghus Lawlor. 2018. Automatic generation of natural language explanations. In IUI. 1–2.
[14]
Qiming Diao, Minghui Qiu, and Chao-Yuan Wu. 2014. Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In KDD. 193–202.
[15]
Jingtao Ding, Guanghui Yu, Yong Li, Xiangnan He, and Depeng Jin. 2020. Improving implicit recommender systems with auxiliary data. TOIS 38, 1 (2020), 1–27.
[16]
Li Dong, Shaohan Huang, Furu Wei, Mirella Lapata, Ming Zhou, and Ke Xu. 2017. Learning to generate product reviews from attributes. In ACL. 623–632.
[17]
Jiatao Gu, Zhengdong Lu, Hang Li, and Victor O. K. Li. 2016. Incorporating copying mechanism in sequence-to-sequence learning. In ACL. 1631–1640.
[18]
Xinyu Guan, Zhiyong Cheng, Xiangnan He, Yongfeng Zhang, Zhibo Zhu, Qinke Peng, and Tat-Seng Chua. 2019. Attentive aspect modeling for review-aware recommendation. TOIS 37, 3 (2019), 1–27.
[19]
Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier. 2017. An unsupervised neural attention model for aspect extraction. In ACL. 388–397.
[20]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173–182.
[21]
Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional matrix factorization for document context-aware recommendation. In RecSys. 233–240.
[22]
Chenliang Li, Cong Quan, Li Peng, Yunwei Qi, Yuming Deng, and Libing Wu. 2019. A capsule network for recommendation and explaining what you like and dislike. In SIGIR. 275–284.
[23]
Lei Li, Yongfeng Zhang, and Li Chen. 2020. Generate neural template explanations for recommendation. In CIKM. 755–764.
[24]
Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam. 2017. Neural rating regression with abstractive tips generation for recommendation. In SIGIR. 345–354.
[25]
Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In ACL. 74–81.
[26]
Yujie Lin, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Jun Ma, and Maarten de Rijke. 2020. Explainable outfit recommendation with joint outfit matching and comment generation. TKDE 32, 8 (2020), 1502–1516.
[27]
Guang Ling, Michael R. Lyu, and Irwin King. 2014. Ratings meet reviews, a combined approach to recommend. In RecSys. 105–112.
[28]
Bing Liu. 2012. Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies 5, 1 (2012), 1–167.
[29]
Donghua Liu, Jing Li, Bo Du, Jun Chang, and Rong Gao. 2019. DAML: Dual attention mutual learning between ratings and reviews for item recommendation. In KDD. 344–352.
[30]
Yichao Lu, Ruihai Dong, and Barry Smyth. 2018. Coevolutionary recommendation model: Mutual learning between ratings and reviews. In WWW. 773–782.
[31]
Yichao Lu, Ruihai Dong, and Barry Smyth. 2018. Why I like it: Multi-Task learning for recommendation and explanation. In RecSys. 4–12.
[32]
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In ACL. 1412–1421.
[33]
Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: Understanding rating dimensions with review text. In RecSys. 165–172.
[34]
Jianmo Ni, Jiacheng Li, and Julian McAuley. 2019. Justifying recommendations using distantly-labeled reviews and fine-grained aspects. In EMNLP. 188–197.
[35]
Jianmo Ni, Zachary C. Lipton, Sharad Vikram, and Julian McAuley. 2017. Estimating reactions and recommending products with generative models of reviews. In IJCNLP. 783–791.
[36]
Jianmo Ni and Julian McAuley. 2018. Personalized review generation by expanding phrases and attending on aspect-aware representations. In ACL. 706–711.
[37]
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In ACL. 311–318.
[38]
Ruslan Salakhutdinov and Andriy Mnih. 2008. Probabilistic matrix factorization. In NIPS. 1–8.
[39]
Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In RecSys. 297–305.
[40]
Stefan Siersdorfer, Sergiu Chelaru, Wolfgang Nejdl, and Jose San Pedro. 2010. How useful are your comments?: Analyzing and predicting YouTube comments and comment ratings. In WWW. 891.
[41]
Peijie Sun, Le Wu, Kun Zhang, Yanjie Fu, Richang Hong, and Meng Wang. 2020. Dual learning for explainable recommendation: Towards unifying user preference prediction and review generation. In WWW. 837–842.
[42]
Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In NIPS. 1–9.
[43]
Yunzhi Tan, Min Zhang, Yiqun Liu, and Shaoping Ma. 2016. Rating-boosted latent topics: Understanding users and items with ratings and reviews. In IJCAI. 2640–2646.
[44]
Yi Tay, Luu Anh Tuan, and Siu Cheung Hui. 2018. Multi-pointer co-attention networks for recommendation. In KDD. 2309–2318.
[45]
Quoc-Tuan Truong and Hady Lauw. 2019. Multimodal review generation for recommender systems. In WWW. 1864–1874.
[46]
Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles. In KDD. 448–456.
[47]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In KDD. 1235–1244.
[48]
Nan Wang, Hongning Wang, Yiling Jia, and Yue Yin. 2018. Explainable recommendation via multi-task learning in opinionated text data. In SIGIR. 165–174.
[49]
Libing Wu, Cong Quan, Chenliang Li, Qian Wang, Bolong Zheng, and Xiangyang Luo. 2019. A context-aware user-item representation learning for item recommendation. TOIS 37, 2 (2019), 1–29.
[50]
Le Wu, Peijie Sun, Yanjie Fu, Hong Richang, Wang Xiting, and Wang Meng. 2019. A neural influence diffusion model for social recommendation. In SIGIR. 235–244.
[51]
Yao Wu and Martin Ester. 2015. FLAME: A probabilistic model combining aspect based opinion mining and collaborative filtering. In WSDM. 199–208.
[52]
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In ICML. 2048–2057.
[53]
Bao Yang, Fang Hui, and Zhang Jie. 2014. TopicMF simultaneously exploiting ratings and reviews for recommendation. In AAAI. 2–8.
[54]
Yonghui Yang, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2021. Enhanced graph learning for collaborative filtering via mutual information maximization. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 71–80.
[55]
Wei Zhang and Jianyong Wang. 2016. Integrating topic and latent factors for scalable personalized review-based rating prediction. TKDE 28, 11 (2016), 3013–3027.
[56]
Wei Zhang, Quan Yuan, Jiawei Han, and Jianyong Wang. 2016. Collaborative multi-level embedding learning from reviews for rating prediction. In IJCAI. 2986–2992.
[57]
Yongfeng Zhang and Xu Chen. 2020. Explainable recommendation: A survey and new perspectives. Now Foundations and Trends 14, 1 (2020), 1–101.
[58]
Yongfeng Zhang, Guokun Lai, Min Zhang, Yi Zhang, Yiqun Liu, and Shaoping Ma. 2014. Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In SIGIR. 83–92.
[59]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint deep modeling of users and items using reviews for recommendation. In WSDM. 425–434.

Cited By

View all
  • (2024)Enhancing Explainable Recommendations: Integrating Reason Generation and Rating Prediction through Multi-Task LearningApplied Sciences10.3390/app1418830314:18(8303)Online publication date: 14-Sep-2024
  • (2024)Keywords-enhanced Contrastive Learning Model for travel recommendationInformation Processing & Management10.1016/j.ipm.2024.10387461:6(103874)Online publication date: Nov-2024
  • (2023)A Survey on Review - Aware Recommendation SystemsProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617050(198-207)Online publication date: 23-Oct-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems
ACM Transactions on Information Systems  Volume 40, Issue 3
July 2022
650 pages
ISSN:1046-8188
EISSN:1558-2868
DOI:10.1145/3498357
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 November 2021
Accepted: 01 August 2021
Revised: 01 July 2021
Received: 01 November 2020
Published in TOIS Volume 40, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Explainable recommendation
  2. aspect-aware recommendation
  3. review-based recommendation
  4. unsupervised aspect extraction
  5. multi-task learning

Qualifiers

  • Research-article
  • Refereed

Funding Sources

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • Young Elite Scientists Sponsorship

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)344
  • Downloads (Last 6 weeks)22
Reflects downloads up to 24 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Enhancing Explainable Recommendations: Integrating Reason Generation and Rating Prediction through Multi-Task LearningApplied Sciences10.3390/app1418830314:18(8303)Online publication date: 14-Sep-2024
  • (2024)Keywords-enhanced Contrastive Learning Model for travel recommendationInformation Processing & Management10.1016/j.ipm.2024.10387461:6(103874)Online publication date: Nov-2024
  • (2023)A Survey on Review - Aware Recommendation SystemsProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617050(198-207)Online publication date: 23-Oct-2023
  • (2023)Personalized Prompt Learning for Explainable RecommendationACM Transactions on Information Systems10.1145/358048841:4(1-26)Online publication date: 23-Mar-2023
  • (2023)Shilling Black-box Review-based Recommender Systems through Fake Review GenerationProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599502(286-297)Online publication date: 6-Aug-2023
  • (2023)Aspect-Guided Syntax Graph Learning for Explainable RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.322184735:8(7768-7781)Online publication date: 1-Aug-2023
  • (2023)Multi-Aspect enhanced Graph Neural Networks for recommendationNeural Networks10.1016/j.neunet.2022.10.001157:C(90-102)Online publication date: 1-Jan-2023
  • (2023)Learning Implicit Sentiment for Explainable Review-Based RecommendationDatabases Theory and Applications10.1007/978-3-031-47843-7_5(59-72)Online publication date: 1-Nov-2023
  • (undefined)DIRECT: Dual Interpretable Recommendation with Multi-aspect Word AttributionACM Transactions on Intelligent Systems and Technology10.1145/3663483

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media