Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3077136.3080822acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Neural Rating Regression with Abstractive Tips Generation for Recommendation

Published: 07 August 2017 Publication History

Abstract

Recently, some E-commerce sites launch a new interaction box called Tips on their mobile apps. Users can express their experience and feelings or provide suggestions using short texts typically several words or one sentence. In essence, writing some tips and giving a numerical rating are two facets of a user's product assessment action, expressing the user experience and feelings. Jointly modeling these two facets is helpful for designing a better recommendation system. While some existing models integrate text information such as item specifications or user reviews into user and item latent factors for improving the rating prediction, no existing works consider tips for improving recommendation quality. We propose a deep learning based framework named NRT which can simultaneously predict precise ratings and generate abstractive tips with good linguistic quality simulating user experience and feelings. For abstractive tips generation, gated recurrent neural networks are employed to "translate'' user and item latent representations into a concise sentence. Extensive experiments on benchmark datasets from different domains show that NRT achieves significant improvements over the state-of-the-art methods. Moreover, the generated tips can vividly predict the user experience and feelings.

References

[1]
Amjad Almahairi, Kyle Kastner, Kyunghyun Cho, and Aaron Courville. 2015. Learning distributed representations from reviews for collaborative filtering RecSys. ACM, 147--154.
[2]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate ICLR.
[3]
Lidong Bing, Piji Li, Yi Liao, Wai Lam, Weiwei Guo, and Rebecca Passonneau. 2015. Abstractive Multi-Document Summarization via Phrase Selection and Merging ACL. 1587--1597.
[4]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. JMLR, Vol. 3, Jan (2003), 993--1022.
[5]
Li Chen, Guanliang Chen, and Feng Wang. 2015. Recommender systems based on user reviews: the state of the art. User Modeling and User-Adapted Interaction Vol. 25, 2 (2015), 99--154.
[6]
Kyunghyun Cho, Bart van Merriënboer Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares Holger Schwenk, and Yoshua Bengio 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. EMNLP (2014), 1724--1734.
[7]
Günes Erkan and Dragomir R. Radev. 2004. Lexrank: Graph-based lexical centrality as salience in text summarization. JAIR Vol. 22 (2004), 457--479.
[8]
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press. http://www.deeplearningbook.org.
[9]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In NIPS. 2672--2680.
[10]
Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. Trirank: Review-aware explainable recommendation by modeling aspects CIKM. ACM, 1661--1670.
[11]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In WWW. 173--182.
[12]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
[13]
Philipp Koehn. 2004. Pharaoh: a beam search decoder for phrase-based statistical machine translation models Conference of the Association for Machine Translation in the Americas. Springer, 115--124.
[14]
Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model KDD. ACM, 426--434.
[15]
Yehuda Koren, Robert Bell, Chris Volinsky, and others. 2009. Matrix factorization techniques for recommender systems. Computer, Vol. 42, 8 (2009), 30--37.
[16]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks NIPS. 1097--1105.
[17]
Quoc V. Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. ICML. 1188--1196.
[18]
Daniel D. Lee and H. Sebastian Seung 2001. Algorithms for non-negative matrix factorization. NIPS. 556--562.
[19]
Piji Li, Zihao Wang, Wai Lam, Zhaochun Ren, and Lidong Bing. 2017. Salience Estimation via Variational Auto-Encoders for Multi-Document Summarization AAAI. 3497--3503.
[20]
Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries ACL Workshop, Vol. Vol. 8.
[21]
Guang Ling, Michael R. Lyu, and Irwin King. 2014. Ratings meet reviews, a combined approach to recommend RecSys. 105--112.
[22]
Benjamin M. Marlin. 2003. Modeling user rating profiles for collaborative filtering NIPS. 627--634.
[23]
Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: understanding rating dimensions with review text RecSys. ACM, 165--172.
[24]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality NIPS. 3111--3119.
[25]
Andrew Ng. 2011. Sparse autoencoder. CS294A Lecture notes Vol. 72 (2011), 1--19.
[26]
Zhaochun Ren, Shangsong Liang, Piji Li, Shuaiqiang Wang, and Maarten de Rijke. 2017. Social collaborative viewpoint regression with explainable recommendations WSDM.
[27]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to recommender systems handbook. Springer.
[28]
Frank Rosenblatt. 1961. Principles of neurodynamics. perceptrons and the theory of brain mechanisms. Technical Report. DTIC Document.
[29]
David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. 1988. Learning representations by back-propagating errors. Cognitive modeling, Vol. 5, 3 (1988), 1.
[30]
Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sentence summarization EMNLP.
[31]
Ruslan Salakhutdinov and Andriy Mnih 2007. Probabilistic Matrix Factorization. In NIPS. 1--8.
[32]
Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton. 2007. Restricted Boltzmann machines for collaborative filtering ICML. ACM, 791--798.
[33]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl 2001. Item-based collaborative filtering recommendation algorithms WWW. ACM, 285--295.
[34]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie 2015. Autorec: Autoencoders meet collaborative filtering WWW. ACM, 111--112.
[35]
Yue Shi, Martha Larson, and Alan Hanjalic. 2010. List-wise learning to rank with matrix factorization for collaborative filtering RecSys. 269--272.
[36]
Richard Socher, Danqi Chen, Christopher D. Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion NIPS. 926--934.
[37]
Xiaoyuan Su and Taghi M Khoshgoftaar. 2009. A survey of collaborative filtering techniques. Advances in artificial intelligence Vol. 2009 (2009), 4.
[38]
Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints Vol. abs/1605.02688 (2016).
[39]
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. JMLR Vol. 11 (2010), 3371--3408.
[40]
Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles KDD. ACM, 448--456.
[41]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems KDD. ACM, 1235--1244.
[42]
Hao Wang, S. H. I. Xingjian, and Dit-Yan Yeung 2016. Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks NIPS. 415--423.
[43]
Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J. Smola, and How Jing. 2017. Recurrent Recommender Networks. In WSDM. 495--503.
[44]
Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester. 2016. Collaborative denoising auto-encoders for top-n recommender systems WSDM. ACM, 153--162.
[45]
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, and others. 2016. Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. arXiv preprint arXiv:1609.08144 (2016).
[46]
Yinqing Xu, Wai Lam, and Tianyi Lin. 2014. Collaborative filtering incorporating review text and co-clusters of hidden user communities and item groups. In CIKM. ACM, 251--260.
[47]
Yinqing Xu, Bei Shi, Wentao Tian, and Wai Lam. 2015. A Unified Model for Unsupervised Opinion Spamming Detection Incorporating Text Generality IJCAI. 725--731.
[48]
Matthew D. Zeiler. 2012. ADADELTA: an adaptive learning rate method. arXiv preprint arXiv:1212.5701 (2012).
[49]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint deep modeling of users and items using reviews for recommendation WSDM. ACM, 425--434.

Cited By

View all
  • (2025)SiSRS: Signed social recommender system using deep neural network representation learningExpert Systems with Applications10.1016/j.eswa.2024.125205259(125205)Online publication date: Jan-2025
  • (2024)Enhancing Explainable Recommendations: Integrating Reason Generation and Rating Prediction through Multi-Task LearningApplied Sciences10.3390/app1418830314:18(8303)Online publication date: 14-Sep-2024
  • (2024)Improving Faithfulness and Factuality with Contrastive Learning in Explainable RecommendationACM Transactions on Internet Technology10.1145/3653984Online publication date: 25-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
August 2017
1476 pages
ISBN:9781450350228
DOI:10.1145/3077136
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deep learning
  2. rating prediction
  3. tips generation

Qualifiers

  • Research-article

Funding Sources

  • Research Grant Council of the Hong Kong Special Administrative Region
  • Microsoft Research Asia Urban Informatics

Conference

SIGIR '17
Sponsor:

Acceptance Rates

SIGIR '17 Paper Acceptance Rate 78 of 362 submissions, 22%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)118
  • Downloads (Last 6 weeks)15
Reflects downloads up to 24 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2025)SiSRS: Signed social recommender system using deep neural network representation learningExpert Systems with Applications10.1016/j.eswa.2024.125205259(125205)Online publication date: Jan-2025
  • (2024)Enhancing Explainable Recommendations: Integrating Reason Generation and Rating Prediction through Multi-Task LearningApplied Sciences10.3390/app1418830314:18(8303)Online publication date: 14-Sep-2024
  • (2024)Improving Faithfulness and Factuality with Contrastive Learning in Explainable RecommendationACM Transactions on Internet Technology10.1145/3653984Online publication date: 25-May-2024
  • (2024)A Comparative Analysis of Text-Based Explainable Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688069(105-115)Online publication date: 8-Oct-2024
  • (2024)Natural Language Explainable Recommendation with Robustness EnhancementProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671781(4203-4212)Online publication date: 25-Aug-2024
  • (2024)Aligning Explanations for Recommendation with Rating and Feature via Maximizing Mutual InformationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679663(3374-3383)Online publication date: 21-Oct-2024
  • (2024)Budgeted Embedding Table For Recommender SystemsProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635778(557-566)Online publication date: 4-Mar-2024
  • (2024)Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationProceedings of the ACM Web Conference 202410.1145/3589334.3645661(3854-3863)Online publication date: 13-May-2024
  • (2024)MMLF: Multi-Metric Latent Feature Analysis for High-Dimensional and Incomplete DataIEEE Transactions on Services Computing10.1109/TSC.2023.333157017:2(575-588)Online publication date: Mar-2024
  • (2024)A Prediction-Sampling-Based Multilayer-Structured Latent Factor Model for Accurate Representation to High-Dimensional and Sparse DataIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.320000935:3(3845-3858)Online publication date: Mar-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media