Abstract
Recommender systems are the systems that take advantages of users’ historical behavior data to model the users’ behavior preferences to recommend things to users. However, recommender systems often suffer from data sparsity issues, due to a lack of adequate preference data, which degrades the overall recommendation performance. Cross-domain recommender systems were later developed to transfer knowledge from the auxiliary domain with rich user behavior data to help improve the recommendation performance of the target domain. Most of the existing cross-domain recommendation methods assume that overlapping entities are shared between domains, and then use them as a bridge for knowledge transfer across domains. However, this assumption does not universally hold. In this scenario, the existing cross-domain recommendation methods rarely consider the distribution inconsistency between domains, but directly transfer the cluster-level knowledge learned from the auxiliary domain to the target domain, which cannot ensure the consistency of knowledge transfer. Therefore, when overlapping entities are not shared between domains, how to effectively transfer knowledge is a key challenge for cross-domain recommender systems. Here, we propose a Cross-Domain Collaborative Recommendation without Overlapping Entities Based on Domain Adaptation, called CCR-DA. We find that CCR-DA can simultaneously achieve the consistency of knowledge transfer and avoid negative transfer in a unified framework. Specifically, we first seamlessly integrate the Maximum Mean Discrepancy (MMD) regularization constraints into the weighted collective matrix tri-factorization to reduce the distribution discrepancy between domains, so as to ensure the consistency of knowledge transfer. Then we further incorporate the graph regularization of user and item graphs from the two domains into the above framework to maintain the inherent geometric structure of each domain, thereby avoiding negative transfer. Experimental results on three categories of cross-domain recommendation tasks constructed from six real-world data sets show that our CCR-DA method outperforms.
Similar content being viewed by others
References
Lu, J., Wu, D., Mao, M., Wang, W., Zhang, G.: Recommender system application developments: A survey. Decis. Support Syst. 74, 12–32 (2015)
Bobadilla, J., Ortega, F., Hernando, A., Gutirrez, A.: Recommender systems survey. Knowl. Based Syst. 46(Complete), 109–132 (2013)
Sarwar, B.M., Karypis, G., Konstan, J.A., Riedl, J., et al.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of 10th International Conference World Wide Web (WWW), vol. 1, Hong Kong, China, pp. 285–295 (2001)
Mnih, A., Salakhutdinov, R.R.: Probabilistic matrix factorization. In: Proceedings of Advances Neural Information Processing System (NIPS), Vancouver, Canada, pp. 1257–1264 (2008)
Chen, G., Wang, F., Zhang, C.: Collaborative filtering using orthogonal nonnegative matrix tri-factorization. Inform. Process. Manag. 45(3), 368–379 (2009)
Hernando, A., Bobadilla, J., Ortega, F.: A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl.-Based Syst. 97, 188–202 (2016)
Grcar, M., Mladenic, D., Fortuna, B., Grobelnik, M.: Data sparsity issues in the collaborative filtering framework. In: Proceedings of 7th International Workshop on Knowledge Discovery on the Web, vol. 4198, Chicago, IL, USA, pp. 58–76 (2005)
Pan, W., Xiang, E.W., Liu, N.N., Yang, Q.: Transfer learning in collaborative filtering for sparsity reduction. In: Proceedings of the 24 th AAAI Conference on Artificial Intelligence(AAAI), Atlanta, USA, pp. 230–235 (2010)
Pan, W., Xiang, E., Yang, Q.: Transfer learning in collaborative filtering with uncertain ratings. In: Proceedings of 26th AAAI Conference on Artificial Intelligence(AAAI), vol. 26, no. 1, Toronto, Canada, (2012)
Li, B., Zhu, X., Li, R., Zhang, C.: Rating knowledge sharing in cross-domain collaborative filtering. IEEE Trans. Cybern. 45(5), 1068–1082 (2015)
Pan, W., Yang, Q.: Transfer learning in heterogeneous collaborative filtering domains. Artif. Intell. 197, 39–55 (2013)
Jiang, S., Ding, Z., Fu, Y.: Heterogeneous recommendation via deep low-rank sparse collective factorization. IEEE Trans. Pattern Anal. Mach. Intell. 42(5), 1097–1111 (2020)
Coyle, M., Smyth, B.: (web search) shared: social aspects of a collaborative, community-based search network. In: Proceedings of 5th International Conference on Adaptive Hypermedia and Adaptive Web-Based Syst., Hannover, Germany, pp. 103–112 (2008)
Li, B., Yang, Q., Xue, X.: Can movies and books collaborate? cross-domain collaborative filtering for sparsity reduction. In: Proc. 21st International Joint Conference on Artificial Intelligence (IJCAI), Pasadena, California, USA, pp. 2052–2057 (2009)
Li, B., Yang, Q., Xue, X.: Transfer learning for collaborative filtering via a rating-matrix generative model. In: Proceedings of the 26th Annual International Conference on machine Learning (ICML), Montreal, QC, Canada, pp. 617–624 (2009)
Zhang, Q., Wu, D., Lu, J., Liu, F., Zhang, G.: A cross-domain recommender system with consistent information transfer. Decis. Support Syst. 104, 49–63 (2017)
Gong, B., Shi, Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: 25th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), RI, USA, pp. 2066–2073 (2012)
Gong, B., Grauman, K., Sha, F.: Learning kernels for unsupervised domain adaptation with applications to visual object recognition. Int. J. Comput. Vision 109(1–2), 3–27 (2014)
Zhang, Q., Lu, J., Zhang, G.: Cross-domain recommendation with multiple sources. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, Scotland, United Kingdom, pp. 1–7 (2020)
Singh, A.P., Gordon, G.J.: Relational learning via collective matrix factorization. In: Proc. 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), Las Vegas, NV, USA, pp. 650–658 (2008)
Pan, W., Liu, N.N., Xiang, E.W., Yang, Q.: Transfer learning to predict missing ratings via heterogeneous user feedbacks. In: Proc. 22nd International Joint Conference on Artificial Intelligence (IJCAI), Barcelona, Catalonia, Spain, pp. 2318–2323 (2011)
Hu, L., Cao, J., Xu, G., Cao, L., Zhu, C.: Personalized recommendation via cross-domain triadic factorization. In: Proceedings of 22nd International Conference World Wide Web, pp. 595–606 (2013)
Man, T., Shen, H., Jin, X., Cheng, X.: Cross-domain recommendation: An embedding and mapping approach. In: Proceedings of 26th International Joint Conference on Artificial Intelligence (IJCAI), Melbourne, Australia, pp. 2464–2470 (2017)
Singh, A.P., Gordon, G.J.: Matching users and items across domains to improve the recommendation quality. In: Proc. 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), New York, NY, USA, pp. 801–810 (2014)
Zhao, L., Pan, S., Xiang, E., Zhong, E., Lu, Z., Yang, Q.: Active transfer learning for cross-system recommendation. In: Proceedings of 27th Conference on Artificial Intelligence (AAAI), vol. 27, no. 1, Bellevue, Washington, USA (2013)
Zhao, L., Pan, S.J., Yang, Q.: A unified framework of active transfer learning for cross-system recommendation. Artif. Intell. 245, 38–55 (2017)
Zhang, Q., Lu, J., Wu, D., Zhang, G.: A cross-domain recommender system with kernel-induced knowledge transfer for overlapping entities. IEEE Trans. Neural Netw. 30(7), 1998–2012 (2019)
Sahu, A.K., Dwivedi, P.: Knowledge transfer by domain-independent user latent factor for cross-domain recommender systems. Future Gener. Comput. Syst. 108, 320–333 (2020)
Zhang, H., Kong, X., Zhang, Y.: Enhanced knowledge transfer for collaborative filtering with multi-source heterogeneous feedbacks. Multimedia Tools Appl. 80(16), 24245–24270 (2021)
Gao, C., Li, Y., Feng, F., Chen, X., Zhao, K., He, X., Jin, D.: Cross-domain recommendation with bridge-item embeddings. ACM Trans. Knowl. Discov. Data (TKDD) 16(1), 1–23 (2021)
Do, Q., Liu, W., Fan, J., Tao, D.: Unveiling hidden implicit similarities for cross-domain recommendation. IEEE Trans. Knowl. Data Eng. 33(1), 302–315 (2021)
Gao, S., Luo, H., Chen, D., Li, S., Gallinari, P., Guo, J.: Cross-domain recommendation via cluster-level latent factor model. In: Proceedings of European Conference on Machine Learning Knowledge Discovery Databases (ECML/PKDD), Prague, Czech Republic, pp. 161–176 (2013)
Zhang, Q., Lu, J., Wu, D., Zhang, G.: Cross-domain recommendation with consistent knowledge transfer by subspace alignment. In: International Conference on Web Information Systems Engineering, Dubai, United Arab Emirates, pp. 67–82 (2018)
Gretton, A., Borgwardt, K.M., Rasch, M.J., Schlkopf, B., Smola, A.J.: A kernel method for the two-sample-problem. Adv. Neural Inform. Process. Syst. (2007)
Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)
Long, M., Wang, J., Ding, G., Shen, D., Yang, Q.: Transfer learning with graph co-regularization. IEEE Trans. Knowl. Data Eng. 26(7), 1805–1818 (2013)
Mingming, G., Kun, Z., Tongliang, L., Dacheng, T., Clark, G., Bernhard, S.: Domain adaptation with conditional transferable components. In: Proceedings of 33rd Annual International Conference on Machine Learning (ICML), vol. 48, New York, NY, USA, pp. 2839–2848 (2016)
Long, M., Wang, J., Ding, G., Sun, J., Yu, P.S.: Transfer joint matching for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA, pp. 1410–1417 (2014)
Gu, Q., Zhou, J., Ding, C.: Collaborative filtering: Weighted nonnegative matrix factorization incorporating user and item graphs. In: Proceedings of 10th SIAM International Conference Data Mining(SDM), Columbus, USA, pp. 199–210 (2010)
Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Proceedings of 15th Advances in Neural Information Processing System (NIPS), Vancouver, British Columbia, Canada, pp. 556–562 (2001)
Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2010)
Huang, J., Cheng, X.-Q., Shen, H.-W., Zhou, T., Jin, X.: Exploring social influence via posterior effect of word-of-mouth recommendations. In: Proceedings of 5th ACM International Conference on Web Search and Data Mining, Seattle, WA, USA, pp. 573–582 (2012)
Zhong, E., Fan, W., Yang, Q.: User behavior learning and transfer in composite social networks. ACM Trans. Knowl. Disc. Data 8(1), 1–32 (2014)
Jamali, M., Ester, M.: A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of 4th ACM Conf. Recommender System, Barcelona, Spain, pp. 135–142 (2010)
Si, L., Jin, R.: “Flexible mixture model for collaborative filtering,” In: Proceedings of 20th International Conference on Machine Learning (ICML), Washington, DC, USA, pp 704–711 (2003)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (NSFC) under Grant 61772111, in part by the Foundation for Innovative Research Groups of the National Natural Science Foundation of China (NSFC) under Grant 71421001.
Author information
Authors and Affiliations
Consortia
Corresponding author
Additional information
Communicated by B-K Bao.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, H., Kong, X., Member, IEEE. et al. Cross-domain collaborative recommendation without overlapping entities based on domain adaptation. Multimedia Systems 28, 1621–1637 (2022). https://doi.org/10.1007/s00530-022-00923-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-022-00923-9