Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Sound and Music Recommendation with Knowledge Graphs

Published: 21 October 2016 Publication History

Abstract

The Web has moved, slowly but steadily, from a collection of documents towards a collection of structured data. Knowledge graphs have then emerged as a way of representing the knowledge encoded in such data as well as a tool to reason on them in order to extract new and implicit information. Knowledge graphs are currently used, for example, to explain search results, to explore knowledge spaces, to semantically enrich textual documents, or to feed knowledge-intensive applications such as recommender systems. In this work, we describe how to create and exploit a knowledge graph to supply a hybrid recommendation engine with information that builds on top of a collections of documents describing musical and sound items. Tags and textual descriptions are exploited to extract and link entities to external graphs such as WordNet and DBpedia, which are in turn used to semantically enrich the initial data. By means of the knowledge graph we build, recommendations are computed using a feature combination hybrid approach. Two explicit graph feature mappings are formulated to obtain meaningful item feature representations able to catch the knowledge embedded in the graph. Those content features are further combined with additional collaborative information deriving from implicit user feedback. An extensive evaluation on historical data is performed over two different datasets: a dataset of sounds composed of tags, textual descriptions, and user’s download information gathered from Freesound.org and a dataset of songs that mixes song textual descriptions with tags and user’s listening habits extracted from Songfacts.com and Last.fm, respectively. Results show significant improvements with respect to state-of-the-art collaborative algorithms in both datasets. In addition, we show how the semantic expansion of the initial descriptions helps in achieving much better recommendation quality in terms of aggregated diversity and novelty.

References

[1]
Gediminas Adomavicius and YoungOk Kwon. 2012. Improving aggregate recommendation diversity using ranking-based techniques. IEEE Trans. Knowl. Data Eng. 24, 5 (2012), 896--911.
[2]
Mehdi Hosseinzadeh Aghdam, Negar Hariri, Bamshad Mobasher, and Robin D. Burke. 2015. Adapting recommendations to contextual changes using hierarchical hidden Markov models. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys’15). 241--244.
[3]
Sarabjot Singh Anand, Patricia Kearney, and Mary Shapcott. 2007. Generating semantically enriched user profiles for web personalization. ACM Trans. Internet Technol. 7, 4, Article 22 (Oct. 2007).
[4]
Gleb Beliakov, Tomasa Calvo, and Simon James. 2015. Recommender Systems Handbook. Springer US, Boston, MA, Chapter Aggregation Functions for Recommender Systems, 777--808. Retrieved from http://dx.doi.org/10.1007/978-1-4899-7637-6_23
[5]
Alejandro Bellogín, Iván Cantador, and Pablo Castells. 2010. A study of heterogeneity in recommendations for a social music service. In Proceedings of the 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec’10). ACM, 1--8.
[6]
Tim Berners-Lee, James Hendler, and Ora Lassila. 2001. The semantic web: Scientific American. Sci. Am. (May 2001).
[7]
Christian Bizer, Jens Lehmann, Georgi Kobilarov, Sören Auer, Christian Becker, Richard Cyganiak, and Sebastian Hellmann. 2009. DBpedia - A crystallization point for the web of data. Web Semant. 7 (September 2009), 154--165. Issue 3.
[8]
Dmitry Bogdanov, Nicolas Wack, and others. 2013. ESSENTIA: An open-source library for sound and music analysis. In Proceedings of the ACM International Conference on Multimedia (MM’13). 855--858.
[9]
Geoffray Bonnin and Dietmar Jannach. 2014. Automated generation of music playlists: Survey and experiments. ACM Comput. Surv. 47, 2, Article 26 (Nov. 2014), 35 pages.
[10]
Robin Burke. 2002. Hybrid recommender systems: Survey and experiments. User Model. User-Adapt. Interact. 12, 4 (Nov. 2002), 331--370.
[11]
Iván Cantador, Alejandro Bellogín, and Pablo Castells. 2008. A multilayer ontology-based hybrid recommendation model. AI Commun. Special Issue on Rec. Sys. 21, 2--3 (April 2008), 203--210.
[12]
Tommaso Di Noia, Roberto Mirizzi, Vito Claudio Ostuni, and Davide Romito. 2012a. Exploiting the web of data in model-based recommender systems. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys’12). ACM, New York, NY, 253--256.
[13]
Tommaso Di Noia, Roberto Mirizzi, Vito Claudio Ostuni, Davide Romito, and Markus Zanker. 2012b. Linked open data to support content-based recommender systems. In Proceedings of the 8th International Conference on Semantic Systems (I-SEMANTICS’12). ACM, New York, NY, 1--8.
[14]
Ignacio Fernández-Tobías, Iván Cantador, Marius Kaminskas, and Francesco Ricci. 2011. A generic semantic-based framework for cross-domain recommendation. In Proceedings of the 2nd International Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec’11). ACM, New York, NY, 25--32.
[15]
Frederic Font and Sergio Oramas. 2014. Extending tagging ontologies with domain specific knowledge. In Proceedings of the International Semantic Web Conference (ISWC’14). 1--4.
[16]
Frederic Font, Gerard Roma, Perfecto Herrera, and Xavier Serra. 2012. Characterization of the freesound online community. In Proceedings of the 2012 3rd International Workshop on Cognitive Information Processing (CIP’12). 1--6.
[17]
Zeno Gantner, Lucas Drumond, Christoph Freudenthaler, Steffen Rendle, and Lars Schmidt-Thieme. 2010. Learning attribute-to-feature mappings for cold-start recommendations. In Proceedings of the 2010 IEEE International Conference on Data Mining (ICDM’10). IEEE Computer Society, Washington, DC, 176--185.
[18]
Andres Garcia-Silva, Oscar Corcho, Harith Alani, and Asuncion Gomez-Perez. 2012. Review of the state of the art: Discovering and associating semantics to tags in folksonomies. Knowl. Eng. Rev. 27 (3 2012), 57--85. Issue 01.
[19]
Negar Hariri, Bamshad Mobasher, and Robin D. Burke. 2012. Context-aware music recommendation based on latenttopic sequential patterns. In Sixth ACM Conference on Recommender Systems, RecSys’12, Dublin, Ireland, September 9--13, 2012. 131--138.
[20]
Benjamin Heitmann and Conor Hayes. 2010. Using linked data to build open, collaborative recommender systems. In AAAI Spring Symposium: Linked Data Meets Artificial Intelligence.
[21]
Chia-Hua Ho and Chih-Jen Lin. 2012. Large-scale linear support vector regression. J. Mach. Learn. Res. 13 (2012), 3323--3348.
[22]
Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 2008 8th IEEE International Conference on Data Mining (ICDM’08). 263--272.
[23]
Dietmar Jannach, Lukas Lerche, and Iman Kamehkhosh. 2015. Beyond “hitting the hits”: Generating coherent music playlist continuations with the right tracks. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys’15). ACM, New York, NY, 187--194.
[24]
Marius Kaminskas and Francesco Ricci. 2012. Contextual music information retrieval and recommendation: State of the art and challenges. Comput. Sci. Rev. 6, 2--3 (2012), 89--119.
[25]
Houda Khrouf and Raphaël Troncy. 2013. Hybrid event recommendation using linked data and user diversity. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys’13). ACM, New York, NY, 185--192.
[26]
Peter Knees and Markus Schedl. 2013. A survey of music similarity and recommendation from music context data. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP) 10, 1 (2013).
[27]
Sean M. McNee, John Riedl, and Joseph A. Konstan. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In CHI’06 Extended Abstracts on Human Factors in Computing Systems (CHI EA’06). ACM, New York, NY, 1097--1101.
[28]
Stuart E. Middleton, David De Roure, and Nigel R. Shadbolt. 2009. Ontology-based recommender systems. Handb. Ontol. 32, 6 (2009), 779--796.
[29]
George A. Miller. 1995. WordNet: A lexical database for english. Commun. ACM 38, 11 (Nov. 1995), 39--41.
[30]
Bamshad Mobasher, Xin Jin, and Yanzan Zhou. 2004. Semantically enhanced collaborative filtering on the web. In Web Mining: From Web to Semantic Web, Bettina Berendt, Andreas Hotho, Dunja Mladenic, Maarten Someren, Myra Spiliopoulou, and Gerd Stumme (Eds.). Lecture Notes in Computer Science, Vol. 3209. Springer, Berlin, 57--76.
[31]
Andrea Moro, Alessandro Raganato, and Roberto Navigli. 2014. Entity linking meets word sense disambiguation : A unified approach. Trans. Assoc. Comput. Ling. (TACL) (2014).
[32]
Cataldo Musto, Giovanni Semeraro, Pasquale Lops, and Marco de Gemmis. 2014. Combining distributional semantics and entity linking for context-aware content-based recommendation. In Proceedings of the 22nd International Conference on User Modeling, Adaptation, and Personalization (UMAP’14). 381--392.
[33]
Xia Ning and George Karypis. 2012. Sparse linear methods with side information for top-n recommendations. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys’12). 155--162.
[34]
Sergio Oramas, Luis Espinosa-anke, Mohamed Sordo, Horacio Saggion, and Xavier Serra. 2016. ELMD: An automatically generated entity linking gold standard dataset in the music domain. In Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016.
[35]
Vito Claudio Ostuni, Tommaso Di Noia, Eugenio Di Sciascio, and Roberto Mirizzi. 2013. Top-n recommendations from implicit feedback leveraging linked open data. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys’13). ACM, New York, NY, 85--92.
[36]
Vito Claudio Ostuni, Tommaso Di Noia, Roberto Mirizzi, and Eugenio Di Sciascio. 2014. A linked data recommender system using a neighborhood-based graph kernel. In Proceedings of the 15th International Conference on Electronic Commerce and Web Technologies (Lecture Notes in Business Information Processing). Springer-Verlag.
[37]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI’09). AUAI Press, Arlington, VA, 452--461.
[38]
Matthew Rowe. 2014. SemanticSVD++: Incorporating semantic taste evolution for predicting ratings. In 2014 IEEE/WIC/ACM International Conferences on Web Intelligence, WI 2014.
[39]
Giovanni Semeraro, Pasquale Lops, Pierpaolo Basile, and Marco de Gemmis. 2009. Knowledge infusion into content-based recommender systems. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). ACM, New York, NY, 301--304.
[40]
John Shawe-Taylor and Nello Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press, New York, NY.
[41]
Wei Shen, Jianyong Wang, and Jiawei Han. 2015. Entity linking with a knowledge base: Issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27, 2 (Feb 2015), 443--460.
[42]
Mohamed Sordo, Sergio Oramas, and Luis Espinosa-Anke. 2015. Extracting relations from unstructured text sources for music recommendation. In Proceedings of the 20th International Conference on Applications of Natural Language to Information Systems, NLDB 2015. Springer International Publishing, Cham, 369--382.
[43]
Harald Steck. 2013. Evaluation of recommendations: Rating-prediction and ranking. In RecSys. 213--220.
[44]
Gabriel Vigliensoni and Ichiro Fujinaga. 2014. Identifying time zones in a large dataset of music listening logs. In Proceedings of the 1st International Workshop on Social Media Retrieval and Analysis (SoMeRA’14). ACM, New York, NY, 27--32.
[45]
Cai-Nicolas Ziegler, Georg Lausen, and Lars Schmidt-Thieme. 2004. Taxonomy-driven computation of product recommendations. In Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM’04). ACM, New York, NY, 406--415.

Cited By

View all
  • (2025)Aggregating Contextual Information for Multi-Criteria Online Music RecommendationsIEEE Access10.1109/ACCESS.2025.352751213(8790-8805)Online publication date: 2025
  • (2025)Diversified recommendation with weighted hypergraph embedding: Case study in musicNeurocomputing10.1016/j.neucom.2024.128905616(128905)Online publication date: Feb-2025
  • (2024)Surveying More Than Two Decades of Music Information Retrieval Research on PlaylistsACM Transactions on Intelligent Systems and Technology10.1145/368839815:6(1-68)Online publication date: 12-Aug-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 8, Issue 2
Survey Paper, Special Issue: Intelligent Music Systems and Applications and Regular Papers
March 2017
407 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3004291
  • Editor:
  • Yu Zheng
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2016
Accepted: 01 April 2016
Revised: 01 February 2016
Received: 01 November 2015
Published in TIST Volume 8, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Knowledge graphs
  2. diversity
  3. entity linking
  4. music
  5. novelty
  6. recommender systems

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)83
  • Downloads (Last 6 weeks)5
Reflects downloads up to 03 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Aggregating Contextual Information for Multi-Criteria Online Music RecommendationsIEEE Access10.1109/ACCESS.2025.352751213(8790-8805)Online publication date: 2025
  • (2025)Diversified recommendation with weighted hypergraph embedding: Case study in musicNeurocomputing10.1016/j.neucom.2024.128905616(128905)Online publication date: Feb-2025
  • (2024)Surveying More Than Two Decades of Music Information Retrieval Research on PlaylistsACM Transactions on Intelligent Systems and Technology10.1145/368839815:6(1-68)Online publication date: 12-Aug-2024
  • (2024)SceneKG: A Geo‐Scene Based Spatiotemporal Knowledge Representation Framework Considering Geo‐ProcessesTransactions in GIS10.1111/tgis.1327029:1Online publication date: 17-Nov-2024
  • (2024)Genre Classification Empowered by Knowledge-Embedded Music RepresentationIEEE/ACM Transactions on Audio, Speech, and Language Processing10.1109/TASLP.2024.340211532(2764-2776)Online publication date: 2024
  • (2024)Recommending Third-Party Libraries and Frameworks Using Topic Modeling in Software Projects2024 4th International Conference on Advanced Research in Computing (ICARC)10.1109/ICARC61713.2024.10499759(37-42)Online publication date: 21-Feb-2024
  • (2024)A survey on cybersecurity knowledge graph constructionComputers & Security10.1016/j.cose.2023.103524136(103524)Online publication date: Jan-2024
  • (2024)A qualitative analysis of knowledge graphs in recommendation scenarios through semantics-aware autoencodersJournal of Intelligent Information Systems10.1007/s10844-023-00830-z62:3(787-807)Online publication date: 1-Jun-2024
  • (2024)Lazy learning and sparsity handling in recommendation systemsKnowledge and Information Systems10.1007/s10115-024-02218-z66:12(7775-7797)Online publication date: 1-Dec-2024
  • (2024)Explainable Recommender Systems with Knowledge Graphs and Language ModelsAdvances in Information Retrieval10.1007/978-3-031-56069-9_46(352-357)Online publication date: 23-Mar-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media