Report on the 3rd Workshop on the Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES 2023) at RecSys 2023
Article No.: 18, Pages 1 - 4
Abstract
Evaluation is a central step when developing, optimizing, and deploying recommender systems. The PERSPECTIVES 2023 workshop, held as part of the 17th ACM Conference on Recommender Systems (RecSys 2023), served as a forum where researchers from both academia and industry critically reflected on the evaluation of recommender systems. The goal of the PERSPECTIVES workshop series is to capture the current state of evaluation from different perspectives and discuss the different targets that recommender systems evaluation should strive for. In the third edition of the workshop, we discussed problems and lessons learned, and aimed to move the discourse forward within the community.
Date: 19 September 2023.
Website: https://perspectives-ws.github.io/2023/.
References
[1]
Ghazaleh Haratinezhad Torbati, Anna Tigunova, and Gerhard Weikum. Unveiling challenging cases in text-based recommender systems. In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/paper5.pdf.
[2]
Olivier Jeunen. A common misassumption in online experiments with machine learning models. In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/abstract1.pdf.
[3]
Marta Moscati, Yashar Deldjoo, Giulio Davide Carparelli, and Markus Schedl. Multiobjective hyperparameter optimization of recommender systems. In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/paper3.pdf.
[4]
Alan Said, Eva Zangerle, and Christine Bauer. Third workshop: perspectives on the evaluation of recommender systems (PERSPECTIVES 2023). In 17th ACM Conference on Recommender Systems, RecSys '23, pages 1221--1222, New York, NY, USA, 2023a. ACM.
[5]
Alan Said, Eva Zangerle, and Christine Bauer, editors. Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2023, volume 3476 of CEUR Workshop Proceedings, Aachen, Germany, 2023b. CEUR-WS.org. URL https://ceur-ws.org/Vol-3476/.
[6]
Andra-Georgiana Sav, Andrew M. Demetriou, and Cynthia C. S. Liem. Annotation practices in societally impactful machine learning applications: What are popular recommender systems models actually trained on? In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/paper1.pdf.
[7]
Mete Sertkan, Sophia Althammer, Sebastian Hofstätter, Peter Knees, and Julia Neidhardt. Exploring effect-size-based meta-analysis for multi-dataset evaluation. In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/paper2.pdf.
[8]
Lukas Wegmeth, Tobias Vente, Lennart Purucker, and Joeran Beel. The effect of random seeds for data splitting on recommendation accuracy. In Said et al. [2023b]. URL https://ceur-ws.org/Vol-3476/paper4.pdf.
[9]
Eva Zangerle, Christine Bauer, and Alan Said. Perspectives on the evaluation of recommender systems (PERSPECTIVES). In 15th ACM Conference on Recommender Systems, RecSys '21, pages 794--795, New York, NY, USA, 2021. ACM.
[10]
Eva Zangerle, Christine Bauer, and Alan Said. Report on the 1st workshop on the perspectives on the evaluation of recommender systems (PERSPECTIVES 2021) at recsys 2021. ACM SIGIR Forum, 55(2), mar 2022a.
[11]
Eva Zangerle, Christine Bauer, and Alan Said. Second workshop: Perspectives on the evaluation of recommender systems (PERSPECTIVES 2022). In 16th ACM Conference on Recommender Systems, RecSys '22, pages 652--653, New York, NY, USA, 2022b. ACM.
[12]
Eva Zangerle, Christine Bauer, and Alan Said. Report on the 2nd workshop on the perspectives on the evaluation of recommender systems (PERSPECTIVES 2022) at recsys 2022. ACM SIGIR Forum, 56(2), 2023.
Index Terms
- Report on the 3rd Workshop on the Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES 2023) at RecSys 2023
Index terms have been assigned to the content through auto-classification.
Recommendations
Third Workshop: Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES 2023)
RecSys '23: Proceedings of the 17th ACM Conference on Recommender SystemsEvaluation is important when developing and deploying recommender systems. The PERSPECTIVES workshop sheds light on the different, potentially diverging or contradictory perspectives on the evaluation of recommender systems. Building on the discussions ...
Report on the 10th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems (IntRS 2023) at ACM RecSys 2023
The 10th edition of the Joint Workshop on Interfaces and Human Decision Making for Recommender Systems was held as part of the 17th ACM Conference on Recommender Systems (RecSys), the premier international forum for the presentation of new research ...
Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES)
RecSys '21: Proceedings of the 15th ACM Conference on Recommender SystemsEvaluation is a cornerstone in the process of developing and deploying recommender systems. The PERSPECTIVES workshop brought together academia and industry to critically reflect on the evaluation of recommender systems. Particularly, the workshop ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 January 2024
Published in SIGIR Volume 57, Issue 2
Check for updates
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 24Total Downloads
- Downloads (Last 12 months)24
- Downloads (Last 6 weeks)3
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in