Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3631700.3664901acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article
Open access

Navigating Serendipity - An Experimental User Study On The Interplay of Trust and Serendipity In Recommender Systems

Published: 28 June 2024 Publication History

Abstract

Recommender systems play a crucial role in our daily lives, constantly evolving to meet the diverse needs of users. As the pursuit of improved user experiences continues, metrics such as serendipity have emerged within the realm of beyond-accuracy paradigms. However, integrating serendipitous recommendations presents complex challenges, necessitating a delicate balance between novelty, relevance, and user engagement. In this interdisciplinary experimental user study, we address these challenges within the context of a book recommender system. By investigating the impact of interface design changes on user trust, a key determinant of satisfaction with serendipitous recommendations, we measured trust levels for both individual recommended items and the recommender system as a whole. Our findings indicate that while interface enhancements did not yield significant increases in trust, they did notably elevate serendipity ratings for previously unknown books. These results highlight the intricate interplay between technical and psychological factors in the design of recommender systems, emphasizing the importance of human-centered approaches in the creation of more responsible AI applications. This research contributes to ongoing discussions surrounding user-centric recommendation systems and aligns with broader themes of digital humanism and responsible AI.

References

[1]
Ahmad Hassan Afridi. 2018. User control and serendipitous recommendations in learning environments. Procedia computer science 130 (2018), 214–221.
[2]
Ahmad Hassan Afridi. 2019. Transparency for beyond-accuracy experiences: a novel user interface for recommender systems. Procedia computer science 151 (2019), 335–344.
[3]
Müslüm Atas, Alexander Felfernig, Seda Polat-Erdeniz, Andrei Popescu, Thi Ngoc Trang Tran, and Mathias Uta. 2021. Towards psychology-aware preference construction in recommender systems: Overview and research issues. Journal of Intelligent Information Systems 57 (2021), 467–489.
[4]
Forschungsdatenzentrum Bildung. 2023. Konstrukt. https://www.fdz-bildung.de/konstrukt.php?construct%5C_id=565 Accessed: May 12, 2023.
[5]
Lennart Björneborn. 2017. Three key affordances for serendipity: Toward a framework connecting environmental and personal factors in serendipitous encounters. Journal of documentation 73, 5 (2017), 1053–1081.
[6]
Tomislav Duricic, Dominik Kowald, Emanuel Lacic, and Elisabeth Lex. 2023. Beyond-accuracy: a review on diversity, serendipity, and fairness in recommender systems based on graph neural networks. Frontiers in Big Data 6 (2023), 1251072.
[7]
Miguel Pina e Cunha, Arménio Rego, Stewart Clegg, and Greg Lindsay. 2015. The dialectics of serendipity. European Management Journal 33, 1 (2015), 9–18.
[8]
Thomas Gilovich, Dale Griffin, and Daniel Kahneman. 2002. Heuristics and biases: The psychology of intuitive judgment. Cambridge university press.
[9]
Jason L Harman, John O’Donovan, Tarek Abdelzaher, and Cleotilde Gonzalez. 2014. Dynamics of human trust in recommender systems. In Proceedings of the 8th ACM Conference on Recommender systems. 305–308.
[10]
Dietmar Jannach. 2023. Evaluating conversational recommender systems: A landscape of research. Artificial Intelligence Review 56, 3 (2023), 2365–2400.
[11]
Sirkka L Jarvenpaa, Noam Tractinsky, and Michael Vitale. 2000. Consumer trust in an Internet store. Information technology and management 1 (2000), 45–71.
[12]
Peter Knees, Julia Neidhardt, and Irina Nalis. 2024. Recommender Systems: Techniques, Effects, and Measures Toward Pluralism and Fairness. Hannes Werthner· Carlo Ghezzi· Jeff Kramer· Julian Nida-Rümelin· Bashar Nuseibeh· Erich Prem· (2024), 417.
[13]
Bart P Knijnenburg, Martijn C Willemsen, Zeno Gantner, Hakan Soncu, and Chris Newell. 2012. Explaining the user experience of recommender systems. User modeling and user-adapted interaction 22 (2012), 441–504.
[14]
Mengqi Liao, S Shyam Sundar, and Joseph B. Walther. 2022. User trust in recommendation systems: A comparison of content-based, collaborative and demographic filtering. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–14.
[15]
Valentina Maccatrozzo, Manon Terstall, Lora Aroyo, and Guus Schreiber. 2017. SIRUP: Serendipity in recommendations via user perceptions. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. 35–44.
[16]
Maria Madsen and Shirley Gregor. 2000. Measuring human-computer trust. In 11th australasian conference on information systems, Vol. 53. Citeseer, 6–8.
[17]
Masoud Mansoury, Himan Abdollahpouri, Mykola Pechenizkiy, Bamshad Mobasher, and Robin Burke. 2020. Feedback loop and bias amplification in recommender systems. In Proceedings of the 29th ACM international conference on information & knowledge management. 2145–2148.
[18]
Tien T Nguyen, F Maxwell Harper, Loren Terveen, and Joseph A Konstan. 2018. User personality and user satisfaction with recommender systems. Information Systems Frontiers 20 (2018), 1173–1189.
[19]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2021. Recommender systems: Techniques, applications, and challenges. Recommender Systems Handbook (2021), 1–35.
[20]
Bracha Shapira, Lior Rokach, and Francessco Ricci. 2022. Recommender systems handbook. (2022).
[21]
Donghee Shin. 2020. How do users interact with algorithm recommender systems? The interaction of users, algorithms, and performance. Computers in human behavior 109 (2020), 106344.
[22]
Annelien Smets. 2023. Designing for serendipity: a means or an end?Journal of Documentation 79, 3 (2023), 589–607.
[23]
Annelien Smets, Lien Michiels, Toine Bogers, and Lennart Björneborn. 2022. Serendipity in recommender systems beyond the algorithm: A feature repository and experimental design. In CEUR Workshop Proceedings, Vol. 3222. CEUR Workshop Proceedings, 46–66.
[24]
Jonathan Stray, Alon Halevy, Parisa Assar, Dylan Hadfield-Menell, Craig Boutilier, Amar Ashar, Lex Beattie, Michael Ekstrand, Claire Leibowicz, Connie Moon Sehat, 2022. Building human values into recommender systems: An interdisciplinary synthesis. arXiv preprint arXiv:2207.10192 (2022).
[25]
Thi Ngoc Trang Tran, Alexander Felfernig, and Nava Tintarev. 2021. Humanized recommender systems: State-of-the-art and research issues. ACM Transactions on Interactive Intelligent Systems (TiiS) 11, 2 (2021), 1–41.
[26]
Amos Tversky and Daniel Kahneman. 2015. Causal schemas in judgments under uncertainty. In Progress in social psychology. Psychology Press, 49–72.
[27]
Nasim Vatani, Amir Masoud Rahmani, Hamid Haj Seyyed Javadi, and Somayyeh Jafarali Jassbi. 2024. Social networks data analytical approaches for trust-based recommender systems: A systematic literature review. International Journal of Communication Systems (2024).
[28]
Reza Jafari Ziarani and Reza Ravanmehr. 2021. Serendipity in recommender systems: a systematic literature review. Journal of Computer Science and Technology 36 (2021), 375–396.

Cited By

View all
  • (2024)Transforming recommender systemsProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/982(8559-8564)Online publication date: 3-Aug-2024
  • (2024)HAAPIE 2024: 9th International Workshop on Human Aspects in Adaptive and Personalized Interactive EnvironmentsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3658526(362-364)Online publication date: 27-Jun-2024

Index Terms

  1. Navigating Serendipity - An Experimental User Study On The Interplay of Trust and Serendipity In Recommender Systems

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UMAP Adjunct '24: Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization
    June 2024
    662 pages
    ISBN:9798400704666
    DOI:10.1145/3631700
    This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 June 2024

    Check for updates

    Author Tags

    1. Adaptation
    2. Personalization
    3. Recommender Systems
    4. Serendipity
    5. Trust

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    UMAP '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 162 of 633 submissions, 26%

    Upcoming Conference

    UMAP '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)343
    • Downloads (Last 6 weeks)69
    Reflects downloads up to 29 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Transforming recommender systemsProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/982(8559-8564)Online publication date: 3-Aug-2024
    • (2024)HAAPIE 2024: 9th International Workshop on Human Aspects in Adaptive and Personalized Interactive EnvironmentsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3658526(362-364)Online publication date: 27-Jun-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media