extended-abstract

Joint Workshop on Interfaces and Human Decision Making for Recommender Systems (IntRS’21)

Authors:

Peter Brusilovsky,

Marco de Gemmis,

Alexander Felfernig,

Giovanni Semeraro,

Martijn C. WillemsenAuthors Info & Claims

RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems

Pages 783 - 786

https://doi.org/10.1145/3460231.3470927

Published: 13 September 2021 Publication History

Abstract

Recommender systems were originally developed as interactive intelligent systems that can proactively guide users to items that match their preferences. Despite its origin on the crossroads of HCI and AI, the majority of research on recommender systems gradually focused on objective accuracy criteria paying less and less attention to how users interact with the system as well as the efficacy of interface designs from users’ perspectives. This trend is reversing with the increased volume of research that looks beyond algorithms, into users’ interactions, decision making processes, and overall experience. The series of workshops on Interfaces and Human Decision Making for Recommender Systems focuses on the ”human side” of recommender systems. The goal of the research stream featured at the workshop is to improve users’ overall experience with recommender systems by integrating different theories of human decision making into the construction of recommender systems and exploring better interfaces for recommender systems. In this summary, we introduce the Joint Workshop on Interfaces and Human Decision Making for Recommender Systems at RecSys’21, review its history, and discuss most important topics considered at the workshop.

References

[1]

Gediminas Adomavicius, Jesse C Bockstedt, Curley Shawn, and Jingjing Zhang. 2014. De-biasing user preference ratings in recommender systems. In Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR, 2–9.

[2]

Dirk Bollen, Mark Graus, and Martijn C Willemsen. 2012. Remembering the stars? Effect of time on preference retrieval from memory. In Proceedings of the sixth ACM conference on Recommender systems. ACM, Dublin, Ireland, 217–220.

Digital Library

[3]

Dirk Bollen, Bart P Knijnenburg, Martijn C Willemsen, and Mark Graus. 2010. Understanding choice overload in recommender systems. In Proceedings of the fourth ACM conference on Recommender systems. 63–70.

Digital Library

[4]

Li Chen, Marco De Gemmis, Alexander Felfernig, Pasquale Lops, Francesco Ricci, and Giovanni Semeraro. 2013. Human decision making and recommender systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 3, 3(2013), 17.

Digital Library

[5]

Tim Donkers, Benedikt Loepp, and Jürgen Ziegler. 2016. Tag-Enhanced Collaborative Filtering for Increasing Transparency and Interactive Control. In 24th Conference on User Modeling, Adaptation and Personalization (UMAP 2016). ACM Press, 169–173.

[6]

Michael D Ekstrand, F Maxwell Harper, Martijn C Willemsen, and Joseph A Konstan. 2014. User perception of differences in recommender algorithms. In Proceedings of the 8th ACM Conference on Recommender systems. 161–168.

Digital Library

[7]

A. Felfernig, G Friedrich, B. Gula, M. Hitz, T Kruggel, G. Leitner, R. Melcher, D. Riepan, S. Strauss, E. Teppan, and O. Vitouch. 2007. Persuasive recommendation: Serial position effects in knowledge-based recommender systems. In Persuasive Technology(LNCS, Vol. 4744). Springer, 283–294.

[8]

Jan Feuerbach, Benedikt Loepp, Catalin-Mihai Barbu, and Jürgen Ziegler. 2017. Enhancing an Interactive Recommendation System with Review-based Information Filtering. In 4th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR Workshop Proceedings, 2–9.

[9]

Peter Gaspar, Michal Kompan, Jakub Simko, and Maria Bielikova. 2018. Analysis of User Behavior in Interfaces with Recommended Items: An Eye-tracking Study. In IntRS 2018: 5th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR, 32–36.

[10]

Ishan Ghanmode and Nava Tintarev. 2018. MovieTweeters: An Interactive Interface to Improve Recommendation Novelty. In 5th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR, 24–31.

[11]

Gerd Gigerenzer and Wolfgang Gaissmaier. 2011. Heuristic decision making. Annual review of psychology 62 (2011), 451–482.

[12]

Mark P Graus and Martijn C Willemsen. 2015. Improving the user experience during cold start through choice-based preference elicitation. In Proceedings of the 9th ACM Conference on Recommender Systems. 273–276.

Digital Library

[13]

Mark P Graus and Martijn C Willemsen. 2016. Can trailers help to alleviate popularity bias in choice-based preference elicitation?. In IntRS@ RecSys. 22–27.

[14]

Marc Güell, Maria Salamó, David Contreras, and Ludovico Boratto. 2020. Integrating a cognitive assistant within a critique-based recommender system. Cognitive Systems Research 64 (2020), 1–14.

[15]

Chen He, Denis Parra, and Katrien Verbert. 2016. Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities. Expert Systems with Applications 56, C (2016), 59–27.

[16]

Katja Herrmanny, Simone Löppenberg, and Michael Schwarz. 2019. Investigating Mechanisms for User Integration in the Activity Goal Recommendation Process by Interface Design. In 6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR Workshop Proceedings, 46–54.

[17]

Rong Hu and Pearl Pu. 2011. Enhancing recommendation diversity with organization interfaces. In Proceedings of the 16th international conference on Intelligent user interfaces. 347–350.

Digital Library

[18]

Anthony Jameson, Martijn C Willemsen, Alexander Felfernig, Marco de Gemmis, Pasquale Lops, Giovanni Semeraro, and Li Chen. 2015. Human decision making and recommender systems. In Recommender Systems Handbook. Springer, 611–648.

[19]

Yucheng Jin, Bruno Cardoso, and Katrien Verbert. 2017. How do different levels of user control affect cognitive load and acceptance of recommendations?. In 4th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, Vol. 1884. CEUR Workshop Proceedings, 35–42.

[20]

Michael Jugovac and Dietmar Jannach. 2017. Interacting with recommenders—overview and research directions. ACM Transactions on Interactive Intelligent Systems (TiiS) 7, 3(2017), 10.

[21]

Daniel Kahneman. 2011. Thinking, fast and slow. Farrar, Straus and Giroux, New York.

[22]

Bart P. Knijnenburg, Svetlin Bostandjiev, John O’Donovan, and Alfred Kobsa. 2012. Inspectability and Control in Social Recommenders. In 6th ACM Conference on Recommender System. 43–50.

[23]

Bart P Knijnenburg, Niels JM Reijmer, and Martijn C Willemsen. 2011. Each to his own: how different users call for different interaction methods in recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. 141–148.

Digital Library

[24]

Bart P Knijnenburg and Martijn C Willemsen. 2015. Evaluating recommender systems with user experiments. In Recommender Systems Handbook. Springer, 309–352.

[25]

Dominik Kowald, Subhash Chandra Pujari, and Elisabeth Lex. 2017. Temporal Effects on Hashtag Reuse in Twitter: A Cognitive-Inspired Hashtag Recommendation Approach. In Proceedings of the 26th International Conference on World Wide Web (Perth, Australia). 1401–1410.

Digital Library

[26]

Vikas Kumar, Sabirat Rubya, Joseph A Konstan, and Loren Terveen. 2018. Risk” attention” or” adventure”: A qualitative study of novelty and familiarity in music listening. In 5th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, Vol. 2225. 15–23.

[27]

Elisabeth Lex, Dominik Kowald, Paul Seitlinger, Thi Ngoc Trang Tran, Alexander Felfernig, Markus Schedl, 2021. Psychology-informed Recommender Systems. Foundations and Trends® in Information Retrieval 15, 2(2021), 134–242.

[28]

George Loewenstein and Jennifer S Lerner. 2003. The role of affect in decision making. Handbook of affective science 619, 642 (2003), 3.

[29]

Feng Lu and Nava Tintarev. 2018. A Diversity Adjusting Strategy with Personality for Music Recommendation. In 5th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. 7–14.

[30]

Judith Masthoff. 2004. Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers. User Modeling and User-Adapted Interaction 14, 1 (2004), 37–85.

Digital Library

[31]

Martijn Millecamp, Sidra Naveed, Katrien Verbert, and Jürgen Ziegler. 2019. To explain or not to explain: The effects of personal characteristics when explaining feature-based recommendations in different domains. In 6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, Vol. 2450. CEUR Workshop Proceedings, 10–18.

[32]

Yuri Nakao, Takuya Ohwa, and Kotaro Ohori. 2019. Generation of Hints to Overcome Difficulty in Operating Interactive Recommender Systems. In 6th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems. CEUR Workshop Proceedings, 36–45.

[33]

Sidra Naveed and Jürgen Ziegler. 2020. Featuristic: An interactive hybrid system for generating explainable recommendations–beyond system accuracy. system 18(2020), 33.

[34]

John O’Donovan, Barry Smyth, Brynjar Gretarsson, Svetlin Bostandjiev, and Tobias Hšllerer. 2008. PeerChooser: visual interactive recommendation. In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems. ACM, 1085–1088.

Digital Library

[35]

Denis Parra-Santander, Peter Brusilovsky, and Christoph Trattner. 2014. See What You Want to See: Visual User-Driven Approach for Hybrid Recommendation. In Proceedings of the 19th International Conference on Intelligent User Interfaces. ACM, 235–240.

Digital Library

[36]

Pearl Pu and Li Chen. 2006. Trust building with explanation interfaces. In Proceedings of the 11th international conference on Intelligent user interfaces. 93–100.

Digital Library

[37]

Pearl Pu, Li Chen, and Rong Hu. 2011. A user-centric evaluation framework for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. 157–164.

Digital Library

[38]

Paul Resnick and Hal R Varian. 1997. Recommender systems. Commun. ACM 40, 3 (1997), 56–58.

Digital Library

[39]

Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to recommender systems handbook. In Recommender systems handbook. Springer, 1–35.

[40]

Christoph Schneider, Markus Weinmann, and Jan Vom Brocke. 2018. Digital nudging: guiding online user choices through interface design. Commun. ACM 61, 7 (2018), 67–73.

Digital Library

[41]

Paul Seitlinger, Dominik Kowald, Simone Kopeinik, Ilire Hasani-Mavriqi, Tobias Ley, and Elisabeth Lex. 2015. Attention please! a hybrid resource recommender mimicking attention-interpretation dynamics. In Proceedings of the 24th International Conference on World Wide Web. ACM, 339–345.

Digital Library

[42]

Keith E Stanovich and Richard F West. 1998. Individual differences in rational thought.Journal of experimental psychology: general 127, 2 (1998), 161.

[43]

M. Stettinger, A. Felfernig, G. Leitner, and S. Reiterer. 2015. Counteracting Anchoring Effects in Group Decision Making. In The 23rd Conference on User Modeling, Adaptation and Personalization UMAP 2015(Lecture Notes in Computer Science, Vol. 9146). Springer, Trinity College, Dublin, Ireland, 118–130.

[44]

M. Stettinger, A. Felfernig, G. Leitner, S. Reiterer, and M. Jeran. 2015. Counteracting Serial Position Effects in the Choicla Group Decision Support Environment. In 20th ACM Conference on Intelligent User Interfaces (IUI2015). Atlanta, Georgia, USA, 148–157.

[45]

Khushboo Thaker, Yun Huang, Peter Brusilovsky, and He Daqing. 2018. Dynamic knowledge modeling with heterogeneous activities for adaptive textbooks. In The 11th International Conference on Educational Data Mining. 592–595.

[46]

Richard Thaler. 1980. Toward a positive theory of consumer choice. Journal of economic behavior & organization 1, 1(1980), 39–60.

[47]

Nava Tintarev and Judith Masthoff. 2015. Explaining recommendations: Design and evaluation. In Recommender systems handbook. Springer, 353–382.

[48]

Marko Tkalcic, Andrej Kosir, and Jurij Tasic. 2011. Affective recommender systems: the role of emotions in recommender systems. In Proceedings of the RecSys 2011 Workshop on Human Decision Making in Recommender Systems and User‐Centric Evaluation of Recommender Systems and Their Interfaces. Citeseer, 9–13.

[49]

Thi Ngoc Trang Tran, Alexander Felfernig, and Nava Tintarev. 2021. Humanized Recommender Systems: State-of-the-art and Research Issues. ACM Transactions on Interactive Intelligent Systems (TiiS) 11, 9(2021), 1–41. Issue 2.

Digital Library

[50]

Chun Tsai and Peter Brusilovsky. 2017. Providing Control and Transparency in a Social Recommender System for Academic Conferences. In the 25th Conference on User Modeling, Adaptation and Personalization. ACM, 313–317.

Digital Library

[51]

Chun-Hua Tsai and Peter Brusilovsky. 2017. Enhancing recommendation diversity through a dual recommendation interface. In 4th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, Vol. 1884. CEUR Workshop Proceedings, 10–15.

[52]

Amos Tversky and Daniel Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. science 185, 4157 (1974), 1124–1131.

[53]

Kyung-Hyan Yoo, Ulrike Gretzel, and Markus Zanker. 2012. Persuasive recommender systems: conceptual background and implications. Springer Science & Business Media.

[54]

Yongfeng Zhang, Xu Chen, 2020. Explainable Recommendation: A Survey and New Perspectives. Foundations and Trends® in Information Retrieval 14, 1(2020), 1–101.

Cited By

Schedl MGómez ELex EChua TLauw HSi LTerzi ETsaparas P(2023)Trustworthy Algorithmic Ranking SystemsProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3572723(1240-1243)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3572723
Lex ESchedl MElsweiler DKruschwitz ULudwig B(2022)Psychology-informed Recommender Systems: A Human-Centric Perspective on Recommender SystemsProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505841(367-368)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505841
Schedl MGómez ELex EAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Retrieval and Recommendation Systems at the Crossroads of Artificial Intelligence, Ethics, and RegulationProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532683(3420-3424)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532683

Joint Workshop on Interfaces and Human Decision Making for Recommender Systems (IntRS’21)
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals

Recommendations

Joint Workshop on Interfaces and Human Decision Making for Recommender Systems (IntRS’22)
RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems

The constant increase in the amount of data and information available on the Web has made the development of systems that can support users in making relevant decisions increasingly important. Recommender systems (RSs) have emerged as tools to address ...
Interfaces and Human Decision Making for Recommender Systems
RecSys '20: Proceedings of the 14th ACM Conference on Recommender Systems

As an interactive intelligent system, recommender systems are developed to give recommendations that match users’ preferences. Since the emergence of recommender systems, a large majority of research focuses on objective accuracy criteria and less ...
Human Decision Making and Recommender Systems

Recommender systems have already proved to be valuable for coping with the information overload problem in several application domains. They provide people with suggestions for items which are likely to be of interest for them; hence, a primary function ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems

September 2021

883 pages

ISBN:9781450384582

DOI:10.1145/3460231

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2021

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

RecSys '21

Sponsor:

RecSys '21: Fifteenth ACM Conference on Recommender Systems

September 27 - October 1, 2021

Amsterdam, Netherlands

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
179
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schedl MGómez ELex EChua TLauw HSi LTerzi ETsaparas P(2023)Trustworthy Algorithmic Ranking SystemsProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3572723(1240-1243)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3572723
Lex ESchedl MElsweiler DKruschwitz ULudwig B(2022)Psychology-informed Recommender Systems: A Human-Centric Perspective on Recommender SystemsProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505841(367-368)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505841
Schedl MGómez ELex EAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Retrieval and Recommendation Systems at the Crossroads of Artificial Intelligence, Ethics, and RegulationProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532683(3420-3424)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532683

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten