Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

Investigating Characteristics of Media Recommendation Solicitation in r/ifyoulikeblank

Published: 08 November 2024 Publication History

Abstract

Despite the existence of search-based recommender systems like Google, Netflix, and Spotify, online users sometimes may turn to crowdsourced recommendations in places like the r/ifyoulikeblank subreddit. In this exploratory study, we probe why users go to r/ifyoulikeblank, how they look for recommendation, and how the subreddit users respond to recommendation requests. To answer, we collected sample posts from r/ifyoulikeblank and analyzed them using a qualitative approach. Our analysis reveals that users come to this subreddit for various reasons, such as exhausting popular search systems, not knowing what or how to search for an item, and thinking crowd have better knowledge than search systems. Examining users query and their description, we found novel information users provide during recommendation seeking using r/ifyoulikeblank. For example, sometimes they ask for artifacts recommendation based on the tools used to create them. Or, sometimes indicating a recommendation seeker's time constraints can help better suit recommendations to their needs. Finally, recommendation responses and interactions revealed patterns of how requesters and responders refine queries and recommendations. Our work informs future intelligent recommender systems design.

References

[1]
Himan Abdollahpouri, Masoud Mansoury, Robin Burke, Bamshad Mobasher, and Edward Malthouse. 2021. User-centered evaluation of popularity bias in recommender systems. UMAP 2021 - Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization (2021), 119--129. https://doi.org/10.1145/3450613.3456821 arxiv: 2103.06364
[2]
Ivana Andjelkovic, Denis Parra, and John O'Donovan. 2019. Moodplay: Interactive music recommendation based on Artists' mood similarity. International Journal of Human Computer Studies, Vol. 121, May 2017 (2019), 142--159. https://doi.org/10.1016/j.ijhcs.2018.04.004
[3]
Maryam Aziz, Jesse Anderton, Kevin Jamieson, Alice Wang, Hugues Bouchard, and Javed Aslam. 2022. Identifying New Podcasts with High General Appeal Using a Pure Exploration Infinitely-Armed Bandit Strategy. RecSys 2022 - Proceedings of the 16th ACM Conference on Recommender Systems (2022), 134--144. https://doi.org/10.1145/3523227.3546766
[4]
Md Momen Bhuiyan, Carlos Augusto Bautista Isaza, Tanushree Mitra, and Sang Won Lee. 2022. OtherTube: Facilitating Content Discovery and Reflection by Exchanging YouTube Recommendations with Strangers. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1--17.
[5]
Youmna Borghol, Sebastien Ardon, Niklas Carlsson, Derek Eager, and Anirban Mahanti. 2012. The untold story of the clones: Content-agnostic factors that impact YouTube video popularity. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2012), 1186--1194. https://doi.org/10.1145/2339530.2339717 arxiv: 1311.6526
[6]
Dimitrios Bountouridis, Jaron Harambam, Mykola Makhortykh, Mónica Marrero, Nava Tintarev, and Claudia Hauff. 2019. Siren: A simulation framework for understanding the effects of recommender systems in online news environments. FAT* 2019 - Proceedings of the 2019 Conference on Fairness, Accountability, and Transparency (2019), 150--159. https://doi.org/10.1145/3287560.3287583
[7]
Wanling Cai and Li Chen. 2019. Towards a taxonomy of user feedback intents for conversational recommendations. CEUR Workshop Proceedings, Vol. 2431, April 2012 (2019), 51--55.
[8]
Wanling Cai and Li Chen. 2020. Predicting User Intents and Satisfaction with Dialogue-based Conversational Recommendations. UMAP 2020 - Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization (2020), 33--42. https://doi.org/10.1145/3340631.3394856
[9]
Jose Camacho-Collados, Kiamehr Rezaee, Talayeh Riahi, Asahi Ushio, Daniel Loureiro, Dimosthenis Antypas, Joanne Boisson, Luis Espinosa-Anke, Fangyu Liu, Eugenio Martínez-Cámara, et al. 2022. TweetNLP: Cutting-Edge Natural Language Processing for Social Media. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics, Abu Dhabi, U.A.E.
[10]
Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He?. 2022. Bias and Debias in Recommender System: A Survey and Future Directions. ACM Transactions on Information Systems, Vol. 41, 3 (2022). https://doi.org/10.1145/3564284 arxiv: 2010.03240
[11]
Minmin Chen, Yuyan Wang, Can Xu, Ya Le, Mohit Sharma, Lee Richardson, Su Lin Wu, and Ed Chi. 2021. Values of user exploration in recommender systems. RecSys 2021 - 15th ACM Conference on Recommender Systems (2021), 85--95. https://doi.org/10.1145/3460231.3474236
[12]
Tu Chen, Hui Tian, and Xuzhen Zhu. 2014. An enhanced collaborative filtering with flexible item popularity control for recommender systems. ACM International Conference Proceeding Series, Vol. 2014-Augus (2014). https://doi.org/10.1145/2639968.2640076
[13]
Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the fourth ACM conference on Recommender systems. 39--46.
[14]
Paolo Cremonesi and Roberto Turrin. 2010. Time-evolution of IPTV recommender systems. EuroITV'10 - Proceedings of the 8th International Interactive TV and Video Conference (2010), 105--114. https://doi.org/10.1145/1809777.1809801
[15]
Chaoyue Dai, Feng Qian, Wei Jiang, Zhoutian Wang, and Zenghong Wu. 2014. A personalized recommendation system for netease dating site. Proceedings of the VLDB Endowment, Vol. 7, 13 (2014), 1760--1765. https://doi.org/10.14778/2733004.2733080
[16]
Lucky Dhakad, Mrinal Das, Chiranjib Bhattacharyya, Samik Datta, Mihir Kale, and Vivek Mehta. 2017. SOPER: Discovering the influence of fashion and the many faces of user from session logs using stick breaking process. International Conference on Information and Knowledge Management, Proceedings, Vol. Part F1318 (2017), 1609--1618. https://doi.org/10.1145/3132847.3133007
[17]
Ricardo Dias, Ricardo Cunha, and Manuel J. Fonseca. 2014. A user-centered music recommendation approach for daily activities. CEUR Workshop Proceedings, Vol. 1245 (2014), 26--32.
[18]
Vitaly Feldman. 2020. Does learning require memorization? a short tale about a long tail. Proceedings of the Annual ACM Symposium on Theory of Computing (2020), 954--959. https://doi.org/10.1145/3357713.3384290 arxiv: 1906.05271
[19]
Zuohui Fu, Yikun Xian, Shijie Geng, Gerard De Melo, and Yongfeng Zhang. 2021. Popcorn: Human-in-the-loop Popularity Debiasing in Conversational Recommender Systems. International Conference on Information and Knowledge Management, Proceedings (2021), 494--503. https://doi.org/10.1145/3459637.3482461
[20]
Peter Gaspar, Michal Kompan, Jakub Simko, and Maria Bielikova. 2018. Analysis of user behavior in interfaces with recommended items: An eye-tracking study. CEUR Workshop Proceedings, Vol. 2225, October (2018), 32--36.
[21]
Christian Hansen, Rishabh Mehrotra, Casper Hansen, Brian Brost, Lucas Maystre, and Mounia Lalmas. 2021. Shifting Consumption towards Diverse Content on Music Streaming Platforms. WSDM 2021 - Proceedings of the 14th ACM International Conference on Web Search and Data Mining (2021), 238--246. https://doi.org/10.1145/3437963.3441775
[22]
Yu Chieh Ho, Yi Ting Chiang, and Jane Yung Jen Hsu. 2014. Who likes it more? Mining worth-recommending items from long tails by modeling relative preference. WSDM 2014 - Proceedings of the 7th ACM International Conference on Web Search and Data Mining (2014), 253--262. https://doi.org/10.1145/2556195.2566589
[23]
Christine Hosey, Lara Vujović, Brian St. Thomas, Jean Garcia-Gathright, and Jennifer Thom. 2019. Just give me what I want: How people use and evaluate music search. In Proceedings of the 2019 chi conference on human factors in computing systems. 1--12.
[24]
Jin Huang, Harrie Oosterhuis, and Maarten De Rijke. 2022. It is different when items are older: Debiasing recommendations when selection bias and user preferences are dynamic. WSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining (2022), 381--389. https://doi.org/10.1145/3488560.3498375 arxiv: 2111.12481
[25]
Amir H. Jadidinejad, Craig MacDonald, and Iadh Ounis. 2019. Unifying explicit and implicit feedback for rating prediction and ranking recommendation tasks. ICTIR 2019 - Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval (2019), 149--156. https://doi.org/10.1145/3341981.3344225
[26]
Rahul Katarya and Om Prakash Verma. 2016. Recent developments in affective recommender systems. Physica A: Statistical Mechanics and its Applications, Vol. 461 (2016), 182--190. https://doi.org/10.1016/j.physa.2016.05.046
[27]
Shahedul Huq Khandkar. 2009. Open coding. University of Calgary, Vol. 23, 2009 (2009).
[28]
Joseph A Konstan, Bradley N Miller, David Maltz, Jonathan L Herlocker, Lee R Gordon, and John Riedl. 1997. Grouplens: Applying collaborative filtering to usenet news. Commun. ACM, Vol. 40, 3 (1997), 77--87.
[29]
Kibeom Lee, Kyogu Lee, and A Music Recommender Systems. 2014. Using Dynamically Promoted Experts for Music Recommendation., Vol. 16, 5 (2014), 1201--1210.
[30]
Kibeom Lee, Woon Seung Yeo, and Kyogu Lee. 2010. Music recommendation in the personal long tail: Using a social-based analysis of a user's long-tailed listening behavior. CEUR Workshop Proceedings, Vol. 633, c (2010), 47--54.
[31]
Yu Liang, Aditya Ponnada, Paul Lamere, and Nediyana Daskalova. 2023. Enabling goal-focused exploration of podcasts in interactive recommender systems. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 142--155.
[32]
Allen Lin, Jianling Wang, Ziwei Zhu, and James Caverlee. 2022. Quantifying and Mitigating Popularity Bias in Conversational Recommender Systems. International Conference on Information and Knowledge Management, Proceedings iii (2022), 1238--1247. https://doi.org/10.1145/3511808.3557423 arxiv: 2208.03298
[33]
Zhongzhou Liu, Yuan Fang, and Min Wu. 2022. Mitigating Popularity Bias for Users and Items with Fairness-centric Adaptive Recommendation. ACM Transactions on Information Systems, Vol. 41, 3 (2022). https://doi.org/10.1145/3564286
[34]
Feng Lu and Nava Tintarev. 2018. A diversity adjusting strategy with personality for music recommendation. CEUR Workshop Proceedings, Vol. 2225 (2018), 7--14.
[35]
Haokai Lu, James Caverlee, and Wei Niu. 2016. Discovering what you're known for: A contextual poisson factorization approach. RecSys 2016 - Proceedings of the 10th ACM Conference on Recommender Systems (2016), 253--260. https://doi.org/10.1145/2959100.2959146
[36]
Shengnan Lyu, Arpit Rana, Scott Sanner, and Mohamed Reda Bouadjenek. 2021. A workflow analysis of context-driven conversational recommendation. The Web Conference 2021 - Proceedings of the World Wide Web Conference, WWW 2021, Vol. 2 (2021), 866--877. https://doi.org/10.1145/3442381.3450123
[37]
Brian J. Mcinnis, Elizabeth L. Murnane, Dmitry Epstein, Dan Cosley, and Gilly Leshed. 2016. One and done: Factors affecting one-time contributors to ad-hoc online communities. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, Vol. 27 (2016), 609--623. https://doi.org/10.1145/2818048.2820075
[38]
Sean M McNee, John Riedl, and Joseph A Konstan. 2006. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI'06 extended abstracts on Human factors in computing systems. 1097--1101.
[39]
Robert K Merton. 1968. The Matthew effect in science: The reward and communication systems of science are considered. Science, Vol. 159, 3810 (1968), 56--63.
[40]
microsoft. 2023. Introducing Microsoft 365 Copilot your copilot for work -- news.microsoft.com. https://news.microsoft.com/reinventing-productivity/. [Accessed 02-05--2024].
[41]
Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich. 2010. What do people ask their social networks, and why? A survey study of status message Q&A behavior. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1739--1748.
[42]
Javier Parapar and Filip Radlinski. 2021. Diverse User Preference Elicitation with Multi-Armed Bandits. WSDM 2021 - Proceedings of the 14th ACM International Conference on Web Search and Data Mining (2021), 130--138. https://doi.org/10.1145/3437963.3441786
[43]
Renata Pelissari, Paulos S C Alencar, Sarah B E N Amor, and Leonardo Tomazeli Duarte. 2022. A systematic review of the use of multiple criteria decision aiding methods in recommender systems : preliminary results. (2022), 1--9.
[44]
Maria Soledad Pera and Yiu Kai Ng. 2014. Assisting emergent readers in finding books to read. CEUR Workshop Proceedings, Vol. 1247 (2014), 2--3.
[45]
Matjavz Perc. 2014. The Matthew effect in empirical data. Journal of The Royal Society Interface, Vol. 11, 98 (2014), 20140378.
[46]
Sundar Pichai. 2023. An important next step on our AI journey -- blog.google. https://blog.google/technology/ai/bard-google-ai-search-updates/ . [Accessed 02-05--2024].
[47]
Wondo Rhee, Sung Min Cho, and Bongwon Suh. 2022. Countering Popularity Bias by Regularizing Score Differences. RecSys 2022 - Proceedings of the 16th ACM Conference on Recommender Systems (2022), 145--155. https://doi.org/10.1145/3523227.3546757
[48]
Deepjyoti Roy and Mala Dutta. 2022. A systematic review and research perspective on recommender systems. Journal of Big Data, Vol. 9, 1 (2022), 59.
[49]
Suvash Sedhain, Scott Sanner, Lexing Xie, Riley Kidd, Khoi Nguyen Tran, and Peter Christen. 2013. Social affinity filtering: Recommendation through fine-grained analysis of user interactions and activities. COSN 2013 - Proceedings of the 2013 Conference on Online Social Networks (2013), 51--61. https://doi.org/10.1145/2512938.2512947
[50]
Christin Seifert, Jörg Schlötterer, and Michael Granitzer. 2015. Towards a feature-rich data set for personalized access to long-tail content. Proceedings of the ACM Symposium on Applied Computing, Vol. 13--17-Apri, section 6 (2015), 1031--1038. https://doi.org/10.1145/2695664.2695671
[51]
Harald Steck. 2011. Item popularity and recommendation accuracy. RecSys'11 - Proceedings of the 5th ACM Conference on Recommender Systems (2011), 125--132. https://doi.org/10.1145/2043932.2043957
[52]
Wenlong Sun, Olfa Nasraoui, Sami Khenissi, and Patrick Shafto. 2019. Debiasing the human-recommender system feedback loop in collaborative filtering. The Web Conference 2019 - Companion of the World Wide Web Conference, WWW 2019 (2019), 645--651. https://doi.org/10.1145/3308560.3317303
[53]
Jiliang Tang, Xia Hu, and Huan Liu. 2013. Social recommendation: a review. Social Network Analysis and Mining, Vol. 3 (2013), 1113--1133.
[54]
Chun-Hua Tsai and Peter Brusilovsky. 2018. Beyond the ranked list: User-driven exploration and diversification of social recommendation. In 23rd international conference on intelligent user interfaces. 239--250.
[55]
Chun Hua Tsai and Peter Brusilovsky. 2020. User feedback in controllable and explainable social recommender systems: A linguistic analysis. CEUR Workshop Proceedings, Vol. 2682, c (2020), 1--13.
[56]
Dmitry Ustalov, Natalia Fedorova, and Nikita Pavlichenko. 2022. Improving Recommender Systems with Human-in-the-Loop. In Proceedings of the 16th ACM Conference on Recommender Systems. 708--709.
[57]
Andreu Vall, Markus Schedl, Gerhard Widmer, Massimo Quadrana, and Paolo Cremonesi. 2017. The importance of song context in music playlists: Enabling recommendations in the long tail. CEUR Workshop Proceedings, Vol. 1905 (2017), 7--8.
[58]
Longqi Yang, Chenyang Wang, Yin Cui, Serge Belongie, Yuan Xuan, and Deborah Estrin. 2018. Unbiased offline recommender evaluation for missing-not-at-random implicit feedback. RecSys 2018 - 12th ACM Conference on Recommender Systems (2018), 279--287. https://doi.org/10.1145/3240323.3240355
[59]
Yang Zhang, Fuli Feng, Xiangnan He, Tianxin Wei, Chonggang Song, Guohui Ling, and Yongdong Zhang. 2021. Causal Intervention for Leveraging Popularity Bias in Recommendation. SIGIR 2021 - Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (2021), 11--20. https://doi.org/10.1145/3404835.3462875 arxiv: 2105.06067
[60]
Yong Zheng. 2016. Adapt to Emotional Reactions In Context-aware Personalization. RecSys (2016). http://ceur-ws.org/Vol-1680/

Index Terms

  1. Investigating Characteristics of Media Recommendation Solicitation in r/ifyoulikeblank

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CSCW2
    CSCW
    November 2024
    5177 pages
    EISSN:2573-0142
    DOI:10.1145/3703902
    Issue’s Table of Contents
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 November 2024
    Published in PACMHCI Volume 8, Issue CSCW2

    Check for updates

    Author Tags

    1. content analysis
    2. crowdsourcing recommendation
    3. feature selection
    4. ifyoulikeblank
    5. information seeking

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 42
      Total Downloads
    • Downloads (Last 12 months)42
    • Downloads (Last 6 weeks)42
    Reflects downloads up to 29 Nov 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media