research-article

Highlighting High-quality Content as a Moderation Strategy: The Role of New York Times Picks in Comment Quality and Engagement

Authors:

Nicholas DiakopoulosAuthors Info & Claims

ACM Transactions on Social Computing (TSC), Volume 4, Issue 4

Article No.: 13, Pages 1 - 24

https://doi.org/10.1145/3484245

Published: 29 January 2022 Publication History

Abstract

News commenting is a prevalent form of online interaction, but it is fraught with issues, such as a low quality of discussion that often takes place. While various moderation methods can be used to maintain online discussion quality, one moderation strategy that is underexplored is for professional moderators to mark high-quality posts that are further highlighted in the interface. In this work, we look at the impact of New York Times (NYT) Picks. We present an analysis of more than 13 million NYT comments, examining the quality and frequency of commenting on the site in response to NYT Picks. The findings offer evidence that NYT Picks are associated with an increase in the quality of first-time receivers’ next approved comment, as well as the commenting frequency during commenters’ early tenure on the site. The quality boost associated with receiving a Pick attenuates after subsequent picks and diminishes over time as the user continues commenting but is still higher than commenters who do not receive Picks. Visible comment quality has a relatively small but significant positive correlation with the quality of the next comment, and exposure to Pick badges is also positively correlated with subsequent higher-quality approved comments, albeit to a lesser extent. Our results underscore the potential for news organizations to adopt the moderation strategy of highlighting professionally selected high-quality comments to improve overall community quality. We discuss the implications of our findings and offer design opportunities for comment sections that could further enhance quality in online discourse.

References

[1]

Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2013. Steering user behavior with badges. In Proceedings of the 22nd International Conference on World Wide Web (WWW’13). Association for Computing Machinery, New York, NY, 95–106. https://doi.org/10.1145/2488388.2488398

Digital Library

[2]

Ron Artstein and Massimo Poesio. 2008. Inter-coder agreement for computational linguistics. Comput. Ling. 34, 4 (2008), 555–596.

Digital Library

[3]

Albert Bandura and Richard H. Walters. 1977. Social Learning Theory. Vol. 1. Prentice Hall, Englewood Cliffs, NJ.

[4]

Kenneth Benoit, Drew Conway, Benjamin E. Lauderdale, Michael Laver, and Slava Mikhaylov. 2016. Crowd-sourced text analysis: Reproducible and agile production of political data. Am. Pol. Sci. Rev. 110, 2 (2016), 278–295.

[5]

Leo Breiman. 1996. Bagging predictors. Mach. Learn. 24, 2 (1996), 123–140.

Digital Library

[6]

Moira Burke, Cameron Marlow, and Thomas Lento. 2009. Feed me: Motivating newcomer contribution in social network sites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, 945–954. https://doi.org/10.1145/1518701.1518847

Digital Library

[7]

Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You can’t stay here: The efficacy of Reddit’s 2015 ban examined through hate speech. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 31 (November 2017), 1–22. DOI: https://doi.org/10.1145/3134666

Digital Library

[8]

Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The bag of communities: Identifying abusive behavior online with preexisting internet data. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, 3175–3187. https://doi.org/10.1145/3025453.3026018

Digital Library

[9]

Justin Cheng, Michael Bernstein, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2017. Anyone can become a troll: Causes of trolling behavior in online discussions. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW’17). Association for Computing Machinery, New York, NY, 1217–1230. https://doi.org/10.1145/2998181.2998213

Digital Library

[10]

Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2014. How community feedback shapes user behavior. In Proceedings of the International AAAI Conference on Web and Social Media.

[11]

Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. Antisocial behavior in online discussion communities. In Proceedings of the 9th International AAAI Conference on Web and Social Media.

[12]

Coye Cheshire. 2007. Selective incentives and generalized information exchange. Social Psychology Quarterly 70, 1 (2007), 82–100.

[13]

Kevin Coe, Kate Kenski, and Stephen A. Rains. 2014. Online and uncivil? Patterns and determinants of incivility in newspaper website comments. J. Commun. 64, 4 (2014), 658–679.

[14]

Irene Costera Meijer and Hildebrand P. Bijleveld. 2016. Valuable journalism: Measuring news quality from a user’s perspective. Journal. Stud. 17, 7 (2016), 827–839.

[15]

Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. Automated hate speech detection and the problem of offensive language. In Proceedings of the International AAAI Conference on Web and Social Media.

[16]

Nicholas Diakopoulos and Mor Naaman. 2011. Towards quality discourse in online news comments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW’11). Association for Computing Machinery, New York, NY, 133–142. https://doi.org/10.1145/1958824.1958844

Digital Library

[17]

Nicholas A. Diakopoulos. 2015. The editor’s eye: Curation and comment relevance on the new york times. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW’15). Association for Computing Machinery, New York, NY, 1153–1157. https://doi.org/10.1145/2675133.2675160

Digital Library

[18]

Joseph Fanfarelli, Stephanie Vie, and Rudy McDaniel. 2015. Understanding digital badges through feedback, reward, and narrative: A multidisciplinary approach to building better badges in social environments. Commun. Des. Quart. Rev. 3, 3 (2015), 56–60.

Digital Library

[19]

Ernst Fehr, Urs Fischbacher, and Simon Gächter. 2002. Strong reciprocity, human cooperation, and the enforcement of social norms. Hum. Nat. 13, 1 (2002), 1–25.

[20]

Charles B. Ferster and Burrhus Frederic Skinner. 1957. Schedules of Reinforcement. Appleton-Century-Crofts, New York, NY.

[21]

Rolf Fredheim, Alfred Moore, and John Naughton. 2015. Anonymity and online commenting: The broken windows effect and the end of drive-by commenting. In Proceedings of the ACM Web Science Conference (WebSci’15). Association for Computing Machinery, New York, NY, Article 11, 8 pages. https://doi.org/10.1145/2786451.2786459

Digital Library

[22]

Dennis Friess and Christiane Eilders. 2015. A systematic review of online deliberation research. Policy Internet 7, 3 (2015), 319–339.

[23]

Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media. Yale University Press, New Haven, CT.

[24]

James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. 17 (2015), 42.

[25]

Soo-Hye Han and LeAnn M Brazeal. 2015. Playing nice: Modeling civility in online political discussions. Communication Research Reports 32, 1 (2015), 20–28.

[26]

John Hattie and Helen Timperley. 2007. The power of feedback. Rev. Educ. Res. 77, 1 (2007), 81–112.

[27]

D. Ho, K. Imai, G. King, and E. Stuart. 2006. MatchIt: Nonparametric Preprocessing for Parametric Casual Inference. R package version 2–2.

[28]

Matthew W. Hughey and Jessie Daniels. 2013. Racist comments at online news sites: A methodological dilemma for discourse analysis. Media Cult. Soc. 35, 3 (2013), 332–347.

[29]

Jessica Hullman, Nicholas Diakopoulos, Elaheh Momeni, and Eytan Adar. 2015. Content, context, and critique: Commenting on a data visualization blog. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW’15). Association for Computing Machinery, New York, NY, 1170–1175. https://doi.org/10.1145/2675133.2675207

Digital Library

[30]

C. Hutto and Eric Gilbert. 2014. VADER: A parsimonious rule-based model for sentiment analysis of social media text. Proc. Int. AAAI Conf. Web Soc. Media 8, 1 (May 2014), 216–225.

[31]

Davy Janssen and Raphaël Kies. 2005. Online forums and deliberative democracy. Acta pol. 40, 3 (2005), 317–335.

[32]

Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of reddit automoderator. ACM Trans. Comput.-Hum. Interact. 26, 5 (2019), 1–35.

Digital Library

[33]

Ling Jiang and Eui-Hong Han. 2019. ModBot: Automatic comments moderation. In Proceedings of the Computation+ Journalism Symposium.

[34]

Victoria Johansson. 2009. Lexical diversity and lexical density in speech and writing: A developmental perspective. Lund Work. Pap. Ling. 53 (2009), 61–79.

[35]

Elisabeth Joyce and Robert E. Kraut. 2006. Predicting continued participation in newsgroups. J. Comput.-Mediat. Commun. 11, 3 (2006), 723–747.

[36]

Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2012. Regulating behavior in online communities. In Building Successful Online Communities: Evidence-based Social Design, 125–178.

[37]

Aniket Kittur, Ed H. Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with mechanical turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). Association for Computing Machinery, New York, NY, 453–456. https://doi.org/10.1145/1357054.1357127

Digital Library

[38]

Cliff Lampe and Erik Johnston. 2005. Follow the (slash) dot: Effects of feedback on new members in an online community. In Proceedings of the 2005 International ACM SIGGROUP Conference on Supporting Group Work (GROUP’05). Association for Computing Machinery, New York, NY, 11–20. https://doi.org/10.1145/1099203.1099206

Digital Library

[39]

Cliff Lampe and Paul Resnick. 2004. Slash(Dot) and Burn: Distributed Moderation in a Large Online Conversation Space. Association for Computing Machinery, New York, NY, 543–550. https://doi.org/10.1145/985692.985761

Digital Library

[40]

J. Nathan Matias. 2019. The civic labor of volunteer moderators online. Social Media+ Society 5, 2 (2019), https://doi.org/10.1177/2056305119836778

[41]

J. Nathan Matias. 2019. Preventing harassment and increasing group participation through social norms in 2,190 online science discussions. Proc. Natl. Acad. Sci. U.S.A. 116, 20 (2019), 9785–9789.

[42]

G. Harry Mc Laughlin. 1969. SMOG grading-a new readability formula. J. Read. 12, 8 (1969), 639–646.

[43]

Burt L. Monroe, Michael P. Colaresi, and Kevin M. Quinn. 2008. Fightin’ words: Lexical feature selection and evaluation for identifying the content of political conflict. Polit. Anal. 16, 4 (2008), 372–403.

[44]

Jae Yun Moon and Lee S. Sproull. 2008. The role of feedback in managing the Internet-based volunteer work force. Inf. Syst. Res. 19, 4 (2008), 494–515.

[45]

Ashley Muddiman and Natalie Jomini Stroud. 2016. 10 Things We Learned by Analyzing 9 Million Comments from The New York Times. Center for Media Engagement, The University of Texas at Austin.

[46]

Kevin Munger. 2017. Tweetment effects on the tweeted: Experimentally reducing racist harassment. Polit. Behav. 39, 3 (2017), 629–649.

[47]

Nic Newman, Richard Fletcher, Antonis Kalogeropoulos, and Rasmus Kleis Nielsen. 2019. Reuters Institute Digital News Report. Reuters Institute for the Study of Journalism (2019).

[48]

Chikashi Nobata, Joel Tetreault, Achint Thomas, Yashar Mehdad, and Yi Chang. 2016. Abusive language detection in online user content. In Proceedings of the 25th International Conference on World Wide Web (WWW’16). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 145–153. https://doi.org/10.1145/2872427.2883062

Digital Library

[49]

Blair Nonnecke and Jenny Preece. 2001. Why lurkers lurk. AMCIS 2001 Proc. (2001), 294.

[50]

Zizi Papacharissi. 2004. Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New Media Soc. 6, 2 (2004), 259–283.

[51]

Deokgun Park, Simranjit Sachar, Nicholas Diakopoulos, and Niklas Elmqvist. 2016. Supporting comment moderators in identifying high quality online news comments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16). Association for Computing Machinery, New York, NY, 1114–1125. https://doi.org/10.1145/2858036.2858389

Digital Library

[52]

Simranjit Singh Sachar and Nicholas Diakopoulos. 2016. Changing names in online news comments at the new york times. In Proceedings of the 10th International AAAI Conference on Web and Social Media.

[53]

Arthur D. Santana. 2014. Virtuous or vitriolic: The effect of anonymity on civility in online newspaper reader comment boards. Journal. Pract. 8, 1 (2014), 18–33.

[54]

Jodi Schneider, Alexandre Passant, and John G. Breslin. 2011. Understanding and improving wikipedia article discussion spaces. In Proceedings of the 2011 ACM Symposium on Applied Computing (SAC’11). Association for Computing Machinery, New York, NY, 808–813. https://doi.org/10.1145/1982185.1982358

Digital Library

[55]

Joseph Seering, Tianmi Fang, Luca Damasco, Mianhong ‘Cherie’ Chen, Likang Sun, and Geoff Kaufman. 2019. Designing user interface elements to improve the quality and civility of discourse in online commenting behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19). Association for Computing Machinery, New York, NY, 1–14. https://doi.org/10.1145/3290605.3300836

Digital Library

[56]

Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping pro and anti-social behavior on twitch through moderation and example-setting. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW’17). Association for Computing Machinery, New York, NY, 111–125. https://doi.org/10.1145/2998181.2998277

Digital Library

[57]

Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media Soc. 21, 7 (2019), 1417–1443.

[58]

Nina Springer, Ines Engelmann, and Christian Pfaffinger. 2015. User comments: Motives and inhibitors to write and read. Inf. Commun. Soc. 18, 7 (2015), 798–815.

[59]

Natalie Jomini Stroud, Joshua M Scacco, Ashley Muddiman, and Alexander L Curry. 2015. Changing deliberative norms on news organizations’ Facebook sites. J. Comput.-Mediat. Commun. 20, 2 (2015), 188–203.

[60]

Natalie Jomini Stroud, Emily Van Duyn, Alexis Alizor, Alishan Alibhai, and Cameron Lang. 2014. Journalist Involvement in Comment Sections. Center for Media Engagement, The University of Texas at Austin.

[61]

Natalie Jomini Stroud, Emily Van Duyn, Alexis Alizor, Alishan Alibhai, and Cameron Lang. 2017. Comment Section Survey Across 20 News Sites. Center for Media Engagement, The University of Texas at Austin.

[62]

Natalie Jomini Stroud, Emily Van Duyn, and Cynthia Peacock. 2016. Survey of Commenters and Comment Readers. Center for Media Engagement, The University of Texas at Austin.

[63]

Abhay Sukumaran, Stephanie Vezich, Melanie McHugh, and Clifford Nass. 2011. Normative influences on thoughtful online participation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). Association for Computing Machinery, New York, NY, 3401–3410. https://doi.org/10.1145/1978942.1979450

Digital Library

[64]

Manos Tsagkias, Wouter Weerkamp, and Maarten de Rijke. 2010. News comments:Exploring, modeling, and online prediction. In Advances in Information Retrieval, Cathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan Rüger, and Keith van Rijsbergen (Eds.). ECIR 2010. Lecture Notes in Computer Science, Springer, Berlin, 191–203. https://doi.org/10.1007/978-3-642-12275-0_19

Digital Library

[65]

Robert Waldersee and Fred Luthans. 1994. The impact of positive and corrective feedback on customer service performance. J. Organiz. Behav. 15, 1 (1994), 83–95.

[66]

Shan Wang. 2017. The New York Times, with a Little Help from Automation, Is Aiming to Open up Most Articles to Comments. Nieman Journalism Lab.

[67]

Yixue Wang and Nicholas Diakopoulos. 2021. Journalistic source discovery: Supporting the identification of news sources in user generated content. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 447, 1–18. DOI: https://doi.org/10.1145/3411764.3445266

Digital Library

[68]

Brendan R Watson, Zhao Peng, and Seth C. Lewis. 2019. Who will intervene to save news comments? Deviance and social control in communities of news commenters. New Media Soc. 21, 8 (2019), 1840–1858.

[69]

Patrick Weber. 2014. Discussions in the comments section: Factors influencing participation and interactivity in online newspaper’s reader comments. New Media Soc. 16, 6 (2014), 941–957.

[70]

Kevin Wise, Brian Hamman, and Kjerstin Thorson. 2006. Moderation, response rate, and message interactivity: Features of online communities and their effects on intent to participate. J. Comput.-Mediat. Commun. 12, 1 (2006), 24–41.

[71]

Donghee Yvette Wohn. 2015. The effects of feedback and habit on content posting in an online community. In Proceedings of the iConference.

[72]

Ellery Wulczyn, Nithum Thain, and Lucas Dixon. 2017. Ex machina: Personal attacks seen at scale. In Proceedings of the 26th International Conference on World Wide Web (WWW’17). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 1391–1399. https://doi.org/10.1145/3038912.3052591

Digital Library

[73]

Peng Zhao, Xiaogang Su, Tingting Ge, and Juanjuan Fan. 2016. Propensity score and proximity matching using random forest. Contemp. Clin. Trials 47 (2016), 85–92.

[74]

Haiyi Zhu, Amy Zhang, Jiping He, Robert E. Kraut, and Aniket Kittur. 2013. Effects of peer feedback on contribution: A field experiment in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). Association for Computing Machinery, New York, NY, 2253–2262. https://doi.org/10.1145/2470654.2481311

Digital Library

Cited By

Waterschoot Cvan den Bosch A(2024)A time-robust group recommender for featured comments on news platformsFrontiers in Big Data10.3389/fdata.2024.13997397Online publication date: 21-May-2024
https://doi.org/10.3389/fdata.2024.1399739
Lambert CChoi FChandrasekharan E(2024)"Positive reinforcement helps breed positive behavior": Moderator Perspectives on Encouraging Desirable BehaviorProceedings of the ACM on Human-Computer Interaction10.1145/36869298:CSCW2(1-33)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686929
Waterschoot Cvan den Hemel Evan den Bosch A(2024)The Impact of Featuring Comments in Online DiscussionsSocial Networks Analysis and Mining10.1007/978-3-031-78538-2_5(65-74)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-78538-2_5
Show More Cited By

Index Terms

Highlighting High-quality Content as a Moderation Strategy: The Role of New York Times Picks in Comment Quality and Engagement
1. Human-centered computing
  1. Collaborative and social computing
  2. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Web-based interaction

Recommendations

Towards quality discourse in online news comments
CSCW '11: Proceedings of the ACM 2011 conference on Computer supported cooperative work

With the growth in sociality and interaction around online news media, news sites are increasingly becoming places for communities to discuss and address common issues spurred by news articles. The quality of online news comments is of importance to ...
What Makes a Good TODO Comment?
Software development is a collaborative process that involves various interactions among individuals and teams. TODO comments in source code play a critical role in managing and coordinating diverse tasks during this process. However, this study finds ...
A decade of code comment quality assessment: A systematic literature review
Abstract
Code comments are important artifacts in software systems and play a paramount role in many software engineering (SE) tasks related to maintenance and program comprehension. However, while it is widely accepted that high quality matters in code ...
Highlights
- The studies in the last decade (2011–2020) analyze comments of multiple systems.
- 87% of the studies analyze comments from Java systems.
- 50% of the studies focus on specific comment types, e.g., method, or inline.
- 21 quality ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Social Computing

ACM Transactions on Social Computing Volume 4, Issue 4

December 2021

95 pages

EISSN:2469-7826

DOI:10.1145/3505217

Editor:
Kevin Crowston
Syracuse University, USA

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2022

Accepted: 01 August 2021

Revised: 01 August 2021

Received: 01 January 2021

Published in TSC Volume 4, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
752
Total Downloads

Downloads (Last 12 months)168
Downloads (Last 6 weeks)29

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Waterschoot Cvan den Bosch A(2024)A time-robust group recommender for featured comments on news platformsFrontiers in Big Data10.3389/fdata.2024.13997397Online publication date: 21-May-2024
https://doi.org/10.3389/fdata.2024.1399739
Lambert CChoi FChandrasekharan E(2024)"Positive reinforcement helps breed positive behavior": Moderator Perspectives on Encouraging Desirable BehaviorProceedings of the ACM on Human-Computer Interaction10.1145/36869298:CSCW2(1-33)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686929
Waterschoot Cvan den Hemel Evan den Bosch A(2024)The Impact of Featuring Comments in Online DiscussionsSocial Networks Analysis and Mining10.1007/978-3-031-78538-2_5(65-74)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-78538-2_5
He WGordon MPopowski LBernstein M(2023)Cura: Curation at Social Media ScaleProceedings of the ACM on Human-Computer Interaction10.1145/36101867:CSCW2(1-33)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610186
Wang XFujisawa MMikawa M(2023)XProtoSphere: an eXtended multi-sized sphere packing algorithm driven by particle size distributionThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02977-w39:8(3333-3346)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1007/s00371-023-02977-w
Che YHe D(2022)An enhanced seagull optimization algorithm for solving engineering optimization problemsApplied Intelligence10.1007/s10489-021-03155-y52:11(13043-13081)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10489-021-03155-y

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents