extended-abstract

RHETORiC: an Audience Conversation Tool that Restores Civility in News Comment Sections

Authors:

Emilie Bossens,

Michiel Nuytemans,

Jan BoesmanAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 42, Pages 1 - 7

https://doi.org/10.1145/3491101.3503560

Published: 28 April 2022 Publication History

Abstract

We present a case study where we developed RHETORiC: an audience conversation tool that promotes civil participation in online news comments. By following a human-centered design process, we created and evaluated a novel tool with an interface that supports people in carefully formulating their opinions and arguments, so they can constructively contribute to online discussions about news. Results of a large-scale field study show that our tool succeeds in increasing the level of civility, argumentation and proficiency of comments in comparison with those on social media. On top, both users and journalists report high satisfaction with the RHETORiC tool. In our paper we reflect upon lessons learned about the design process as well as about the tool itself, which contributes to the fields of both Human-Computer Interaction and Digital Journalism.

Supplementary Material

MP4 File (3491101.3503560-talk-video.mp4)

Talk Video

Download
168.83 MB

MP4 File (3491101.3503560-video-preview.mp4)

Video Preview

Download
27.64 MB

References

[1]

Emilie Bossens, Elias Storms, and David Geerts. 2021. Improving the Debate: Interface Elements that Enhance Civility and Relevance in Online News Comments. In Human-Computer Interaction – INTERACT 2021, 433–450.

Digital Library

[2]

Marcel Broersma. 2019. Audience Engagement. In Tim P. Vos, Folker Hanusch, Dimitra Dimitrakopoulou, Margaretha Geertsema-Sligh, and Annika Sehl (eds.). The International Encyclopedia of Journalism Studies Wiley. https://doi.org/10.1002/9781118841570.iejs0060

[3]

James Curran, Shanto Iyengar, Anker Brink Lund, and Inka Salovaara-Moring. 2009. Media System, Public Knowledge and Democracy: A Comparative Study. European Journal of Communication 24, 1: 5–26. https://doi.org/10.1177/0267323108098943

[4]

Nicholas Diakopoulos and Mor Naaman. 2011. Towards quality discourse in online news comments. In Proceedings of the ACM 2011 conference on Computer supported cooperative work - CSCW ’11, 133. https://doi.org/10.1145/1958824.1958844

Digital Library

[5]

Siamak Faridani, Ephrat Bitton, Kimiko Ryokai, and Ken Goldberg. 2010. Opinion space: a scalable tool for browsing online comments. In Proceedings of the 28th international conference on Human factors in computing systems - CHI ’10, 1175. https://doi.org/10.1145/1753326.1753502

Digital Library

[6]

Thomas B. Ksiazek and Nina Springer. 2018. User Comments in Digital Journalism. In The Routledge Handbook of Developments in Digital Journalism Studies (1st ed.), Scott A. Eldridge and Bob Franklin (eds.). Routledge, 475–486. https://doi.org/10.4324/9781315270449-37

[7]

Thomas B. Ksiazek and Nina Springer. 2020. User Comments and Moderation in Digital Journalism: Disruptive Engagement. Routledge. https://doi.org/10.4324/9780429276132

[8]

Edith Manosevitch. 2009. The Reflective Cue: Prompting Citizens for Greater Consideration of Reasons. International Journal of Public Opinion Research 21, 2: 187–203. https://doi.org/10.1093/ijpor/edp013

[9]

Edith Manosevitch, Nili Steinfeld, and Azi Lev-On. 2014. Promoting online deliberation quality: cognitive cues matter. Information, Communication & Society 17, 10: 1177–1195. https://doi.org/10.1080/1369118X.2014.899610

[10]

Cynthia Peacock, Joshua M Scacco, and Natalie Jomini Stroud. 2019. The deliberative influence of comment section structure. Journalism 20, 6: 752–771.https://doi.org/10.1177/1464884917711791

[11]

Fabian Prochazka, Patrick Weber, and Wolfgang Schweiger. 2018. Effects of Civility and Reasoning in User Comments on Perceived Journalistic Quality. Journalism Studies 19, 1: 62–78. https://doi.org/10.1080/1461670X.2016.1161497

[12]

Christine Schmidt. 2017. Remember that Norwegian site that made readers take a quiz before commenting? Here's an update on it. Retrieved from https://www.niemanlab.org/2017/08/remember-that-norwegian-site-that-makes-readers-take-a-quiz-before-commenting-heres-an-update-on-it/

[13]

Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2017. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence 4, 6: 103. https://doi.org/10.9781/ijimai.2017.09.001

[14]

Joseph Seering, Tianmi Fang, Luca Damasco, Mianhong “Cherie” Chen, Likang Sun, and Geoff Kaufman. 2019. Designing User Interface Elements to Improve the Quality and Civility of Discourse in Online Commenting Behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300836

[15]

Natalie Jomini Stroud, Joshua M. Scacco, Ashley Muddiman, and Alexander L. Curry. 2015. Changing Deliberative Norms on News Organizations’ Facebook Sites. Journal of Computer-Mediated Communication 20, 2: 188–203. https://doi.org/10.1111/jcc4.12104

[16]

Mingxiao Sui and Raymond J Pingree. 2016. In Search of Reason-Centered Discussion on China's Twitter: The Effects of Initiating Post and Discussion Format on Reasoning. 16.

[17]

John Suler. 2004. The Online Disinhibition Effect. CyberPsychology & Behavior 7, 3: 321–326. https://doi.org/10.1089/1094931041291295

[18]

W. Ben Towne and James D. Herbsleb. 2012. Design Considerations for Online Deliberation Systems. Journal of Information Technology & Politics 9, 1: 97–115. https://doi.org/10.1080/19331681.2011.637711

[19]

Marc Ziegele, Oliver Quiring, Katharina Esau, and Dennis Friess. 2020. Linking News Value Theory With Online Deliberation: How News Factors and Illustration Factors in News Articles Affect the Deliberative Quality of User Discussions in SNS’ Comment Sections. Communication Research 47, 6: 860–890. https://doi.org/10.1177/0093650218797884

Cited By

Ilves MSyrjämäki AOlsson TKiskola JIsokoski PRantasila ABente GSurakka V(2024)Emotion labelling strengthens readers’ emotional responses to online messagesBehaviour & Information Technology10.1080/0144929X.2024.2379552(1-12)Online publication date: 29-Jul-2024
https://doi.org/10.1080/0144929X.2024.2379552
Weber IVandebosch HPoels KPabian S(2023)Features for Hate? Using the Delphi Method to Explore Digital Determinants for Online Hate Perpetration and Possibilities for InterventionCyberpsychology, Behavior, and Social Networking10.1089/cyber.2022.019526:7(479-488)Online publication date: 1-Jul-2023
https://doi.org/10.1089/cyber.2022.0195

Recommendations

How to Compete Online for News Audience: Modeling Words that Attract Clicks
KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Headlines are particularly important for online news outlets where there are many similar news stories competing for users' attention. Traditionally, journalists have followed rules-of-thumb and experience to master the art of crafting catchy headlines, ...
Digesting News Reader Comments via Fine-Grained Associations with Event Facets and News Contents
CIKM '16: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management

News articles from different sources reporting the same event are often associated with an enormous amount of reader comments resulting in difficulty in digesting the comments manually. Some of these comments, despite coming from different sources, ...
Workshop Transmedia Journalism and Interactive Documentary in Dialogue
Interactive Storytelling
Abstract
This half-day workshop promotes a hands-on approach to recent developments in transmedia storytelling and its application to journalism and interactive documentary (iDoc). Transmedia journalism, as well as any other application of transmedia ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Funding Sources

VLAIO

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
194
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ilves MSyrjämäki AOlsson TKiskola JIsokoski PRantasila ABente GSurakka V(2024)Emotion labelling strengthens readers’ emotional responses to online messagesBehaviour & Information Technology10.1080/0144929X.2024.2379552(1-12)Online publication date: 29-Jul-2024
https://doi.org/10.1080/0144929X.2024.2379552
Weber IVandebosch HPoels KPabian S(2023)Features for Hate? Using the Delphi Method to Explore Digital Determinants for Online Hate Perpetration and Possibilities for InterventionCyberpsychology, Behavior, and Social Networking10.1089/cyber.2022.019526:7(479-488)Online publication date: 1-Jul-2023
https://doi.org/10.1089/cyber.2022.0195

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents