Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3539597.3570487acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Beyond Digital "Echo Chambers": The Role of Viewpoint Diversity in Political Discussion

Published: 27 February 2023 Publication History

Abstract

Increasingly taking place in online spaces, modern political conversations are typically perceived to be unproductively affirming---siloed in so called "echo chambers" of exclusively like-minded discussants. Yet, to date we lack sufficient means to measure viewpoint diversity in conversations. To this end, in this paper, we operationalize two viewpoint metrics proposed for recommender systems and adapt them to the context of social media conversations. This is the first study to apply these two metrics (Representation and Fragmentation) to real world data and to consider the implications for online conversations specifically. We apply these measures to two topics---daylight savings time (DST), which serves as a control, and the more politically polarized topic of immigration. We find that the diversity scores for both Fragmentation and Representation are lower for immigration than for DST. Further, we find that while pro-immigrant views receive consistent pushback on the platform, anti-immigrant views largely operate within echo chambers. We observe less severe yet similar patterns for DST. Taken together, Representation and Fragmentation paint a meaningful and important new picture of viewpoint diversity.

Supplementary Material

MP4 File (WSDM23-fp0057.mp4)
In this video we give an overview of our work. This study measures viewpoint diversity in online political conversations using two metrics adapted from news recommender systems. For the first time, the metrics (Representation and Fragmentation) are applied to real-world data, specifically on the topics of daylight savings time and immigration. Results show lower diversity scores for immigration compared to daylight savings time, with anti-immigrant views mostly operating in echo chambers while pro-immigrant views receive pushback. Representation and Fragmentation provide a new and significant understanding of viewpoint diversity in online conversations.
MP4 File (07_wsdm2023_fard_hada_diversity_01.mp4-streaming.mp4)
Beyond Digital "Echo Chambers": The Role of Viewpoint Diversity in Political Discussion

References

[1]
Jisun An, Daniele Quercia, Meeyoung Cha, Krishna Gummadi, and Jon Crowcroft. 2014. Sharing political news: the balancing act of intimacy and socialization in selective exposure. EPJ Data Science 3 (2014), 1--21.
[2]
Sinan Aral, Lev Muchnik, and Arun Sundararajan. 2009. Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks. Proceedings of the National Academy of Sciences 106, 51 (2009), 21544--21549.
[3]
Arunkumar Bagavathi, Pedram Bashiri, Shannon Reid, Matthew Phillips, and Siddharth Krishnan. 2019. Examining untempered social media: analyzing cascades of polarized conversations. In Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. 625--632.
[4]
Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132.
[5]
Pablo Barberá. 2015. Birds of the same feather tweet together: Bayesian ideal point estimation using Twitter data. Political analysis 23, 1 (2015), 76--91.
[6]
Pablo Barberá, John T Jost, Jonathan Nagler, Joshua A Tucker, and Richard Bonneau. 2015. Tweeting from left to right: Is online political communication more than an echo chamber? Psychological science 26, 10 (2015), 1531--1542.
[7]
Marco Bastos, Dan Mercea, and Andrea Baronchelli. 2018. The geographic embedding of online echo chambers: Evidence from the Brexit campaign. PloS one 13, 11 (2018), e0206841.
[8]
Fabian Baumann, Philipp Lorenz-Spreen, Igor M Sokolov, and Michele Starnini. 2020. Modeling echo chambers and polarization dynamics in social networks. Physical Review Letters 124, 4 (2020), 048301.
[9]
Emily M. Bender and Batya Friedman. 2018. Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science. Transactions of the Association for Computational Linguistics 6 (2018).
[10]
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proc. of FAccT '21.
[11]
Yochai Benkler, Robert Faris, and Hal Roberts. 2018. Network propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford University Press.
[12]
John Bollenbacher, Diogo Pacheco, Pik-Mai Hui, Yong-Yeol Ahn, Alessandro Flammini, and Filippo Menczer. 2021. On the challenges of predicting microscopic dynamics of online conversations. Applied Network Science 6, 1 (2021), 1--21.
[13]
Iván Cantador, María E Cortés-Cediel, and Miriam Fernández. 2020. Exploiting Open Data to analyze discussion and controversy in online citizen participation. Information Processing & Management 57, 5 (2020), 102301.
[14]
Hsuan-Ting Chen. 2018. Spiral of silence on social media and the moderating role of disagreement and publicness in the network: Analyzing expressive and withdrawal behaviors. New Media & Society 20, 10 (2018), 3917--3936.
[15]
Daejin Choi, Jinyoung Han, Taejoong Chung, Yong-Yeol Ahn, Byung-Gon Chun, and Ted Taekyoung Kwon. 2015. Characterizing conversation patterns in reddit: From the perspectives of content properties and user participation behaviors. In Proceedings of the 2015 acm on conference on online social networks. 233--243.
[16]
Matteo Cinelli, Gianmarco De Francisci Morales, Alessandro Galeazzi, Walter Quattrociocchi, and Michele Starnini. 2021. The echo chamber effect on social media. Proceedings of the National Academy of Sciences 118, 9 (2021).
[17]
Peter Cogan, Matthew Andrews, Milan Bradonjic, W Sean Kennedy, Alessandra Sala, and Gabriel Tucci. 2012. Reconstruction and analysis of twitter conversation graphs. In Proceedings of the First ACM International Workshop on Hot Topics on Interdisciplinary Social Networks Research. 25--31.
[18]
Joshua Cohen. 1989. Deliberation and Democratic Legitimacy. In The Good Polity: Normative Analysis of the State, Alan Hamlin and Phillip Petit (Eds.). Blackwell, New York.
[19]
Tim Draws, Oana Inel, Nava Tintarev, Christian Baden, and Benjamin Timmermans. 2022. Comprehensive Viewpoint Representations for a Deeper Understanding of User Interactions With Debated Topics. In ACM SIGIR Conference on Human Information Interaction and Retrieval (Regensburg, Germany) (CHIIR '22). Association for Computing Machinery, New York, NY, USA, 135--145. https://doi.org/10.1145/3498366.3505812
[20]
John S. Dryzek. 2009. Democratization as Deliberative Capacity Building. Comparative Political Studies 42, 11 (2009). https://doi.org/10.1177/0010414009332129
[21]
Deen Freelon, Alice Marwick, and Daniel Kreiss. 2020. False equivalencies: Online activism from left to right. Science 369, 6508 (2020), 1197--1201.
[22]
Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Political discourse on social media: Echo chambers, gate- keepers, and the price of bipartisanship. In Proceedings of the 2018 World Wide Web Conference. 913--922.
[23]
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna M. Wallach, Hal Daumé III, and Kate Crawford. 2018. Datasheets for Datasets. CoRR abs/1803.09010 (2018).
[24]
Maria Glenski, Emily Saldanha, and Svitlana Volkova. 2019. Characterizing speed and scale of cryptocurrency discussion spread on reddit. In The World Wide Web Conference. 560--570.
[25]
Jürgen Habermas. 1984. The theory of communicative action. Beacon Press, Boston.
[26]
Keith N Hampton, Harrison Rainie, Weixu Lu, Maria Dwyer, Inyoung Shin, and Kristen Purcell. 2014. Social media and the ?spiral of silence'. PewResearchCenter.
[27]
Natali Helberger. 2019. On the Democratic Role of News Recommenders. Digital Journalism 7, 8 (2019), 993--1012. https://doi.org/10.1080/21670811.2019.1623700 arXiv:https://doi.org/10.1080/21670811.2019.1623700
[28]
Kenneth Joseph, Sarah Shugars, Ryan Gallagher, Jon Green, Alexi Quintana Mathé, Zijian An, and David Lazer. 2021. (Mis)alignment Between Stance Expressed in Social Media Data and Public Opinion Surveys. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).
[29]
Daniel Kreiss. 2021. "Social Media and Democracy: The State of the Field, Prospects for Reform," edited by Nathaniel Persily and Joshua A. Tucker.
[30]
Dilek Küçük and Fazli Can. 2020. Stance detection: A survey. ACM Computing Surveys (CSUR) 53, 1 (2020), 1--37.
[31]
Ravi Kumar, Mohammad Mahdian, and Mary McGlohon. 2010. Dynamics of conversations. In Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. 553--562.
[32]
Jae Kook Lee, Jihyang Choi, Cheonsoo Kim, and Yonghwan Kim. 2014. Social media, network heterogeneity, and opinion polarization. Journal of communication 64, 4 (2014), 702--722.
[33]
Felicia Loecherbach, Judith Moeller, Damian Trilling, and Wouter van Atteveldt. 2020. The Unified Framework of Media Diversity: A Systematic Literature Review. Digital Journalism 8, 5 (2020), 605--642. https://doi.org/10.1080/21670811.2020.1764374 arXiv:https://doi.org/10.1080/21670811.2020.1764374
[34]
Jane Mansbridge. 1999. Everyday talk in the deliberative system. In Deliberative Politics: Essays on Democracy and Disagreement, Stephen Macedo (Ed.). Oxford University Press, 1--211.
[35]
Jane Mansbridge. 2015. A minimalist definition of deliberation. Deliberation and development: Rethinking the role of voice and collective action in unequal societies (2015), 27--50.
[36]
Hugo Mercier and Hélène Landemore. 2012. Reasoning is for arguing: Understanding the successes and failures of deliberation. Political Psychology 33, 2 (2012), 243--258.
[37]
Dat Quoc Nguyen, Thanh Vu, and Anh Tuan Nguyen. 2020. BERTweet: A pre-trained language model for English Tweets. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 9--14.
[38]
Ryosuke Nishi, Taro Takaguchi, Keigo Oka, Takanori Maehara, Masashi Toyoda, Ken-ichi Kawarabayashi, and Naoki Masuda. 2016. Reply trees in twitter: data analysis and branching process models. Social Network Analysis and Mining 6, 1 (2016), 26.
[39]
Debora Nozza, Federico Bianchi, and Dirk Hovy. 2020. What the [mask]? making sense of language-specific BERT models. arXiv preprint arXiv:2003.02912 (2020).
[40]
Anna Rogers, Olga Kovaleva, and Anna Rumshisky. 2020. A Primer in BERTology: What We Know About How BERT Works. Transactions of the Association for Computational Linguistics 8 (2020), 842--866. https://doi.org/10.1162/tacl_a_00349
[41]
Robin Schaefer and Manfred Stede. 2021. Argument Mining on Twitter: A survey. it-Information Technology 63, 1 (2021), 45--58.
[42]
Indira Sen, Fabian Flöck, and Claudia Wagner. 2020. On the reliability and validity of detecting approval of political actors in tweets. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1413--1426.
[43]
Sarah Shugars and Nicholas Beauchamp. 2019. Why keep arguing? Predicting engagement in political conversations online. Sage Open 9, 1 (2019), 2158244019828850.
[44]
Cass Sunstein and Cass R Sunstein. 2018. # Republic. Princeton university press.
[45]
Rebekah Tromble. 2018. Thanks for (actually) responding! How citizen demand shapes politicians' interactive practices on Twitter. New media & society 20, 2 (2018), 676--697.
[46]
Rebekah Tromble and Michael Meffert. 2016. The life and death of frames: Dynamics of media frame duration. International Journal of Communication 10 (2016), 23.
[47]
Rebekah Tromble and Miriam Wouters. 2015. Are We Talking with or past One Another? Examining Transnational Political Discourse across Western- Muslim "Divides". International Studies Quarterly 59, 2 (2015), 373--386. https://doi.org/10.1111/isqu.12167
[48]
Sanne Vrijenhoek, Mesut Kaya, Nadia Metoui, Judith Möller, Daan Odijk, and Natali Helberger. 2021. Recommenders with a mission: assessing diversity in news recommendations. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. 173--183.
[49]
Xingshan Zeng, Jing Li, Lu Wang, Nicholas Beauchamp, Sarah Shugars, and Kam-Fai Wong. 2018. Microblog conversation recommendation via joint modeling of topics and discourse. In Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 375--385.

Cited By

View all
  • (2024)RADio* – An Introduction to Measuring Normative Diversity in News RecommendationsACM Transactions on Recommender Systems10.1145/36364653:1(1-29)Online publication date: 2-Aug-2024
  • (2024)Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language TechnologyProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659017(1926-1939)Online publication date: 3-Jun-2024
  • (2024)Capturing the Viewpoint Dynamics in the News DomainKnowledge Engineering and Knowledge Management10.1007/978-3-031-77792-9_2(18-34)Online publication date: 25-Nov-2024
  • Show More Cited By

Index Terms

  1. Beyond Digital "Echo Chambers": The Role of Viewpoint Diversity in Political Discussion

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining
    February 2023
    1345 pages
    ISBN:9781450394079
    DOI:10.1145/3539597
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 February 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Twitter
    2. conversation network
    3. echo chambers
    4. viewpoint diversity

    Qualifiers

    • Research-article

    Funding Sources

    • Twitter, Inc.

    Conference

    WSDM '23

    Acceptance Rates

    Overall Acceptance Rate 498 of 2,863 submissions, 17%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)112
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)RADio* – An Introduction to Measuring Normative Diversity in News RecommendationsACM Transactions on Recommender Systems10.1145/36364653:1(1-29)Online publication date: 2-Aug-2024
    • (2024)Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language TechnologyProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659017(1926-1939)Online publication date: 3-Jun-2024
    • (2024)Capturing the Viewpoint Dynamics in the News DomainKnowledge Engineering and Knowledge Management10.1007/978-3-031-77792-9_2(18-34)Online publication date: 25-Nov-2024
    • (2023)Shards of Knowledge – Modeling Attributions for Event-Centric Knowledge GraphsConceptual Modeling10.1007/978-3-031-47262-6_14(259-276)Online publication date: 6-Nov-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media