Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3616855.3635785acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Likelihood-Based Methods Improve Parameter Estimation in Opinion Dynamics Models

Published: 04 March 2024 Publication History

Abstract

We show that a maximum likelihood approach for parameter estimation in agent-based models (ABMs) of opinion dynamics outperforms the typical simulation-based approach. Simulation-based approaches simulate the model repeatedly in search of a set of parameters that generates data similar enough to the observed one. In contrast, likelihood-based approaches derive a likelihood function that connects the unknown parameters to the observed data in a statistically principled way. We compare these two approaches on the well-known bounded-confidence model of opinion dynamics.
We do so on three realistic scenarios of increasing complexity depending on data availability: (i) fully observed opinions and interactions, (ii) partially observed interactions, (iii) observed interactions with noisy proxies of the opinions. To realize the likelihood-based approach, we first cast the model into a probabilistic generative guise that supports a proper data likelihood. Then, we describe the three scenarios via probabilistic graphical models and show the nuances that go into translating the model. Finally, we implement such models in an automatic differentiation framework, thus enabling easy and efficient maximum likelihood estimation via gradient descent. These likelihood-based estimates are up to 4× more accurate and require up to \timeratio× less computational time.

References

[1]
Mart'in Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467 (2016).
[2]
Rediet Abebe, Jon Kleinberg, David Parkes, and Charalampos E Tsourakakis. 2018. Opinion dynamics with varying susceptibility to persuasion. In 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1089--1098.
[3]
Lucila G Alvarez-Zuzek, Cristian E La Rocca, José R Iglesias, and Lidia A Braunstein. 2017. Epidemic spreading in multiplex networks influenced by opinion exchanges on vaccination. PloS one, Vol. 12, 11 (2017), e0186492.
[4]
Li An, Volker Grimm, Abigail Sullivan, BL Turner Ii, Nicolas Malleson, Alison Heppenstall, Christian Vincenot, Derek Robinson, Xinyue Ye, Jianguo Liu, et al. 2021. Challenges, tasks, and opportunities in modeling agent-based complex systems. Ecological Modelling, Vol. 457 (2021), 109685.
[5]
Gaurav Arya, Moritz Schauer, Frank Sch"afer, and Christopher Rackauckas. 2022. Automatic differentiation of programs with discrete randomness. Advances in Neural Information Processing Systems, Vol. 35 (2022), 10435--10447.
[6]
Chris Bail. 2021. Breaking the Social Media Prism: How to Make Our Platforms Less Polarizing. Princeton University Press.
[7]
Sylvain Barde. 2016. Direct comparison of agent-based models of herding in financial markets. Journal of Economic Dynamics and Control, Vol. 73 (2016), 329--353.
[8]
Fabian Baumann, Philipp Lorenz-Spreen, Igor M Sokolov, and Michele Starnini. 2021. Emergence of polarized ideological opinions in multidimensional topic spaces. Physical Review X, Vol. 11, 1 (2021), 011012.
[9]
Marco Benedetti, Gennaro Catapano, Francesco De Sclavis, Marco Favorito, Aldo Glielmo, Davide Magnanimi, and Antonio Muci. 2022. Black-it: A Ready-to-Use and Easy-to-Extend CalibrationKit for Agent-based Models. Journal of Open Source Software, Vol. 7, 79 (Nov. 2022), 4622.
[10]
Nikita Bhalla, Adam Lechowicz, and Cameron Musco. 2023. Local edge dynamics and opinion polarization. In 16th ACM International Conference on Web Search and Data Mining. 6--14.
[11]
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang. 2018. JAX: composable transformations of PythonNumPy programs. http://github.com/google/jax
[12]
Uthsav Chitra and Christopher Musco. 2020. Analyzing the impact of filter bubbles on social network polarization. In 13th International Conference on Web Search and Data Mining. 115--123.
[13]
Ayush Chopra, Alexander Rodr'iguez, Jayakumar Subramanian, Balaji Krishnamurthy, B Aditya Prakash, and Ramesh Raskar. 2022. Differentiable Agent-based Epidemiology. arXiv:2207.09714 (2022).
[14]
Matteo Cinelli, Gianmarco De Francisci Morales, Alessandro Galeazzi, Walter Quattrociocchi, and Michele Starnini. 2021. The Echo Chamber Effect on Social Media. PNAS, Vol. 118, 9 (2021), e2023301118.
[15]
Kyle Cranmer, Johann Brehmer, and Gilles Louppe. 2020. The frontier of simulation-based inference. PNAS, Vol. 117, 48 (2020), 30055--30062.
[16]
Henrique Ferraz de Arruda, Felipe Maciel Cardoso, Guilherme Ferraz de Arruda, Alexis R Hernández, Luciano da Fontoura Costa, and Yamir Moreno. 2022. Modelling how social network algorithms can influence opinion polarization. Information Sciences, Vol. 588 (2022), 265--278.
[17]
Guillaume Deffuant, David Neau, Frederic Amblard, and Gérard Weisbuch. 2000. Mixing beliefs among interacting agents. Advances in Complex Systems, Vol. 3, 01n04 (2000), 87--98.
[18]
Wen Dong. 2016. Variational inference with agent-based models. arXiv:1605.04360 (2016).
[19]
Joel Dyer, Patrick Cannon, J Doyne Farmer, and Sebastian Schmon. 2022. Black-box Bayesian inference for economic agent-based models. arXiv:2202.00625 (2022).
[20]
Giorgio Fagiolo, Mattia Guerini, Francesco Lamperti, Alessio Moneta, and Andrea Roventini. 2019. Validation of agent-based models in economics and finance. In Computer simulation validation. Springer, 763--787.
[21]
Ben G Fitzpatrick. 2019. Issues in reproducible simulation research. Bulletin of mathematical biology, Vol. 81 (2019), 1--6.
[22]
Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying Controversy on Social Media. ACM Transactions on Social Computing, Vol. 1, 1 (2018), 3.
[23]
Jakob Grazzini, Matteo G Richiardi, and Mike Tsionas. 2017. Bayesian estimation of agent-based models. Journal of Economic Dynamics and Control, Vol. 77 (2017), 26--47.
[24]
C Marijn Hazelbag, Jonathan Dushoff, Emanuel M Dominic, Zinhle E Mthombothi, and Wim Delva. 2020. Calibration of individual-based models to epidemiological data: A systematic review. PLoS computational biology, Vol. 16, 5 (2020), e1007893.
[25]
Mira Kattwinkel and Peter Reichert. 2017. Bayesian parameter inference for individual-based models using a Particle Markov Chain Monte Carlo method. Environmental modelling & software, Vol. 87 (2017), 110--119.
[26]
Ladislav Kocis and William J Whiten. 1997. Computational investigations of low-discrepancy sequences. ACM Transactions on Mathematical Software (TOMS), Vol. 23, 2 (1997), 266--294.
[27]
Ulrich Krause. 2000. A discrete nonlinear and non-autonomous model of consensus formation. Communications in difference equations, Vol. 2000 (2000), 227--236.
[28]
Jiri Kukacka and Jozef Barunik. 2017. Estimation of financial agent-based models with simulated maximum likelihood. Journal of Economic Dynamics and Control, Vol. 85 (2017), 21--45.
[29]
Francesco Lamperti. 2018. An information theoretic criterion for empirical validation of simulation models. Econometrics and Statistics, Vol. 5 (2018), 83--106.
[30]
Francesco Lamperti, Andrea Roventini, and Amir Sani. 2018. Agent-based model calibration using machine learning surrogates. Journal of Economic Dynamics and Control, Vol. 90 (2018), 366--389.
[31]
Jun Lang, Wesley W Erickson, and Zhuo Jing-Schmidt. 2021. # MaskOn!# MaskOff! Digital polarization of mask-wearing in the United States during COVID-19. PloS one, Vol. 16, 4 (2021), e0250817.
[32]
Ju-Sung Lee, Tatiana Filatova, Arika Ligmann-Zielinska, Behroexoz Hassani-Mahmooei, Forrest Stonedahl, Iris Lorscheid, Alexey Voinov, J Gareth Polhill, Zhanli Sun, and Dawn C Parker. 2015. The complexities of agent-based modeling output analysis. Journal of Artificial Societies and Social Simulation, Vol. 18, 4 (2015).
[33]
Alexander K Lew, Mathieu Huot, Sam Staton, and Vikash K Mansinghka. 2023. ADEV: Sound automatic differentiation of expected values of probabilistic programs. ACM on Programming Languages, Vol. 7, POPL (2023), 121--153.
[34]
Jan Lorenz. 2007. Continuous opinion dynamics under bounded confidence: A survey. International Journal of Modern Physics C, Vol. 18, 12 (2007), 1819--1838.
[35]
Thomas Lux. 2021. Bayesian estimation of agent-based models via adaptive particle Markov chain Monte Carlo. Computational Economics (2021), 1--27.
[36]
Thomas Lux. 2023. Sequential Monte Carlo Squared for Agent-Based Models. In Artificial Intelligence, Learning and Computation in Economics and Finance. Springer, 59--69.
[37]
Thomas Lux and Remco CJ Zwinkels. 2018. Empirical validation of agent-based models. In Handbook of computational economics. Vol. 4. Elsevier, 437--488.
[38]
Corrado Monti, Luca Maria Aiello, Gianmarco De Francisci Morales, and Francesco Bonchi. 2022. The language of opinion change on social media under the lens of communicative action. Scientific Reports, Vol. 12, 1 (Oct. 2022), 17920.
[39]
Corrado Monti, Gianmarco De Francisci Morales, and Francesco Bonchi. 2020. Learning opinion dynamics from social traces. In 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 764--773.
[40]
Corrado Monti, Jacopo D'Ignazi, Michele Starnini, and Gianmarco De Francisci Morales. 2023 a. Evidence of Demographic rather than Ideological Segregation in News Discussion on Reddit. In ACM Web Conference 2023. ACM, Austin TX USA, 2777--2786.
[41]
Corrado Monti, Marco Pangallo, Gianmarco De Francisci Morales, and Francesco Bonchi. 2023 b. On learning agent-based models from data. Scientific Reports, Vol. 13, 1 (2023), 9268.
[42]
Cameron Musco, Christopher Musco, and Charalampos E Tsourakakis. 2018. Minimizing polarization and disagreement in social networks. In 2018 world wide web conference. 369--378.
[43]
Eli Pariser. 2011. The filter bubble: What the Internet is hiding from you. penguin UK.
[44]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, Vol. 32 (2019).
[45]
Antonio F Peralta, János Kertész, and Gerardo I niguez. 2022. Opinion dynamics in social networks: From models to data. arXiv:2201.01322 (2022).
[46]
Flavio Petruzzellis, Francesco Bonchi, Gianmarco De Francisci Morales, and Corrado Monti. 2023. On the Relation between Opinion Change and Information Consumption on Reddit. International AAAI Conference on Web and Social Media, Vol. 17 (June 2023), 710--719.
[47]
Donovan Platt. 2020. A comparison of economic agent-based model calibration methods. Journal of Economic Dynamics and Control, Vol. 113 (2020), 103859.
[48]
Donovan Platt. 2022. Bayesian estimation of economic simulation models using neural networks. Computational Economics, Vol. 59, 2 (2022), 599--650.
[49]
Arnau Quera-Bofarull, Ayush Chopra, Anisoara Calinescu, Michael Wooldridge, and Joel Dyer. 2023. Bayesian calibration of differentiable agent-based models. arXiv:2305.15340 (2023).
[50]
Takashi Shiono. 2021. Estimation of agent-based models using Bayesian deep learning approach of BayesFlow. Journal of Economic Dynamics and Control, Vol. 125 (2021), 104082.
[51]
Alina S^irbu, Vittorio Loreto, Vito DP Servedio, and Francesca Tria. 2017. Opinion dynamics: models, extensions and external effects. Participatory sensing, opinions and collective awareness (2017), 363--401.
[52]
Vivek Srikrishnan and Klaus Keller. 2021. Small increases in agent-based model complexity can result in large increases in required calibration data. Environmental Modelling & Software, Vol. 138 (2021), 104978.
[53]
Katarzyna Sznajd-Weron and Jozef Sznajd. 2000. Opinion evolution in closed community. International Journal of Modern Physics C, Vol. 11, 06 (2000), 1157--1165.
[54]
Patricia Ternes, Jonathan A Ward, Alison Heppenstall, Vijay Kumar, Le-Minh Kieu, and Nick Malleson. 2022. Data assimilation and agent-based modelling: towards the incorporation of categorical agent parameters. Open Research Europe, Vol. 1 (2022), 131.
[55]
Carlo M Valensise, Matteo Cinelli, and Walter Quattrociocchi. 2023. The drivers of online polarization: fitting models to data. Information Sciences (2023), 119152.
[56]
Elske van der Vaart, Mark A Beaumont, Alice SA Johnston, and Richard M Sibly. 2015. Calibration and evaluation of individual-based models using Approximate Bayesian Computation. Ecological Modelling, Vol. 312 (2015), 182--190.
[57]
Uri Wilensky and William Rand. 2007. Making models match: Replicating an agent-based model. Journal of Artificial Societies and Social Simulation, Vol. 10, 4 (2007), 2.
[58]
Paul Windrum, Giorgio Fagiolo, and Alessio Moneta. 2007. Empirical validation of agent-based models: Alternatives and prospects. Journal of Artificial Societies and Social Simulation, Vol. 10, 2 (2007), 8.
[59]
Zhen Xu, Wen Dong, and Sargur N Srihari. 2016. Using social dynamics to make individual predictions: variational inference with a stochastic kinetic model. Advances in Neural Information Processing Systems, Vol. 29 (2016). io

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
WSDM '24: Proceedings of the 17th ACM International Conference on Web Search and Data Mining
March 2024
1246 pages
ISBN:9798400703713
DOI:10.1145/3616855
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 March 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. agent-based models
  2. maximum likelihood
  3. opinions dynamics
  4. probabilistic modeling
  5. social media

Qualifiers

  • Research-article

Conference

WSDM '24

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 165
    Total Downloads
  • Downloads (Last 12 months)165
  • Downloads (Last 6 weeks)9
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media