Algorithmic Authority & AI Influence in Decision Settings: Theories and Implications for Design
Authors: 
Alessandro Facchini, Caterina Fregosi, Chiara Natali, Alberto Termine, Ben WilsonAuthors Info & Claims
Pages 472 - 474
Abstract
This workshop explores the influence of AI systems on human decision-making - algorithmic authority - and the broader concept of technology dominance, which includes both positive and negative impacts of AI reliance. Drawing from diverse fields such as Human-AI Interaction, Sociology, Epistemology, and Cognitive Science, the workshop will discuss theoretical foundations, empirical studies, and design implications of AI’s role in shaping human judgment and behavior. The objectives are to examine in-depth the concepts of algorithmic authority and technology dominance, and identify metrics for their assessment. The workshop aims to foster interdisciplinary collaboration and produce practical design principles that help to counter risks associated to AI technology dominance and thus foster a responsible use of AI systems.
References
[1]
V. Arnold and Steve Sutton. 1998. The theory of technology dominance: Understanding the impact of intelligent decision aids on decision makers’ judgments. Advances in Accounting Behavioral Research 1 (1998), 175–194.
[2]
Alessio Benavoli, Alessandro Facchini, and Marco Zaffalon. 2022. Quantum indistinguishability through exchangeability. International Journal of Approximate Reasoning 151 (2022), 389–412.
[3]
Federico Cabitza, Andrea Campagner, Riccardo Angius, Chiara Natali, and Carlo Reverberi. 2023. AI shall have no dominion: on how to measure technology dominance in AI-supported human decision-making. In Proceedings of the 2023 CHI conference on human factors in computing systems. 1–20.
[4]
Federico Cabitza, Caterina Fregosi, Andrea Campagner, and Chiara Natali. 2024. Explanations Considered Harmful: The Impact of Misleading Explanations on Accuracy in Hybrid Human-AI Decision Making. In World Conference on Explainable Artificial Intelligence. Springer, 255–269.
[5]
Gabriele Dominici, Pietro Barbiero, Mateo Espinosa Zarlenga, Alberto Termine, Martin Gjoreski, and Marc Langheinrich. 2024. Causal Concept Embedding Models: Beyond Causal Opacity in Deep Learning. arXiv preprint arXiv:2405.16507 (2024).
[6]
Alessandro Facchini and Alberto Termine. 2021. Towards a Taxonomy for the Opacity of AI Systems. In Conference on philosophy and theory of artificial intelligence. Springer, 73–89.
[7]
Andrea Ferrario, Alessandro Facchini, and Alberto Termine. 2024. Experts or Authorities? The Strange Case of the Presumed Epistemic Superiority of Artificial Intelligence Systems. Minds and Machines (2024).
[8]
Andrea Ferrario, Alberto Termine, and Alessandro Facchini. 2024. Addressing Social Misattributions of Large Language Models: An HCXAI-based Approach. arXiv preprint arXiv:2403.17873 (2024).
[9]
Lilith Mattei, Alessandro Antonucci, Denis Deratani Mauá, Alessandro Facchini, and Julissa Villanueva Llerena. 2020. Tractable inference in credal sentential decision diagrams. International Journal of Approximate Reasoning 125 (2020), 26–48.
[10]
Chiara Natali 2023. Per Aspera ad Astra, or Flourishing via Friction: Stimulating Cognitive Activation by Design through Frictional Decision Support Systems. In CEUR workshop proceedings, Vol. 3481. 15–19.
[11]
Chiara Natali, Lorenzo Famiglini, Andrea Campagner, Giovanni Andrea La Maida, Enrico Gallazzi, and Federico Cabitza. 2023. Color shadows 2: Assessing the impact of xai on diagnostic decision-making. In World Conference on Explainable Artificial Intelligence. Springer, 618–629.
[12]
Elisa Rubegni, Omran Ayoub, Stefania Maria Rita Rizzo, Marco Barbero, Guenda Bernegger, Francesca Faraci, Francesca Mangili, Emiliano Soldini, Pierpaolo Trimboli, and Alessandro Facchini. 2024. Designing for Complementarity: A Conceptual Framework to Go Beyond the Current Paradigm of Using XAI in Healthcare. In International Conference on Human-Computer Interaction. Springer, 277–296.
[13]
Alberto Termine, Alessandro Antonucci, and Alessandro Facchini. 2023. Machine Learning Explanations by Surrogate Causal Models (MaLESCaMo). In 1th World Conference on eXplainable Artificial Intelligence, XAI 2023, Lisbon, Portugal, July 26-28, 2023, Proceedings (late-breaking works and demos). https://ceur-ws.org/Vol-3554/paper11.pdf
[14]
Alberto Termine, Alessandro Antonucci, Alessandro Facchini, and Giuseppe Primiero. 2021. Robust model checking with imprecise Markov reward models. In International Symposium on Imprecise Probability: Theories and Applications. PMLR, 299–309.
[15]
Alberto Termine, Alessandro Antonucci, Giuseppe Primiero, and Alessandro Facchini. 2021. Logic and model checking by imprecise probabilistic interpreted systems. In Multi-Agent Systems: 18th European Conference, EUMAS 2021, Virtual Event, June 28–29, 2021, Revised Selected Papers 18. Springer, 211–227.
[16]
Alberto Termine, Alessandro Antonucci, Giuseppe Primiero, and Alessandro Facchini. 2023. Imprecise Probabilistic Model Checking for Stochastic Multi-agent Systems. SN Computer Science 4, 5 (2023), 443.
[17]
Alberto Termine, Giuseppe Primiero, and Fabio Aurelio D’Asaro. 2021. Modelling accuracy and trustworthiness of explaining agents. In Logic, Rationality, and Interaction: 8th International Workshop, LORI 2021, Xi’ian, China, October 16-18, 2021, Proceedings 8. Springer, 232–245.
[18]
Ben Wilson, Darren Scott, Matt Roach, Emily Nielsen, and Berndt Müller. 2024. Designing for situated AI-human decision making: Lessons learned from a primary care deployment. Proceedings of the 1st International Workshop on Designing and Building Hybrid Human-AI Systems co-located with 17th International Conference on Advanced Visual Interfaces (AVI 2024) (2024).
Index Terms
- Algorithmic Authority & AI Influence in Decision Settings: Theories and Implications for Design
Recommendations
Towards Design Principles for User-Centric Explainable AI in Fraud Detection
Artificial Intelligence in HCIAbstractExperts rely on fraud detection and decision support systems to analyze fraud cases, a growing problem in digital retailing and banking. With the advent of Artificial Intelligence (AI) for decision support, those experts face the black-box problem ...
Seamful XAI: Operationalizing Seamful Design in Explainable AI
CSCWMistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. While black-boxing AI systems can make the user experience seamless, hiding the seams risks disempowering users to mitigate fallouts from AI mistakes. ...
Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressure
IUI '24: Proceedings of the 29th International Conference on Intelligent User InterfacesIn settings where users both need high accuracy and are time-pressured, such as doctors working in emergency rooms, we want to provide AI assistance that both increases decision accuracy and reduces decision-making time. Current literature focusses on ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2024
502 pages
ISBN:9798400711787
DOI:10.1145/3687272
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 November 2024
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
HAI '24
Sponsor:
HAI '24: International Conference on Human-Agent Interaction
November 24 - 27, 2024
Swansea, United Kingdom
Acceptance Rates
Overall Acceptance Rate 121 of 404 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 16Total Downloads
- Downloads (Last 12 months)16
- Downloads (Last 6 weeks)8
Reflects downloads up to 20 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format