poster

Capabilities and Constraints: Modelling what Human and AI Agents Can and Can't Change

Authors:

Naia Kamawar-MacLeod,

David ThueAuthors Info & Claims

HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction

Pages 417 - 419

https://doi.org/10.1145/3687272.3690902

Published: 24 November 2024 Publication History

Abstract

With Artificial Intelligence (AI) agents becoming more commonplace across the systems that we use every day, it is becoming increasingly important to document and convey the capabilities and constraints of these agents as interactive partners. In this paper, we extend our existing method for modelling interactive systems to facilitate recording and visualizing several key aspects of human-agent interaction. These include what elements of a system can be changed, who (or what) can observe or change them, who (or what) is able to change the system’s constraints, and more.

References

[1]

Abdurrahman Alshareef, Doohwan Kim, Chungman Seo, and Bernard P. Zeigler. 2020. Activity diagrams between devs-based modeling & simulation and fuml-based model execution. In Proceedings of the 2020 Summer Simulation Conference (Virtual Event, Spain) (SummerSim ’20). Society for Computer Simulation International, San Diego, CA, USA, Article 32, 12 pages.

Digital Library

[2]

Omran Ayoub, Sebastian Troia, Davide Andreoletti, Andrea Bianco, Massimo Tornatore, Silvia Giordano, and Cristina Rottondi. 2022. Towards explainable artificial intelligence in optical networks: The use case of lightpath QOT estimation. Journal of Optical Communications and Networking 15, 1 (Nov 2022). https://doi.org/10.1364/jocn.470812

[3]

Michael Booth. 2009. Replayable Cooperative Game Design: Left 4 Dead. (2009). GDC 2009.

[4]

John Joon Young Chung, Shiqing He, and Eytan Adar. 2022. Artist Support Networks: Implications for Future Creativity Support Tools. In Proceedings of the 2022 ACM Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 232–246. https://doi.org/10.1145/3532106.3533505

Digital Library

[5]

Christopher Dragert, Jörg Kienzle, and Clark Verbrugge. 2011. Toward high-level reuse of statechart-based AI in computer games. In Proceedings of the 1st International Workshop on Games and Software Engineering (Waikiki, Honolulu, HI, USA) (GAS ’11). Association for Computing Machinery, New York, NY, USA, 25–28. https://doi.org/10.1145/1984674.1984684

Digital Library

[6]

Jodi Forlizzi and Katja Battarbee. 2004. Understanding experience in interactive systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (Cambridge, MA, USA) (DIS ’04). Association for Computing Machinery, New York, NY, USA, 261–268. https://doi.org/10.1145/1013115.1013152

Digital Library

[7]

Jay Wright Forrester. 1968. Principles of Systems. Pegasus Communications, Inc.

[8]

Daniel Friesel and Olaf Spinczyk. 2022. Black-box models for non-functional properties of AI software systems. In Proceedings of the 1st International Conference on AI Engineering: Software Engineering for AI (Pittsburgh, Pennsylvania) (CAIN ’22). Association for Computing Machinery, New York, NY, USA, 170–180. https://doi.org/10.1145/3522664.3528602

Digital Library

[9]

Anirban I. Ghosh, Radhika Sharma, Karan Goyal, Balakarthikeyan Rajan, and Senthil Mani. 2023. Health Assurance: AI Model Monitoring Platform. In Proceedings of the Second International Conference on AI-ML Systems (Bangalore, India) (AIMLSystems ’22). Association for Computing Machinery, New York, NY, USA, Article 21, 7 pages. https://doi.org/10.1145/3564121.3564798

Digital Library

[10]

Steffen Holter and Mennatallah El-Assady. 2024. Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation. Computer Graphics forum 43, 3 (2024).

[11]

Leslie Pack Kaelbling, Michael L. Littman, and Anthony R. Cassandra. 1998. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101, 1 (1998), 99–134. https://doi.org/10.1016/S0004-3702(98)00023-X

Digital Library

[12]

Naia Kamawar-MacLeod and David Thue. 2024. The Interactive Process Modeller: A Tool for Modelling Inter-Agent Relationships in an Interactive System. In International Conference on Human-Agent Interaction (HAI ’24), November 24–27, 2024, Swansea, United Kingdom. ACM, New York, NY, USA, 3. https://doi.org/10.1145/3687272.3690871

Digital Library

[13]

Christian Kästner and Eunsuk Kang. 2020. Teaching software engineering for AI-enabled systems. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training (Seoul, South Korea) (ICSE-SEET ’20). Association for Computing Machinery, New York, NY, USA, 45–48. https://doi.org/10.1145/3377814.3381714

Digital Library

[14]

Markus Langer, Daniel Oster, Timo Speith, Holger Hermanns, Lena Kästner, Eva Schmidt, Andreas Sesing, and Kevin Baum. 2021. What do we want from Explainable Artificial Intelligence (XAI)? – a stakeholder perspective on xai and a conceptual model guiding interdisciplinary XAI research. Artificial Intelligence 296 (Jul 2021). https://doi.org/10.1016/j.artint.2021.103473

[15]

Duri Long and Brian Magerko. 2020. What is AI Literacy? Competencies and Design Considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3313831.3376727

Digital Library

[16]

Duri Long, Sophie Rollins, Jasmin Ali-Diaz, Katherine Hancock, Samnang Nuonsinoeun, Jessica Roberts, and Brian Magerko. 2023. Fostering AI Literacy with Embodiment & Creativity: From Activity Boxes to Museum Exhibits. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 727–731. https://doi.org/10.1145/3585088.3594495

Digital Library

[17]

Prashan Madumal, Tim Miller, Liz Sonenberg, and Frank Vetere. 2019. A Grounded Interaction Protocol for Explainable Artificial Intelligence. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (Montreal QC, Canada) (AAMAS ’19). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 1033–1041.

Digital Library

[18]

Jane Southworth, Kati Migliaccio, Joe Glover, Ja’Net Glover, David Reed, Christopher McCarty, Joel Brendemuhl, and Aaron Thomas. 2023. Developing a model for AI Across the curriculum: Transforming the higher education landscape via innovation in AI literacy. Computers and Education: Artificial Intelligence 4 (2023), 100127. https://doi.org/10.1016/j.caeai.2023.100127

[19]

David Thue. 2020. What Might an Action do? Toward a Grounded View of Actions in Interactive Storytelling. In Interactive Storytelling, Anne-Gwenn Bosser, David E. Millard, and Charlie Hargood (Eds.). Springer International Publishing, Cham, 212–220. https://doi.org/10.1007/978-3-030-62516-0_19

Digital Library

[20]

David Thue. 2021. Supporting the Design of Flexible Game Systems. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Austria) (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA, 216–221. https://doi.org/10.1145/3450337.3484223

Digital Library

[21]

Anna Ulak. 2023. Diagrammatic abstractions: Jay Forrester’s Urban Dynamics and its contribution to architecture and urban planning in the late 1960s and early 1970s. Architectural Histories 11, 1 (Aug 2023). https://doi.org/10.16995/ah.8284

[22]

Valve Corporation. 2008. Left 4 Dead. www.l4d.com.

Cited By

Kamawar-MacLeod NThue D(2024)The Interactive Process Modeller: A Tool for Modelling Inter-Agent Relationships in an Interactive SystemProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690871(329-331)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690871

Index Terms

Capabilities and Constraints: Modelling what Human and AI Agents Can and Can't Change

Recommendations

Human-Autonomy Teaming and Explainable AI Capabilities in RTS Games
Engineering Psychology and Cognitive Ergonomics. Cognition and Design
Abstract
Real-time strategy games often times mimic the appearance and feel of military-like command and control systems. Artificial intelligence and machine learning research enjoys utilizing the environments produced by these games and are often focused ...
What can AI get from neuroscience?
50 years of artificial intelligence

The human brain is the best example of intelligence known, with unsurpassed ability for complex, real-time interaction with a dynamic world. AI researchers trying to imitate its remarkable functionality will benefit by learning more about neuroscience, ...
From ”Explainable AI” to ”Graspable AI”
TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

Since the advent of Artificial Intelligence (AI) and Machine Learning (ML), researchers have asked how intelligent computing systems could interact with and relate to their users and their surroundings, leading to debates around issues of biased AI ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction

November 2024

502 pages

ISBN:9798400711787

DOI:10.1145/3687272

Editors:
Muneeb Imtiaz Ahmad
Swansea University, United Kingdom
,
Katrin Lohan
Eastern Switzerland University
,
Mary Ellen Foster
University of Glasgow, Scotland
,
Patrick Holthaus
University of Hertfordshire, United Kingdom
,
Yukie Nagai
The University of Tokyo, Japan

Copyright © 2024 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2024

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

HAI '24

Sponsor:

SIGCHI

HAI '24: International Conference on Human-Agent Interaction

November 24 - 27, 2024

Swansea, United Kingdom

Acceptance Rates

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
7
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kamawar-MacLeod NThue D(2024)The Interactive Process Modeller: A Tool for Modelling Inter-Agent Relationships in an Interactive SystemProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690871(329-331)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690871

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents