research-article

The Communicative Activity of "Making Suggestions" as an Interactional Process: Towards a Dialog Model for HAI

Authors:

Christiane Opfermann,

Ramin Yaghoubzadeh,

Stefan KoppAuthors Info & Claims

HAI '17: Proceedings of the 5th International Conference on Human Agent Interaction

Pages 161 - 170

https://doi.org/10.1145/3125739.3125752

Published: 27 October 2017 Publication History

Abstract

Dialog modeling of making suggestions in human-agent interaction is a challenge due to the socially delicate nature of a suggestion and ensuing interactional negotiations. A basic first dialog model for making suggestions was tested in the context of schedule management assistance by an embodied conversational agent with elderly and mildly cognitively impaired persons. Analysis showed that users responded according to human social structures with most response types bearing potential challenges concerning the system's language understanding and the users' intention interpretation:next to explicit answers, users produced implicit versions for acceptance or resistance and further requests for information or modifications. Thus, an enhanced dialog model with a newly added clarification sequence and a new multi-conditional entry sequence was tested in a second study with the autonomous system. Initial observations show a promising performance of the dialog model.

References

[1]

Charles Antaki and Ray Wilkinson. 2013. Conversation Analysis and the Study of Atypical Populations. In The Handbook of Conversation Analysis, Jack Sidnell and Tanya Stivers (eds.). Wiley-Blackwell, 533 -- 550.

[2]

Michael Bamberg. 1999. Is there anything behind discourse? Narrative and the local accomplishments of identities. Challenges to theoretical psychology, 220 -- 227.

[3]

Jenay Beer et alii. 2012. The Domesticated Robot:Design Guidelines for Assisting Older Adults to Age in Place. In Proceedings of HRI'12, 335 -- 342.

[4]

Dan Bohus and Alexander Rudnicky. 2009. The RavenClaw dialog management framework:architecture and systems. Computer Speech and Language 23:332 -- 361.

Digital Library

[5]

Elizabeth Couper-Kuhlen. 2014. What does Grammar tell us about Action? Journal of Pragmatics 24, 3:623--647.

[6]

Elizabeth Couper-Kuhlen and Margret Selting. 2001. Introducing Interactional Linguistics. In Studies in Interactional Linguistics, Margret Selting and Elizabeth Couper-Kuhlen (eds.). John Benjamins Publishing Company, Amsterdam, 1 -- 22.

[7]

Paul Dickerson, John Rae, Penny Stribling, Kerstin Dautenhahn, and Iain Werry. 2005. Autistic Children's Co--ordination of Gaze and Talk:Re--examining the 'Asocial' Autist. In Applying Conversation Analysis, Keith Richards and Paul Seedhouse (eds.). Palgrave Macmillan Ltd, 19 -- 3

[8]

Kerstin Fischer. 2010. Why it is interesting to investigate how people talk to computers and robots. Journal of Pragmatics 42:2349 -- 2354.

[9]

Kerstin Fischer. 2011. Interpersonal Variation in Understanding Robots as Social Actors. In Proceedings of HRI'11, 53 -- 60.

Digital Library

[10]

Kerstin Fischer, B. Soto, C. Pantofaru, and L. Takaya-ma. 2014. Initiating Interactions in Order to Get Help:Effects of Social Framing on People's Responses to Robots' Requests for Assistance. In Proceedings RO-MAN 2014, 999 -- 1005.

[11]

1Charles Goodwin (ed.). 2003. Conversation and Brain Damage. Oxford University Press.

[12]

John Heritage. 1984. A change-of-state token and aspects of its sequential placement. In Structures of Social Action. Studies in Conversation Analysis, J. Maxwell Atkinson and John Heritage (eds.). Cambridge University Press, 299--345.

[13]

Hanneke Houtkoop. 1987. Establishing Agreement. An Analysis of Proposal-Acceptance Sequence. Foris Publications.

[14]

Wolfgang Imo. 2009. Konstruktion oder Funktion? Erkenntnisprozessmarker ("change-of-state tokens") im Deutschen. In Grammatik im Gespräch. Konstruktionen der Selbst- und Fremdpositionierung, Susanne Günthner and Jörg Bücker (eds.). Walter de Gruyter, 57--86.

[15]

Kobin H. Kendrick and Paul Drew. 2016. Recruitment:Offers, Requests, and the Organization of Assistance in interaction. Research on Language and Social Interaction 49,1:1 -- 19.

[16]

Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsumori Shimohara, and Norihiro Hagita. 20 Alignment Approach Comparison between Implicit and Explicit Suggestions in Object Reference Conversations. In Proceedings of HAI'16, 193 -- 200.

[17]

Gabriele Lucius-Hoene and Arnulf Deppermann. 2004. Narrative Identität und Positionierung. Gesprächsforschung -- Online-Zeitschrift zur verbalen Interaktion 5 (2004):166 -- 183.

[18]

Tom Muskett, Mick Perkins, Judy Clegg, and Richard Body. 2009. Inflexibility as an interactional phenomenon:Using conversation analysis to re-examine a symptom of autism. Clinical Linguistics & Phonetics, 24, 1:1 -- 16.

[19]

Ziad Nasreddine et alii 2005. The Montreal Cognitive Assessment, MoCA:A Brief Screening Tool for Mild Cognitive Impairment. Journal of the American Geriatrics Society 53:695 -- 699.

[20]

Christiane Opfermann and Karola Pitsch. 2017. Reprompts as Error Handling Strategy in Human-Agent-Dialog? User Responses to a System's Display of Non-understanding. Accepted for RO-MAN 2017.

[21]

2Han-Saem Park and Sung-Bae Cho. 2012. A modular design of Bayesian networks using expert knowledge:Context-aware home service robot. Expert Systems with Applications 39:2629 -- 2642.

Digital Library

[22]

2Martin Pickering and Simon Garrod. 2006. Alignment as the Basis for Successful Communication. Research on Language and Computation 4:203 -- 228.

[23]

Karola Pitsch, Anna-Lisa Vollmer, and Manuel Mühlig. 2013. Robot feedback shapes the tutor's presentation. Interaction Studies 14, 2:268 --296.

[24]

Karola Pitsch, Anna-Lisa Vollmer, Katharina Rohlfing, Jannik Frisch, and Britta Wrede. 2014. Tutoring in adult-child interaction. Interaction Studies 15,1:55 -- 98.

[25]

Martha Pollack. 2005. Intelligent Technology for an Aging Population. AI Magazine 26, 2:9 -- 24.

[26]

Laurel Riek. 2012. Wizard of Oz Studies in HRI:A Systematic Review and New Reporting Guidelines. Journal of Human-Robot Interaction 1, 1:119 -- 136.

Digital Library

[27]

Harvey Sacks. 1987. On the preference for agreement and contiguity in sequences in conversation. In Talk and Social Organisation, Graham Button and John R. E. Lee (eds). Multilingual Matters LTD, Clevedon, England, 54 -- 69.

[28]

Harvey Sacks. 1992. Lectures on Conversation. Blackwell.

[29]

Emanuel A. Schegloff. 2007. Sequence Organization in Interaction. A Primer in Conversation Analysis. Cambridge University Press.

[30]

Margret Selting et al. 2009. Gesprächsanalytisches Transkriptionssystem. In Gesprächsforschung - Online-Zeitschrift zur verbalen Interaktion, 2009, 10:353 -- 402.

[31]

3Jack Sidnell. 2013. Basic Conversation Analytic Methods. In The Handbook of Conversation Analysis, Jack Sidnell and Tanya Stivers (eds.). Wiley-Blackwell, 77 -- 99.

[32]

3Jack Sidnell and Tanya Stivers (eds.). 2013. The Handbook of Conversation Analysis. Wiley-Blackwell.

[33]

3Melisa Stevanovic and Anssi Peräkylä. 2012. Deontic Authority in Interaction:The Right to Announce, Propose, and Decide. Research on Language and Social Interaction 45, 3:297 -- 321.

[34]

Tanya Stivers and Jack Sidnell. 2016. Proposals for Activity Collaboration. Research on Language and Social Interaction 49, 2:148 -- 166.

[35]

Luise Süssenbach, Nina Riether, Sebastian Schneider, Ingmar Berger, Franz Kummert, Ingo Lütkebohle, and Karola Pitsch. 2014. A robot as fitness companion:towards an interactive action-based motivation model. In Proceedings of RO-MAN 2014, 286 -- 293.

[36]

Herwin van Welbergen, Ramin Yaghoubzadeh, and Stefan Kopp. AsapRealizer2.0:The Next Steps in Fluent Behavior Realization for ECAs. In Proceedings of IVA 2014, 449 -- 462.

[37]

3Ray Wilkinson. 2015. Conversation and aphasia:advances in analysis and intervention. Aphasiology, 29, 3:257 -- 268.

[38]

3Yorick Wilks, Jan Jasiewicz, Roberta Catizone, Lucian Galescu, Kristina Martinez, and Deborah Rugs. 2014. CALONIS:An artificial companion within a smart home for the care of cognitively impaired patients. In International Conference on Smart Homes and Health Telematics, 255 -- 260.

[39]

3B. Winblad et alii. 2004. Mild cognitive impairment - beyond controversies, toward a consensus:report of the International Working Group on Mild Cognitive Impairment. Journal of Internal Medicine 2004, 256:240 -- 246.

[40]

Ramin Yaghoubzadeh, Marcel Kramer, Karola Pitsch, and Stefan Kopp. 2013. Virtual agents as daily assistants for elderly or cognitively impaired people. In Proceedings of IVA 2013, 79 -- 91.

[41]

4Ramin Yaghoubzadeh, Hendrik Buschmeier, and Stefan Kopp. 2015. Socially Cooperative Behavior for Artificial Companions for Elderly and Cognitively Impaired People. In Proceedings of the 1st International Symposium on Companion-Technology ISCT 2015, 15 -- 19.

[42]

4Ramin Yaghoubzadeh and Stefan Kopp. 2016. flexdiam -- Flexible Dialogue Management for Incremental Interaction with Virtual Agents. In Proceedings of IVA 2016, 505 -- 508.

[43]

4Yoshinobu Yamamoto, Mitsuru Sato, Kazuo Hiraki, Nobuyuki Yamasaki, and Yuichiro Anzai. 1992. A Request of the Robot:An Experiment with the Human-Robot Interactive System HuRIS. In IEEE International Workshop on Robot and Human Communication, 204 -- 209.

[44]

4Keiichi Yamazaki, Michie Kawashima, Yoshinori Kuni, Naonori Akiya, Matthew Burdelski, Akiko Yamazaki and Hideaki Kuzuoka. 2007. Prior-to-request and request behaviors within elderly day care:Implications for developing service robots for use in multiparty settings. In ECSW'07:Proceedings of the Tenth European Conference on Computer Supported Cooperative Work, 61 -- 78.

Cited By

Mlynář Jde Rijk LLiesenfeld AStommel WAlbert S(2024)AI in situated action: a scoping review of ethnomethodological and conversation analytic studiesAI & SOCIETY10.1007/s00146-024-01919-xOnline publication date: 4-Jun-2024
https://doi.org/10.1007/s00146-024-01919-x
Pelikan HJung MCastellano GRiek LCakmak MLeite I(2023)Designing Robot Sound-In-InteractionProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576979(172-182)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576979
Sin JMunteanu CChen DThreatt J(2022)Avoiding mixed messages: research-based fact-checking the media portrayals of voice user interfaces for older adultsHuman–Computer Interaction10.1080/07370024.2022.209812938:3-4(235-258)Online publication date: 14-Jul-2022
https://doi.org/10.1080/07370024.2022.2098129
Show More Cited By

Index Terms

The Communicative Activity of "Making Suggestions" as an Interactional Process: Towards a Dialog Model for HAI
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Precision timing in human-robot interaction: coordination of head movement and utterance
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

As research over the last several decades has shown that non-verbal actions such as face and head movement play a crucial role in human interaction, such resources are also likely to play an important role in human-robot interaction. In developing a ...
A process model for recognizing communicative acts and modeling negotiation subdialogues

Negotiation is an important part of task-oriented expert-consultation dialogues. This paper presents a plan-based model for understanding cooperative negotiation subdialogues. Our system infers both the communicative actions that people pursue when ...
Some Interactional Functions of Text in a Text-and-Voice SCMC Chat Session for Language Learning

This case study examines the functions of the text mode in a predominantly voice-only SCMC tutoring session. Using conversation analysis with attention paid to the sequential and holistic unfolding of both text and voice turns, the authors found that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HAI '17: Proceedings of the 5th International Conference on Human Agent Interaction

October 2017

550 pages

ISBN:9781450351133

DOI:10.1145/3125739

General Chairs:
Britta Wrede
Bielefeld University, Germany
,
Yukie Nagai
Osaka University, Japan
,
Program Chairs:
Takanori Komatsu
Meiji University, Japan
,
Marc Hanheide
University of Lincoln, UK
,
Lorenzo Natale
Italian Institute of Technology, Italy

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

HAI '17

Sponsor:

SIGCHI

HAI '17: The Fifth International Conference on Human-Agent Interaction

October 17 - 20, 2017

Bielefeld, Germany

Acceptance Rates

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
214
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mlynář Jde Rijk LLiesenfeld AStommel WAlbert S(2024)AI in situated action: a scoping review of ethnomethodological and conversation analytic studiesAI & SOCIETY10.1007/s00146-024-01919-xOnline publication date: 4-Jun-2024
https://doi.org/10.1007/s00146-024-01919-x
Pelikan HJung MCastellano GRiek LCakmak MLeite I(2023)Designing Robot Sound-In-InteractionProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576979(172-182)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576979
Sin JMunteanu CChen DThreatt J(2022)Avoiding mixed messages: research-based fact-checking the media portrayals of voice user interfaces for older adultsHuman–Computer Interaction10.1080/07370024.2022.209812938:3-4(235-258)Online publication date: 14-Jul-2022
https://doi.org/10.1080/07370024.2022.2098129
Kim Kde Melo CNorouzi NBruder GWelch G(2020)Reducing Task Load with an Embodied Intelligent Virtual Assistant for Improved Performance in Collaborative Decision Making2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581084624004(529-538)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.1581084624004
Stigall BWaycott JBaker SCaine K(2019)Older Adults' Perception and Use of Voice User InterfacesProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3369506(423-427)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3369457.3369506
Cyra KPitsch KWrede BNagai YKomatsu THanheide MNatale L(2017)Dealing with Long UtterancesProceedings of the 5th International Conference on Human Agent Interaction10.1145/3125739.3132586(341-345)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3125739.3132586
Opfermann CPitsch K(2017)Reprompts as error handling strategy in human-agent-dialog? User responses to a system's display of non-understanding2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2017.8172319(310-316)Online publication date: Aug-2017
https://doi.org/10.1109/ROMAN.2017.8172319

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents