research-article

How to Open an Interaction Between Robot and Museum Visitor?: Strategies to Establish a Focused Encounter in HRI

Authors:

Raphaela Gehle,

Sebastian WredeAuthors Info & Claims

HRI '17: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

Pages 187 - 195

https://doi.org/10.1145/2909824.3020219

Published: 06 March 2017 Publication History

Abstract

On the basis of a video corpus of human-robot-interaction in a museum guide scenario, we address the challenge how a robot could determine the appropriate moment of opening an interaction with a visitor. Considering such "openings" as a stepwise coordinated process, we used a wizard-of-oz setup to investigate the wizard's timely decisions about when to look at the visitor resp. to verbally greet him/her (during early stages called "pre-beginnings"). Analysis is based on both robot internal and external data and combines qualitative sequential case analysis and quantification. Analysis reveals features for classification of two visitors types and corresponding opening strategies.

References

[1]

D. Bohus, E. Horvitz, Learning to predict engagement with a spoken dialog system in open-world settings, Proceedings of the SIGDIAL 2009, pp. 244--252

Digital Library

[2]

T. Dankert, M. Goerlich, S. Wrede, R. Gehle, K. Pitsch, Engagement detection during deictic references in human robot interaction. International Conference on Social Robotics (ICSR 2016), pp. 930 - 939

[3]

Elan Annotation Software: https://tla.mpi.nl/tools/tla-tools/elan/

[4]

R. Gehle, K. Pitsch, T. Dankert, S. Wrede, Trouble-based group dynamics in real-world HRI - Reactions on unexpected next moves of a museum guide robot. 24th International Symposium on Robot and Human Interactive Communication (Ro-MAN 2015), Kobe, Japan, pp. 407--412

[5]

E. Goffman, Behavior in public places. Notes on the Social Organization of Gathering, Free Press, 1967.

[6]

E. Goffman, Encounters. Two studies in the sociology of interaction, The Advanced Studies in Social Sciences, Indianapolis, 1967.

[7]

P. Holthaus, K. Pitsch, S. Wachsmuth, How Can I Help? - Spatial Attention Strategies for a Receptionist Robot, International Journal of Social Robotics 3(4):383 - 393, 2012.

[8]

Y. Kato, T. Kanda, H. Ishiguro, May I help you? - Design of human-like polite approaching behavior, HRI 2015, 2015, pp. 35--42.

Digital Library

[9]

A. Kendon, Some functions of gaze direction in two-person conversations, A. Kendon (Ed), Conducting Interaction. Patterns of Behavior in Focused Encounters, 1990.

[10]

L. Mondada, Emergent focused interactions in public places: A systematic analysis of the multimodal achievement of a common interactional space, Journal of Pragmatics, 2008, pp. 1977--1997.

[11]

L. Mondada, R. Schmitt, Zur Multimodalitat von Situationseröffnungen, in L. Mondada, R. Schmitt (Eds.) Situationseröffnungen: Zur Multimodalen Herstellung Fokussierter Interaktion, Studien zur Deutschen Sprache, 2010, pp. 7--52.

[12]

A. Mortensen, S. Hazel, Moving into interaction - Social practices for initiating encounters at a help desk, Journal of Pragmatics, 2014, pp. 46--67.

[13]

Nao Robot: www.aldebaran.com

[14]

S. Sheiki, J.-M. Odobez, Recognizing the visual focus of attention for human robot interaction, in HBU, 2012, pp. 99--112.

Digital Library

[15]

K. Pitsch, H. Kuzuoka, Y. Suzuki, L. Süssenbach, P. Luff, C. Heath, "The first five seconds": Contingent stepwise entry into an interaction as a means to secure sustained engagement in HRI, 18th International Symposium on Robot and Human Interactive Communication (Ro-MAN 2009), Toyama, Japan, 2009, pp. 985--991.

[16]

K. Pitsch, K. S. Lohan, K. Rohlfing, J. Saunders, C. L. Nehaniv, B. Wrede, Better be reactive at the beginning. Implications of the first seconds of an encounter for the tutoring style in human-robot- interaction. 21th International Symposium on Robot and Human Interactive Communication (Ro-MAN 2012), Paris, France, pp. 974 - 981.

[17]

K. Pitsch, R. Gehle, S. Wrede, Addressing multiple participants. A museum guide robot's gaze shapes visitor participation, ICSR 2013, Bristol, UK, 587--588.

[18]

K. Pitsch, Ko-Konstruktion in der Mensch-Roboter-Interaktion. Kontingenz, Erwartungen und Routinen der Eröffnung, in U. Dausendschön-Gay, E. Gülich, U. Kraft (Eds.): Ko-Konstruktion als interaktive Verfahren, Bielefeld, Benjamins, 2015, pp. 229--257.

[19]

K. Pitsch, Limits and Opportunities for Mathematizing Communicational Conduct for Social Robotics in the Real-World? - Towards enabling a Robot to make use of the Human's Competences, AI & Society, 2015, pp. 1--7.

Digital Library

[20]

W. Quan, H. Niwa, N. Ishikawa, Y. Kobayashi, Y. Kuno, Assisted-care robot based on sociological interaction analysis. Computers in Human Behavior, 27(5), 2011, pp. 1527--1534.

Digital Library

[21]

G. Rashed, R. Suzuki, T. Kikugawa, A. Lam, Y. Kobayashi, Y. Kuno, Network guide robot system proactively initiating interaction with humans based on their local and global behaviors, ICIC 2015, Switzerland 2015, pp. 283--294

[22]

E.A. Schegloff, Sequencing in Conversational Openings, American Anthropologist, Volume 70, Issue 6, 1968, pp. 1075 - 1095

[23]

L. Schillingmann and Y. Nagai, Yet another gaze detector: An embodied calibration free system for the iCub robot, RAS 2015, pp. 8--13.

[24]

C. Shi, M. Shiomi, T. Kanda, H. Ishiguro, N. Hagita, Measuring communication participation to initiate conversation in human-robot interaction, Journal of Social Robotics: 7, 2015, pp. 889--910.

[25]

J. Sidnell, T. Stivers, The handbook of conversation analysis, in Blackwell Handbooks of Linguistics, Wiley, 2012.

[26]

K. Yamazaki, M. Kawashima, Y. Kuno, N. Akiya, M. Burdelski, A. Yamazaki, H. Kuzuoka, Prior-to-request and request behaviors within elderly day care: Implications for developing service robots for use in multiparty settings. In ECSCW 2007, pages 61--78.

[27]

A. Yamazaki, K. Yamazaki, M. Okada, Y. Kuno, Y. Kobayashi, Y. Hoshi, K. Pitsch, P. Luff, D. vom Lehn, C. Heath, Revealing Gauguin: Engaging visitors in robot guide's explanation in an art museum, CHI 2009, pp. 1437 - 1446

Digital Library

[28]

A. Yamazaki, K. Yamazaki, T. Ohyama, Y. Kobayashi, Y. Kuno, A techno-sociological solution for designing a museum guide robot: Regarding choosing an appropriate visitor, HRI 2012, Boston, Massachusetts, USA, 2012, pp. 309--316.

Digital Library

[29]

M.A. Yousuf, Y. Kobayashi, Y. Kuno, A. Yamazaki, K.Yamazaki, How to move towards visitors: A model for museum guide robots to initiate conversation. In RO-MAN, 2013 IEEE

Cited By

Wakabayashi HHiroi YMiyawaki KIto A(2024)Development of a Personal Guide Robot That Leads a Guest Hand-in-Hand While Keeping a DistanceSensors10.3390/s2407234524:7(2345)Online publication date: 7-Apr-2024
https://doi.org/10.3390/s24072345
Erel HOberlender AKhatib JFreund NSadeh OWaksberg JCarsenti EGrollman DBroadbent EJu WSoh HWilliams T(2024)The Power of Opening Encounters in HRI: How Initial Robotic Behavior Shapes the Interaction that FollowsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634996(203-212)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634996
Pan XDoering MKanda TGrollman DBroadbent EJu WSoh HWilliams T(2024)What Is Your Other Hand Doing, Robot? A Model of Behavior for Shopkeeper Robot's Idle HandProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634986(552-560)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634986
Show More Cited By

Index Terms

How to Open an Interaction Between Robot and Museum Visitor?: Strategies to Establish a Focused Encounter in HRI
1. General and reference
  1. Cross-computing tools and techniques
    1. Empirical studies
2. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design

Recommendations

Museum guide robot based on sociological interaction analysis
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We are currently working on a museum guide robot with an emphasis on "friendly" human-robot interaction displayed through nonverbal behaviors. In this paper, we focus on head gestures during explanations of exhibits. The outline of our research is as ...
Signaling trouble in robot-to-group interaction.emerging visitor dynamics with a museum guide robot.
HAI '14: Proceedings of the second international conference on Human-agent interaction

Once a museum guide robot is deployed in the real world, it is faced with the difficulty to deal with user utterances within a noisy environment. We present explorative analysis of the ways in which visitors signal trouble on a multimodal level when ...
Enhancing Blind Visitor’s Autonomy in a Science Museum Using an Autonomous Navigation Robot
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Enabling blind visitors to explore museum floors while feeling the facility’s atmosphere and increasing their autonomy and enjoyment are imperative for giving them a high-quality museum experience. We designed a science museum exploration system for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '17: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

March 2017

510 pages

ISBN:9781450343367

DOI:10.1145/2909824

General Chairs:
Bilge Mutlu
University of Wisconsin-Madison, USA
,
Manfred Tscheligi
University of Salzburg, Austria
,
Program Chairs:
Astrid Weiss
Vienna University of Technology, Austria
,
James E. Young
University of Manitoba, Canada

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

CITEC (EXC 277) Bielefeld University
CorLab Bielefeld University
Volkswagen Foundation

Conference

HRI '17

Sponsor:

SIGAI
SIGCHI
IEEE-RAS

HRI '17: ACM/IEEE International Conference on Human-Robot Interaction

March 6 - 9, 2017

Vienna, Austria

Acceptance Rates

HRI '17 Paper Acceptance Rate 51 of 211 submissions, 24%;

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
796
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)5

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wakabayashi HHiroi YMiyawaki KIto A(2024)Development of a Personal Guide Robot That Leads a Guest Hand-in-Hand While Keeping a DistanceSensors10.3390/s2407234524:7(2345)Online publication date: 7-Apr-2024
https://doi.org/10.3390/s24072345
Erel HOberlender AKhatib JFreund NSadeh OWaksberg JCarsenti EGrollman DBroadbent EJu WSoh HWilliams T(2024)The Power of Opening Encounters in HRI: How Initial Robotic Behavior Shapes the Interaction that FollowsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634996(203-212)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634996
Pan XDoering MKanda TGrollman DBroadbent EJu WSoh HWilliams T(2024)What Is Your Other Hand Doing, Robot? A Model of Behavior for Shopkeeper Robot's Idle HandProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634986(552-560)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634986
Pelikan HReeves SCantarutti MGrollman DBroadbent EJu WSoh HWilliams T(2024)Encountering Autonomous Robots on Public StreetsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634936(561-571)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634936
Maniscalco UMinutolo AStorniolo PEsposito M(2024)Towards a more anthropomorphic interaction with robots in museum settings: An experimental studyRobotics and Autonomous Systems10.1016/j.robot.2023.104561171(104561)Online publication date: Jan-2024
https://doi.org/10.1016/j.robot.2023.104561
Mlynář Jde Rijk LLiesenfeld AStommel WAlbert S(2024)AI in situated action: a scoping review of ethnomethodological and conversation analytic studiesAI & SOCIETY10.1007/s00146-024-01919-xOnline publication date: 4-Jun-2024
https://doi.org/10.1007/s00146-024-01919-x
Due B(2023)A Walk in the Park With Robodog: Navigating Around Pedestrians Using a Spot Robot as a “Guide Dog”Space and Culture10.1177/12063312231159215Online publication date: 6-Mar-2023
https://doi.org/10.1177/12063312231159215
Pelikan HCastellano GRiek LCakmak MLeite I(2023)Robot Sound-In-InteractionCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3579975(754-756)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3579975
Fischer K(2023) Defining Interaction as Coordination Benefits both HRI Research and Robot Development: Entering Service Interactions * 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309642(213-219)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309642
Eisenmann CMlynář JTurowetz JRawls A(2023)“Machine Down”: making sense of human–computer interaction—Garfinkel’s research on ELIZA and LYRIC from 1967 to 1969 and its contemporary relevanceAI & SOCIETY10.1007/s00146-023-01793-zOnline publication date: 21-Nov-2023
https://doi.org/10.1007/s00146-023-01793-z
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents