research-article

Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies

Authors:

Pedro Sequeira,

Patrícia Alves-Oliveira,

Eugenio Di Tullio,

Francisco S. Melo,

Ginevra Castellano,

Ana PaivaAuthors Info & Claims

HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Pages 197 - 204

Published: 07 March 2016 Publication History

Abstract

In this paper we propose a methodology for the creation of social interaction strategies for human-robot interaction based on restricted-perception Wizard-of-Oz studies (WoZ). This novel experimental technique involves restricting the wizard's perceptions over the environment and the behaviors it controls according to the robot's inherent perceptual and acting limitations. Within our methodology, the robot's design lifecycle is divided into three consecutive phases, namely data collection, where we perform interaction studies to extract expert knowledge and interaction data; strategy extraction, where a hybrid strategy controller for the robot is learned based on the gathered data; strategy refinement, where the controller is iteratively evaluated and adjusted. We developed a fully-autonomous robotic tutor based on the proposed approach in the context of a collaborative learning scenario. The results of the evaluation study show that, by performing restricted-perception WoZ studies, our robots are able to engage in very natural and socially-aware interactions.

References

[1]

C. Breazeal, Designing Sociable Robots. MIT Press, 2004.

[2]

C.-M. Huang and B. Mutlu, "Robot behavior toolkit: generating effective social behaviors for robots," in Proc. 7th annual ACM/IEEE Int. Conf. on Human-Robot Interaction. ACM, 2012, pp. 25--32.

[3]

B. D. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration," Robotics and Autonomous Systems, vol. 57, no. 5, pp. 469--483, May 2009.

Digital Library

[4]

P. H. Kahn, N. G. Freier, T. Kanda, H. Ishiguro, J. H. Ruckert, R. L. Severson, and S. K. Kane, "Design patterns for sociality in human-robot interaction," in Proc. 3rd Int. Conf. Human Robot Int., 2008, pp. 97--104.

[5]

L. Riek, "Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines," Journal of Human-Robot Interaction, vol. 1, no. 1, pp. 119--136, 2012.

Digital Library

[6]

W. B. Knox, S. Spaulding, and C. Breazeal, "Learning social interaction from the wizard: A proposal," in Workshops at 28th AAAI Conf. on Artificial Intelligence, 2014.

[7]

A. Steinfeld, O. C. Jenkins, and B. Scassellati, "The Oz of Wizard: Simulating the Human for Interaction Research," in Proc. 4th ACM/IEEE Int. Conf. on Human-Robot Interaction, 2009, pp. 101--107.

Digital Library

[8]

G. Castellano, A. Paiva, A. Kappas, R. Aylett, H. Hastie, W. Barendregt, F. Nabais, and S. Bull, "Towards empathic virtual and robotic tutors," in Artificial Intelligence in Education, ser. Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2013, vol. 7926, pp. 733--736.

[9]

P. Sequeira, F. S. Melo, and A. Paiva, "Let's Save Resources!": A Dynamic, Collaborative AI for a Multiplayer Environmental Awareness Game," in Prc. IEEE Conf. Comp. Intel. and Games, 2015, pp. 399--406.

[10]

E. Knol and P. De Vries, "EnerCities: Educational Game about Energy," in Proc. Central Europe towards Sust. Building, 2010, pp. 12--15.

[11]

C. Bartneck and J. Hu, "Rapid prototyping for interactive robots," in The 8th Conf. on intelligent autonomous systems (IAS-8), 2004, pp. 136--145.

[12]

J. F. Kelley, "An iterative design methodology for user-friendly natural language office information applications," ACM Transactions on Information Systems, vol. 2, no. 1, pp. 26--41, Jan. 1984.

Digital Library

[13]

P. Alves-Oliveira, E. Di Tullio, T. Ribeiro, and A. Paiva, "Meet me halfway: Eye behaviour as an expression of robot's language," in 2014 AAAI Fall Symposium Series, 2014.

[14]

P. Alves-Oliveira, S. Janarthanam, A. Candeias, A. Deshmukh, T. Ribeiro, H. Hastie, A. Paiva, and R. Aylett, "Towards dialogue dimensions for a robotic tutor in collaborative learning scenarios," in Proc. 23rd Int. Symp. Robot & Human Inter. Com., 2014, pp. 862--867.

[15]

A. Billard and D. Grollman, "Robot learning by demonstration," Scholarpedia, vol. 8, no. 12, p. 3824, 2013.

[16]

V. Mnih, K. Kavukcuoglu, D. Silver, A. Rusu, J. Veness, M. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, "Human-level control through deep reinforcement learning," Nature, vol. 518, no. 7540, pp. 529--533, 2015.

[17]

T. Mitchell, Machine Learning. McGraw-Hill, 1997.

[18]

P. Sequeira and C. Antunes, "Real-Time Sensory Pattern Mining for Autonomous Agents," in 6th Int. Workshop on Agents and Data Mining Interaction, 2010, pp. 71--83.

[19]

S. Chernova and M. Veloso, "Interactive Policy Learning Through Confidence-based Autonomy," Journal of Artificial Intelligence Research, vol. 34, no. 1, pp. 1--25, Jan. 2009.

[20]

P. Alves-Oliveira, P. Sequeira, E. D. Tullio, S. Petisca, C. Guerra, F. S. Melo, and A. Paiva, ""It's amazing, we are all feeling it!" Emotional Climate as a Group-Level Emotional Expression in HRI," in Art. Intel. and Human-Robot Interaction, AAAI Fall Symposium Series, 2015.

[21]

J. Nielsen, "Evaluating the thinking-aloud technique for use by computer scientists," Adv. in Human-Comp. Interaction, vol. 3, pp. 69--82, 1992.

[22]

M. Davis, "Interpersonal reactivity index," Empathy: A Social Psychological Approach, pp. 55--6, 1996.

[23]

Croft, and Zoghbi]Bartneck2009C. Bartneck, D. Kulić, E. Croft, and S. Zoghbi, "Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots," Int. journal of social robotics, vol. 1, no. 1, pp. 71--81, 2009.

Cited By

Pahuja DSabnis SNair UGrollman DBroadbent EJu WSoh HWilliams T(2024)Delivery Bot: Enhancing Pedestrian Awareness, Willingness and Ability to Help Delivery Robots Encountering ObstructionsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3641262(1249-1252)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3641262
Schneiders ECheon EKjeldskov JRehm MSkov M(2022)Non-Dyadic Interaction: A Literature Review of 15 Years of Human-Robot Interaction Conference PublicationsACM Transactions on Human-Robot Interaction10.1145/348824211:2(1-32)Online publication date: 8-Feb-2022
https://dl.acm.org/doi/10.1145/3488242
Paiva ACorreia FOliveira RSantos FArriaga P(2021)Empathy and Prosociality in Social AgentsThe Handbook on Socially Interactive Agents10.1145/3477322.3477334(385-432)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477334
Show More Cited By

Index Terms

Recommendations

Interaction Studies with Social Robots
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Over the past 10 years we have seen worldwide an immense growth of research and development into companion robots. Those are robots that fulfil particular tasks, but do so in a socially acceptable manner. The companionship aspect reflects the repeated ...
The oz of wizard: simulating the human for interaction research
HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

The Wizard of Oz experiment method has a long tradition of acceptance and use within the field of human-robot interaction. The community has traditionally downplayed the importance of interaction evaluations run with the inverse model: the human ...
Wizard of Oz studies in HRI: a systematic review and new reporting guidelines
Inaugural Special Issue: Intersection of Systems Sciences and Human Sciences

Many researchers use Wizard of Oz (WoZ) as an experimental technique, but there are methodological concerns over its use, and no comprehensive criteria on how to best employ it. We systematically review 54 WoZ experiments published in the primary HRI ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

March 2016

676 pages

ISBN:9781467383707

General Chairs:
Christoph Bartneck
University of Canterbury, New Zealand
,
Yukie Nagai
Osaka University, Japan
,
Program Chairs:
Ana Paiva
Technical University of Lisbon, Portugal
,
Selma Šabanović
Indiana University Bloomington, USA

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
RA: IEEE Robotics and Automation Society
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

In-Cooperation

AAAI: American Association for Artificial Intelligence
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

Publisher

IEEE Press

Publication History

Published: 07 March 2016

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fundação para a Ciência e a Tecnologia

Conference

HRI '16

Sponsor:

HRI '16: ACM/IEEE International Conference on Human-Robot Interaction

March 7 - 10, 2016

Christchurch, New Zealand

Acceptance Rates

HRI '16 Paper Acceptance Rate 45 of 181 submissions, 25%;

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
510
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pahuja DSabnis SNair UGrollman DBroadbent EJu WSoh HWilliams T(2024)Delivery Bot: Enhancing Pedestrian Awareness, Willingness and Ability to Help Delivery Robots Encountering ObstructionsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3641262(1249-1252)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3641262
Schneiders ECheon EKjeldskov JRehm MSkov M(2022)Non-Dyadic Interaction: A Literature Review of 15 Years of Human-Robot Interaction Conference PublicationsACM Transactions on Human-Robot Interaction10.1145/348824211:2(1-32)Online publication date: 8-Feb-2022
https://dl.acm.org/doi/10.1145/3488242
Paiva ACorreia FOliveira RSantos FArriaga P(2021)Empathy and Prosociality in Social AgentsThe Handbook on Socially Interactive Agents10.1145/3477322.3477334(385-432)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477334
Alves-Oliveira PSequeira PMelo FCastellano GPaiva A(2019)Empathic Robot for Group LearningACM Transactions on Human-Robot Interaction10.1145/33001888:1(1-34)Online publication date: 6-Mar-2019
https://dl.acm.org/doi/10.1145/3300188
Novoa JWuth JEscudero JFredes JMahu RYoma NKanda TŜabanović SHoffman GTapus A(2018)DNN-HMM based Automatic Speech Recognition for HRI ScenariosProceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3171221.3171280(150-159)Online publication date: 26-Feb-2018
https://dl.acm.org/doi/10.1145/3171221.3171280

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents