Article

Free access

Real-time decision making in multimodal face-to-face communication

Author:

Kristinn R. ThórissonAuthors Info & Claims

AGENTS '98: Proceedings of the second international conference on Autonomous agents

Pages 16 - 23

https://doi.org/10.1145/280765.280769

Published: 01 May 1998 Publication History

PDF eReader

References

[1]

Bates, J., Loyall, A. & Reilly, W. S. (1994). An Architecture for Action, Emotion, and Social Behavior. Artificial Social Systems: Fourth European Workshop on Modelling Autonomous Agents in a Multi-Agent World. Springer-Verlag.

Digital Library

Google Scholar

[2]

Blumberg, B. (1996). Old Tricks, New Dogs: Ethology and Interactive Creatures. Ph.D. Thesis, Massachusetts Institute of Technology.

Digital Library

Google Scholar

[3]

Brooks, R. (1990). Elephants Don't Play Chess. In P. Maes (ed.), Designing Autonomous Agents, 3-15. Cam-. bridge, MA: MIT Press.

Google Scholar

[4]

Card, S. K., Moran, T. P. & Newell, A. (1983). The Psychology of Human-Computer Interaction. Hillsdale, New Jersey: Lawrence Earlbaum Associates.

Digital Library

Google Scholar

[5]

Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achom, B., Becket, T., Deouville, B., Prevost, S. & Stone, M. (1994a). Animated Conversation: Rule-based Generation of Faceial Expression, Gesture & Spoken Intonation for Multiple Conversational Agents. Proceedings of $IGGRAPH '94.

Digital Library

Google Scholar

[6]

Cassell, J., Stone, M., Douville, B., Prevost, S., Achom, B., Steedman, M., Badler, N. & Pelachaud, C. (1994b). Modeling the Interaction between Speech and Gesture. Sixteenth Annual Conference of the Cognitive Science Society, Atlanta, Georgia, August 13-16, 153-158.

Crossref

Google Scholar

[7]

Clark, H. H. & Brennan, S. E. (1990). Grounding in Communication. In L. B. Resnick, J. Levine & S. D. Bahrend (eds.), Perspectives on Socially Shared Cognition, 127-149. American Psychological Association.

Google Scholar

[8]

Dodhiawala, R. T. (1989). Blackboard Systems in Real- Time Problem Solving. In Jagannathan, V., Dodhiawala, R. & Baum, L. S. (eds.), Blackboard Architectures and Applications, 181-191. Boston: Academic Press, Inc.

Google Scholar

[9]

Duncan, S, Jr. (1972). Some Signals and Rules for Taking Speaking Turns in Conversations. Journal of Personality and Social Psychology, 23(2), 283-292.

Crossref

Google Scholar

[10]

Effron, D, (1941/1972). Gesture, Race and Culture. The Hague: Mouton,

Google Scholar

[11]

Ekman, P, & Friesen, W. (1978). Facial Action Coding System, Palo Alto, CA: Consulting Psychologists Press.

Google Scholar

[12]

Fehling, M. R., Altman, A. M. & Wilber, B. M. (1989). The Heuristic Control Virtual Machine: An Implementation of the Schemer Computational Model of Reflective, Real-Time Problem-Solving. In Jagannathan, R. Dodhiawala & L, S. Buam, Blackboard Architectures and Applications, 191-218. Boston: Academic Press, inc.

Google Scholar

[13]

Glass, A. L. & Holyoak, K. J. (1986). Cognition. New York, NY: Random House.

Google Scholar

[14]

Goodwin, C. (1986), Gestures as a Resource for the Organization of Mutual Orientation. Semiotica, 62(1/2), 29-49,

Google Scholar

[15]

Goodwin, C. (1981). Conversational Organization: Interaction Between Speakers and Hearers. New York, N~: Academic Press.

Google Scholar

[16]

Grosz, B, L & Sidner, C. L. (1986). Attention, Intentions, and the Strueutre of Discourse. Computational Lhlgtttstics, 12(3), 175-204.

Digital Library

Google Scholar

[17]

Hayes-Roth, B., Hayes-Roth, F., Rosenschein, S. & Cammarata, S. (1988). Modeling Planning as an Incremental, Opportunistic Process. In R. Engelmore & T. Morgan, Blackboard Systems, 231-245. Reading, MA: Addison-Wesley Publishing Co.

Google Scholar

[18]

Kaeprzyk, $, (1992). Fuzzy Sets and Fuzzy Logic. In S,C, Shapiro (ed,), The Encyclopedia of Artificial InteUigence, 2nd ed., 537-542. N.Y.: Wiley Inters~ienee.

Google Scholar

[19]

Kleinke, C, (1986). Gaze and Eye Contact: A Research Review, Psychological Bulletin, 100(1), 78-100.

Crossref

Google Scholar

[20]

Maes, P, (1990). Designing Autonomous Agents: Theory and Practice from Biology to Engineering and Back, In P, Maes (ed.), Designing Autonomous Agents, 1-2, Cambridge, MA: MIT Press

Google Scholar

[21]

Maes, P. How to Do the Right Thing. A.I. Memo 1%. 1180, Artificial intelligence Laboratory, Massachusetts Institute of Technology, December, 1989.

Digital Library

Google Scholar

[22]

MeNeill, D, (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago, IL: University of Chicago Press,

Google Scholar

[23]

Nii, P, (1989), Blackboard Systems. In A. Bat, r, P. R. Cohen & E, A, Feigenbaum (eds.), The Handbook of Artificial httelligence, Vol. iV, 1-74. Reading, MA: Addison-Wesley Publishing Co.

Google Scholar

[24]

Pelaehaud, C, Badler, N. I. & Steedman, M. (1996). Generating Facial Expressions for Speech. Cognitive Science, 20 (1), 1-46.

Crossref

Google Scholar

[25]

Pierrehumbert, J. & Hirschberg, J. (1990). The Meaning of Intonational Contours in the Interpretation of Discourse, In P. R. Cohen, J. Morgan & M. E. Pollack (~ds,), intentions in Communication. Cambridge: MIT Press,

Google Scholar

[26]

Prevost, $. (1996). A Semantics of Contrast and Informarion Structure for Specifying Intonation in Spoken Language Generation. Ph.D. Thesis, Faculty of Coputer and Information Science, University of Pennsylvania.

Digital Library

Google Scholar

[27]

Poyatos, F. (1980). Interactive Functions and Limitations of Verbal and Nonverbal Behaviors in Natural Conversation. Semiotica, 30-3/4, 211-244.

Google Scholar

[28]

Rim6, B. & Schiaratura, L. (1991). Gesture and Speech. In R. S. Feldman & B. Rim6, Fundamentals of Nonverhal Behavior, 239-281. New York: Press Syndicate of the University of Cambridge.

Google Scholar

[29]

Rosenbaum, D. A. & Kirst, H. (1992). Antecedents of Action. In H. Heuer & S. W. Keele (eds.), Handbook of Motor Skills. New York, NY: Academic Press.

Google Scholar

[30]

Sacks, H., Schegloff, E. A. & Jefferson, G. A. (1974). A Simplest Systematics for the Organization of Turn- Taking in Conversation. Language, 50, 696-735.

Crossref

Google Scholar

[31]

Selfridge, O. (1959). Pandemonium: A Paradigm for Learning. Proceedings of Symposium on the Mechanization of Thought Processes, 511-29.

Google Scholar

[32]

Steels, L. (1990). Cooperation Between Distributed Agents Through Self-Organization. In Y. Demazeau & J'. P. M~iller (eds.), Decentralized A. I. Amsterdam: Elsevier Science Publishers B. V. (North-Holland).

Google Scholar

[33]

Th6risson, K. R. (1997a). Layered Action Control in Communicative Humanoids. Proceedings of Computer Graphics Europe '97, June 5-7, Genieva.

Google Scholar

[34]

Th6risson, K. R. (1997b). Oandalf: A Communicative Humanoid Capable of Real-Time Mutlimodal Dialogue with People. A CM First Conference on Autonomous Agents, Marina del Rey, California, February 5-8.

Digital Library

Google Scholar

[35]

Th6risson, K. R. (1996). Communicative Humanoids: A Computational Model of Psychosoeial Dialogue Skills. Ph.D. Thesis, Massachusetts Institute of Technology.

Google Scholar

[36]

Th6risson, K. R. (1995a). Computational Characteristics of Multimodal Dialouge. AAAI Fall Symposium Series on Embodied Lanugage and Action, November 10-12, Massachusetts Institute of Technology, Cambridge, 102-108.

Google Scholar

[37]

Th6risson, K. R. (1995b). Multimodal interaction with Humanoid Computer Characters. Conference on Lifelike Computer Characters, Snowbird, Utah, September 26-. 29, p. 45 (Abstract).

Google Scholar

[38]

Th6risson, K. R. (1994). Face-to-Face Communication with Computer Agents. AAA1 Spring Symposium on Believable Agents Working Notes, Stanford University, California, March 19-20, 86-90.

Google Scholar

[39]

Th6risson, K. R. (1993). Dialogue Control in Social Interface Agents. InterCHI Adjunct Proceedings '93, Amsterdam, April, 139-140.

Digital Library

Google Scholar

[40]

Th6risson, K. R. & Cassell, J. (1997). Communicative Feedback in Human-Humanoid Dialogue. 1JCA1 '97 Workshop on Animated Interface Agents, Nagoya, Japan, Aug. 25-26.

Google Scholar

[41]

Vilhjalmsson, H. H. & Cassell, J. (1998). BodyChat: Autonomous Communicative Behaviors in Avatars. This volume.

Google Scholar

[42]

Yngve, V. H. (1970). On Getting a Word in Edgewise. Papers from the Sixth Regional Meeting., Chicago Linguistics Society, 567-78.

Google Scholar

Cited By

View all

Gillies M(2019)Understanding the Role of Interactive Machine Learning in Movement Interaction DesignACM Transactions on Computer-Human Interaction10.1145/328730726:1(1-34)Online publication date: 6-Feb-2019
https://dl.acm.org/doi/10.1145/3287307
Kotseruba ITsotsos J(2018)40 years of cognitive architectures: core cognitive abilities and practical applicationsArtificial Intelligence Review10.1007/s10462-018-9646-yOnline publication date: 28-Jul-2018
https://doi.org/10.1007/s10462-018-9646-y
Mashego M(2015)Lone ranger decision making versus consensus decision making: Descriptive analysisJournal of Governance and Regulation10.22495/jgr_v4_i4_c4_p124:4(548-552)Online publication date: 2015
https://doi.org/10.22495/jgr_v4_i4_c4_p12
Show More Cited By

Index Terms

Real-time decision making in multimodal face-to-face communication

Recommendations

Gaze, conversational agents and face-to-face communication

In this paper, we describe two series of experiments that examine audiovisual face-to-face interaction between naive human viewers and either a human interlocutor or a virtual conversational agent. The main objective is to analyze the interplay between ...
Speech and face-to-face communication - An introduction

This issue focuses on face-to-face speech communication. Research works have demonstrated that this communicative situation is essential to language acquisition and development (e.g. naming). Face-to-face communication is in fact much more than speaking ...
Multimodal conversation scene analysis for understanding people's communicative behaviors in face-to-face meetings
HCII'11: Proceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II

This presentation overviews our recent progress in multimodal conversation scene analysis, and discusses its future in terms of designing better human-to-human communication systems. Conversation scene analysis aims to provide the automatic description ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AGENTS '98: Proceedings of the second international conference on Autonomous agents

May 1998

484 pages

ISBN:0897919831

DOI:10.1145/280765

Editors:
Katia P. Sycara
Carnegie Mellon Univ., Pittsburgh, PA
,
Michael Wooldridge
Univ. of London, London, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1998

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

AGENTS98

Sponsor:

AGENTS98: 2nd International Conference on Autonomous Agents

May 10 - 13, 1998

Minnesota, Minneapolis, USA

Acceptance Rates

AGENTS '98 Paper Acceptance Rate 57 of 180 submissions, 32%;

Overall Acceptance Rate 182 of 599 submissions, 30%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
933
Total Downloads

Downloads (Last 12 months)68
Downloads (Last 6 weeks)12

Reflects downloads up to 23 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gillies M(2019)Understanding the Role of Interactive Machine Learning in Movement Interaction DesignACM Transactions on Computer-Human Interaction10.1145/328730726:1(1-34)Online publication date: 6-Feb-2019
https://dl.acm.org/doi/10.1145/3287307
Kotseruba ITsotsos J(2018)40 years of cognitive architectures: core cognitive abilities and practical applicationsArtificial Intelligence Review10.1007/s10462-018-9646-yOnline publication date: 28-Jul-2018
https://doi.org/10.1007/s10462-018-9646-y
Mashego M(2015)Lone ranger decision making versus consensus decision making: Descriptive analysisJournal of Governance and Regulation10.22495/jgr_v4_i4_c4_p124:4(548-552)Online publication date: 2015
https://doi.org/10.22495/jgr_v4_i4_c4_p12
Gillies MBrenton HKleinsmith AAlaoui SPasquier PSchiphorst TFrançoise JBevilacqua F(2015)Embodied design of full bodied interaction with virtual humansProceedings of the 2nd International Workshop on Movement and Computing10.1145/2790994.2790996(1-8)Online publication date: 14-Aug-2015
https://dl.acm.org/doi/10.1145/2790994.2790996
Gillies MKleinsmith ABrenton HBrdiczka OChau PCarenini GPan SKristensson P(2015)Applying the CASSM Framework to Improving End User Debugging of Interactive Machine LearningProceedings of the 20th International Conference on Intelligent User Interfaces10.1145/2678025.2701373(181-185)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2678025.2701373
Brenton HKleinsmith AGillies MBevilacqua FAlaoui SFrançoise JPasquier PSchiphorst T(2014)Embodied Design of Dance VisualisationsProceedings of the 2014 International Workshop on Movement and Computing10.1145/2617995.2618017(124-129)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2617995.2618017
Schmitz NBerns K(2011)Perception systems for naturally interacting humanoid robots2011 RO-MAN10.1109/ROMAN.2011.6005251(425-432)Online publication date: Jul-2011
https://doi.org/10.1109/ROMAN.2011.6005251
Gillies MPan XSlater M(2010)Piavca: a framework for heterogeneous interactions with virtual charactersVirtual Reality10.1007/s10055-010-0167-514:4(221-228)Online publication date: 30-Jul-2010
https://doi.org/10.1007/s10055-010-0167-5
Daugherty BBabu SWallendael LCutler BHodges L(2008)Virtual Human versus Human Administration of Photographic LineupsIEEE Computer Graphics and Applications10.1109/MCG.2008.12528:6(65-75)Online publication date: 1-Nov-2008
https://dl.acm.org/doi/10.1109/MCG.2008.125
Vilhjalmsson HMerchant CSamtani P(2007)Social puppetsProceedings of the 2nd international conference on Online communities and social computing10.5555/1784297.1784320(192-201)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1784297.1784320
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Gaze, conversational agents and face-to-face communication

Speech and face-to-face communication - An introduction

Multimodal conversation scene analysis for understanding people's communicative behaviors in face-to-face meetings