Article

Free access

Incremental generation of spatial referring expressions in situated dialog

Authors:

John D. Kelleher,

Geert-Jan M. KruijffAuthors Info & Claims

ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics

Pages 1041 - 1048

https://doi.org/10.3115/1220175.1220306

Published: 17 July 2006 Publication History

Abstract

This paper presents an approach to incrementally generating locative expressions. It addresses the issue of combinatorial explosion inherent in the construction of relational context models by: (a) contextually defining the set of objects in the context that may function as a landmark, and (b) sequencing the order in which spatial relations are considered using a cognitively motivated hierarchy of relations, and visual and discourse salience.

References

[1]

R. J. Beun and A. Cremers. 1998. Object reference in a shared domain of conversation. Pragmatics and Cognition, 6(1/2):121--152.

[2]

D. J. Bryant, B. Tversky, and N. Franklin. 1992. Internal and external spatial frameworks representing described scenes. Journal of Memory and Language, 31:74--98.

[3]

L. A. Carlson-Radvansky and D. Irwin. 1994. Reference frame activation during spatial term assignment. Journal of Memory and Language, 33:646--671.

[4]

L. A. Carlson-Radvansky and G. D. Logan. 1997. The influence of reference frame selection on spatial template construction. Journal of Memory and Language, 37:411--437.

[5]

H. Clark and D. Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition, 22:1--39.

[6]

E. Jeffrey Conklin and David D. McDonald. 1982. Salience: the key to the selection problem in natural language generation. In ACL Proceedings, 20th Annual Meeting, pages 129--135.

Digital Library

[7]

R. Dale and N. Haddock. 1991. Generating referring expressions involving relations. In Proceeding of the Fifth Conference of the European ACL, pages 161--166, Berlin, April.

Digital Library

[8]

R. Dale and E. Reiter. 1995. Computational interpretations of the Gricean maxims in the generation of referring expressions. Cognitive Science, 19(2):233--263.

[9]

I. Duwe and H. Strohner. 1997. Towards a cognitive model of linguistic reference. Report: 97/1 - Situierte Künstliche Kommunikatoren 97/1, Univeristät Bielefeld.

[10]

G. Edwards and B. Moulin. 1998. Towards the simulation of spatial mental images using the voronoï model. In P. Oliver and K. P. Gapp, editors, Representation and processing of spatial expressions, pages 163--184. Lawrence Erlbaum Associates.

Digital Library

[11]

C. Fillmore. 1997. Lecture on Deixis. CSLI Publications.

[12]

K. P. Gapp. 1995. Angle, distance, shape, and their relationship to projective relations. In Proceedings of the 17th Conference of the Cognitive Science Society.

[13]

C Gardent. 2002. Generating minimal definite descriptions. In Proceedings of the 40th International Conference of the Association of Computational Linguistics (ACL-02), pages 96--103.

Digital Library

[14]

S. Garrod, G. Ferrier, and S. Campbell. 1999. In and on: investigating the functional geometry of spatial prepositions. Cognition, 72:167--189.

[15]

P. Gorniak and D. Roy. 2004. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429--470.

[16]

E. Hajicová. 1993. Issues of sentence structure and discourse patterns. In Theoretical and Computational Linguistics, volume 2, Charles University, Prague.

[17]

A Herskovits. 1986. Language and spatial cognition: An interdisciplinary study of prepositions in English. Studies in Natural Language Processing. Cambridge University Press.

Digital Library

[18]

H. Horacek. 1997. An algorithm for generating referential descriptions with flexible interfaces. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, Madrid.

Digital Library

[19]

R. Jackendoff. 1983. Semantics and Cognition. Current Studies in Linguistics. The MIT Press.

[20]

J. Kelleher and J. van Genabith. 2004. A false colouring real time visual salency algorithm for reference resolution in simulated 3d environments. AI Review, 21(3--4):253--267.

Digital Library

[21]

J. D. Kelleher, G. J. M. Kruijff, and F. Costello. 2006. Proximity in context: An empirically grounded computational model of proximity for processing topological spatial expressions. In Proceedings ACL/COLING 2006.

Digital Library

[22]

E. Krahmer and M. Theune. 2002. Efficient context-sensitive generation of referring expressions. In K. van Deemter and R. Kibble, editors, Information Sharing: Reference and Presupposition in Language Generation and Interpretation. CLSI Publications, Standford.

[23]

G. J. M. Kruijff, J. D. Kelleher, G. Berginc, and A. Leonardis. 2006a. Structural descriptions in human-assisted robot visual learning. In Proceedings of the 1st Annual Conference on Human-Robot Interaction (HRI'06).

Digital Library

[24]

G. J. M. Kruijff, J. D. Kelleher, and Nick Hawes. 2006b. Information fusion for visual reference resolution in dynamic situated dialogue. In E. André, L. Dybkjaer, W. Minker, H. Neumann, and M. Weber, editors, Perception and Interactive Technologies (PIT 2006). Springer Verlag.

Digital Library

[25]

B Landau. 1996. Multiple geometric representations of objects in language and language learners. In P Bloom, M. Peterson, L Nadel, and M. Garrett, editors, Language and Space, pages 317--363. MIT Press, Cambridge.

[26]

G. D. Logan. 1994. Spatial attention and the apprehension of spatial relations. Journal of Experimental Psychology: Human Perception and Performance, 20:1015--1036.

[27]

G. D. Logan. 1995. Linguistic and conceptual control of visual spatial attention. Cognitive Psychology, 12:523--533.

[28]

R. Moratz and T. Tenbrink. 2006. Spatial reference in linguistic human-robot interaction: Iterative, empirically supported development of a model of projective relations. Spatial Cognition and Computation.

[29]

L. Talmy. 1983. How language structures space. In H. L. Pick, editor, Spatial orientation. Theory, research and application, pages 225--282. Plenum Press.

[30]

A. Treisman and S. Gormican. 1988. Feature analysis in early vision: Evidence from search assymetries. Psychological Review, 95:15--48.

[31]

K. van Deemter. 2001. Generating referring expressions: Beyond the incremental algorithm. In 4th Int. Conf. on Computational Semantics (IWCS-4), Tilburg.

[32]

I van der Sluis and E Krahmer. 2004. The influence of target size and distance on the production of speech and gesture in multimodal referring expressions. In Proceedings of International Conference on Spoken Language Processing (ICSPL04).

[33]

C. Vandeloise. 1991. Spatial Prepositions: A Case Study From French. The University of Chicago Press.

[34]

S. Varges. 2004. Overgenerating referring expressions involving relations and booleans. In Proceedings of the 3rd International Conference on Natural Language Generation, University of Brighton.

Cited By

Wallbridge CSmith AGiuliani MMelhuish CBelpaeme TLemaignan S(2021)The Effectiveness of Dynamically Processed Incremental Descriptions in Human Robot InteractionACM Transactions on Human-Robot Interaction10.1145/348162811:1(1-24)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3481628
Lemaignan SWarnier MSisbot EClodic AAlami R(2017)Artificial cognition for social humanrobot interactionArtificial Intelligence10.1016/j.artint.2016.07.002247:C(45-69)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1016/j.artint.2016.07.002
Ferreira TParaboni I(2014)Classification-Based Referring Expression GenerationProceedings of the 15th International Conference on Computational Linguistics and Intelligent Text Processing - Volume 840310.1007/978-3-642-54906-9_39(481-491)Online publication date: 6-Apr-2014
https://dl.acm.org/doi/10.1007/978-3-642-54906-9_39
Show More Cited By

Recommendations

The roles of haptic-ostensive referring expressions in cooperative, task-based human-robot dialogue
HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

Generating referring expressions is a task that has received a great deal of attention in the natural-language generation community, with an increasing amount of recent effort targeted at the generation of multimodal referring expressions. However, most ...
A wizard-of-oz environment to study referring expression generation in a situated spoken dialogue task
ENLG '09: Proceedings of the 12th European Workshop on Natural Language Generation

We present a Wizard-of-Oz environment for data collection on Referring Expression Generation (REG) in a real situated spoken dialogue task. The collected data will be used to build user simulation models for reinforcement learning of referring ...
Recognition of referring expressions
ReferringPhenomena '97: Referring Phenomena in a Multimedia Context and their Computational Treatment

Computational models of referring such as those of Kronfeld (1990) and Heeman & Hirst (1995), being based on the view of language as goal-directed behaviour, assume that the act of referring includes making the hearer recognize the speaker's ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics

July 2006

1214 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 17 July 2006

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
421
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wallbridge CSmith AGiuliani MMelhuish CBelpaeme TLemaignan S(2021)The Effectiveness of Dynamically Processed Incremental Descriptions in Human Robot InteractionACM Transactions on Human-Robot Interaction10.1145/348162811:1(1-24)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3481628
Lemaignan SWarnier MSisbot EClodic AAlami R(2017)Artificial cognition for social humanrobot interactionArtificial Intelligence10.1016/j.artint.2016.07.002247:C(45-69)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1016/j.artint.2016.07.002
Ferreira TParaboni I(2014)Classification-Based Referring Expression GenerationProceedings of the 15th International Conference on Computational Linguistics and Intelligent Text Processing - Volume 840310.1007/978-3-642-54906-9_39(481-491)Online publication date: 6-Apr-2014
https://dl.acm.org/doi/10.1007/978-3-642-54906-9_39
Mast VWolter D(2013)A Probabilistic Framework for Object Descriptions in Indoor Route InstructionsProceedings of the 11th International Conference on Spatial Information Theory - Volume 811610.1007/978-3-319-01790-7_11(185-204)Online publication date: 2-Sep-2013
https://dl.acm.org/doi/10.1007/978-3-319-01790-7_11
Viethen JDale RBelz AEvans RGatt AStriegnitz K(2011)GRE3D7Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop10.5555/2187741.2187744(12-22)Online publication date: 31-Jul-2011
https://dl.acm.org/doi/10.5555/2187741.2187744
Dale RViethen J(2010)Attribute-centric referring expression generationEmpirical methods in natural language generation10.5555/1880370.1880382(163-179)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.5555/1880370.1880382
Turner RSripada SReiter E(2010)Generating approximate geographic descriptionsEmpirical methods in natural language generation10.5555/1880370.1880380(121-140)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.5555/1880370.1880380
Giuliani MFoster MIsard AMatheson COberlander JKnoll AKelleher JNamee Bvan der Sluis I(2010)Situated reference in a hybrid human-robot interaction systemProceedings of the 6th International Natural Language Generation Conference10.5555/1873738.1873749(67-75)Online publication date: 7-Jul-2010
https://dl.acm.org/doi/10.5555/1873738.1873749
Coppock EBaxter D(2009)A translation from logic to English with dynamic semanticsProceedings of the 2009 international conference on New frontiers in artificial intelligence10.5555/1881958.1881979(197-216)Online publication date: 19-Nov-2009
https://dl.acm.org/doi/10.5555/1881958.1881979
Foster MGiuliani MIsard AMatheson COberlander JKnoll A(2009)Evaluating description and reference strategies in a cooperative human-robot dialogue systemProceedings of the 21st International Joint Conference on Artificial Intelligence10.5555/1661445.1661737(1818-1823)Online publication date: 11-Jul-2009
https://dl.acm.org/doi/10.5555/1661445.1661737
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten