Article

Free access

Natural language driven image generation

Authors:

Giovanni Adorni,

Mauro Di Manzo,

Fausto GiunchigliaAuthors Info & Claims

ACL '84/COLING '84: Proceedings of the 10th International Conference on Computational Linguistics and 22nd annual meeting on Association for Computational Linguistics

Pages 495 - 500

https://doi.org/10.3115/980491.980597

Published: 02 July 1984 Publication History

Abstract

In this paper the experience made through the development of a NAtural Language driven Image Generation is discussed. This system is able to imagine a static scene described by means of a sequence of simple phrases. In particular, a theory for equilibrium and support will be outlined together with the problem of object positioning.

References

[1]

Ad82a. Adorni, G., Boccalatte, A., and DiManzo, M., "Cognitive Models for Computer Vision", Proc. 9th. COLING, pp. 7--12 (Prague, Czechoslovakia, July 1982).

Digital Library

[2]

Ad83a. Adorni, G. and DiManzo, M., "Top-Down Approach to Scene Interpretation", Proc, CIL-83, pp. 591--606 (Barcelona, Spain, June 1983).

[3]

Ad83b. Adorni, G., DiManzo, M., and Ferrari, G., "Natural Language Input for Scene Generation", Proc. 1st. Conf. of the European Chapter of the ACL, pp. 175--182 (Pisa, Italy, September 1983).

Digital Library

[4]

Ad83c. Adorni, G., DiManzo, M., and Giunchiglia, F., "Some Basic Mechanisms for Common Sense Reasoning about Stories Envinronments", Proc. 8th. IJCAI, pp. 72--74 (Karlsruhe, West Germany, August 1983).

[5]

Ad84a. Adorni, G., Di Manzo, M., and Giunchiglia, F., "From Descriptions to Images: what Reasoning in between?", to appear in Proc. 6th. ECAI, (Pisa, Italy, September 1984).

[6]

Bo79a. Boggess, L. C., "Computational Interpretation of English Spatial Prepositions", TR-75, Coordinated Sci. Lab., Univ. of Illinois, Urbana, ILL (February 1979).

[7]

Bo83a. Bona, R. and Giunchiglia, F., "The semantics of some spatial prepositions: the Italian case as an example", DIST, Technical Report, Genoa, Italy (January 1983).

[8]

By80a. Byrd, L. and Borning, A., "Extending MECHO to Solve Static Problems", Proc. AISB-80 Conference on Artificial Intelligence, (Amsterdam, The Netherlands, July 1980).

[9]

Di84a. DiManzo, M., "A qualitative approach to statics", DIST, Technical Report, Genoa, Italy (June 1984).

[10]

Fo83a. Forbus, K., "Qualitative Reasoning about Space and Motion", in Mental Models, ed. Gentner, D., and Stevens, A., LEA Publishers, Hillsdale, N. J. (1983).

[11]

Fo83b. Forbus, K., "Measurement Interpretation in Qualitative Process Theory", Proc. 8th. IJCAI, pp. 315--320 (Karlsruhe, West Germany, August 1983).

[12]

Fo83c. Forbus, K., "Qualitative Process Theory", AIM-664A, Massachusetts Institute of Technology, A. I. Lab., Cambridge, MA (May 1983).

Digital Library

[13]

Ha78a. Hayes, P. J., "Naive Phisics I: Ontology for liquids", Working Paper N. 35, ISSCO, Univ. of Geneve, Geneve, Switzerland (August 1978).

[14]

Ha79a. Hayes, P. J., "The Naive Physics Manifesto", in Expert Systems in the Micro Electronic Age, ed. Michie, D., Edimburgh University Press, Edimburgh, England (1979).

[15]

He80a. Herskovitz, A., "On the Spatial Uses of the Prepositions", Proc. 18th. ACL, pp. 1--6 (Philadelphia, PEN, June 1980).

Digital Library

[16]

K179a. de Kleer, J., "Qualitative and Quantitative Reasoning in classical Mechanics", in Artificial Intelligence: an MIT Perspective, Volume I, ed. Winston, P. H. and Brown, R. H., The MIT Press, Cambridge, MA (1979).

[17]

K183a. de Kleer, J. and Brown, J., "Assumptions and Ambiguites in Mechanistic Mental Models", in Mental Models, ed. Gentner, D., and Stevens, A., LEA Publishers, Hillsdale, N. J. (1983).

[18]

Mo84a. Morasso, P. and Zaccaria, R., "FAN (Frame Algebra for Nem): an algebra for the description of tree-structured figures in motion", DIST, Technical Report, Genoa, Italy (January 1984).

[19]

So76a. Sondheimer, N. K., "Spatial Reference and Natural Language Machine Control", Int. J. Man-Machine Studies Vol. 8 pp. 329--336 (1976).

[20]

Wa79a. Waltz, D. L. and Boggess, L., "Visual Analog Representations for Natural language Understanding", Proc. 6th. IJCAI, pp. 926--934 (Tokyo, Japan, August 1979).

[21]

Wa80a. Waltz, D. L., "Understanding Scene Descriptions as Event Simulations", Proc. 18th. ACL, pp. 7--12 (Philadelphia, PEN, June 1980).

Digital Library

[22]

Wa81a. Waltz, D. L., "Toward a Detailed Model of Processing for Language Describing the Physical World", Proc. 7th. IJCAI, pp. 1--6 (Vancouver, B. C., Canada, August 1981).

Cited By

Zakraoui JSaleh MAl Ja’am J(2019)Text-to-picture tools, systems, and approaches: a surveyMultimedia Tools and Applications10.1007/s11042-019-7541-478:16(22833-22859)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s11042-019-7541-4
Hassani KLee W(2016)Visualizing Natural Language DescriptionsACM Computing Surveys10.1145/293271049:1(1-34)Online publication date: 29-Jun-2016
https://dl.acm.org/doi/10.1145/2932710
Yokota M(2012)Aware computing in spatial language understanding guided by cognitively inspired knowledge representationApplied Computational Intelligence and Soft Computing10.1155/2012/1841032012(5-5)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1155/2012/184103
Show More Cited By

Recommendations

Route description using natural language generation technology
AIRS'08: Proceedings of the 4th Asia information retrieval conference on Information retrieval technology

This paper aims to solve the problems of generating natural language route description in Chinese way-finding systems, on the basis of datasets of geographical information systems and natural language generation technology. The techniques of deriving ...
Paraphrasing SQL to natural language
RIAO '91: Intelligent Text and Image Handling - Volume 2

Restating the meaning of a sentence in other words is a phenomena in natural language (NL) commonly referred to as paraphrasing. This paper deals with the question of paraphrasing a formal expression to natural language. In any kind of user-system ...
Collective generation of natural image descriptions
ACL '12: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1

We present a holistic data-driven approach to image description generation, exploiting the vast amount of (noisy) parallel image data and associated natural language descriptions available on the web. More specifically, given a query image, we retrieve ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '84/COLING '84: Proceedings of the 10th International Conference on Computational Linguistics and 22nd annual meeting on Association for Computational Linguistics

July 1984

577 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 02 July 1984

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
495
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)5

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zakraoui JSaleh MAl Ja’am J(2019)Text-to-picture tools, systems, and approaches: a surveyMultimedia Tools and Applications10.1007/s11042-019-7541-478:16(22833-22859)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s11042-019-7541-4
Hassani KLee W(2016)Visualizing Natural Language DescriptionsACM Computing Surveys10.1145/293271049:1(1-34)Online publication date: 29-Jun-2016
https://dl.acm.org/doi/10.1145/2932710
Yokota M(2012)Aware computing in spatial language understanding guided by cognitively inspired knowledge representationApplied Computational Intelligence and Soft Computing10.1155/2012/1841032012(5-5)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1155/2012/184103
Oddie AHazlewood PFarrimond BPresland S(2011)Applying deductive techniques to the creation of realistic historical 3D spatiotemporal visualisations from natural language narrativesProceedings of the 2011 international conference on Electronic Visualisation and the Arts10.5555/2227233.2227252(97-105)Online publication date: 6-Jul-2011
https://dl.acm.org/doi/10.5555/2227233.2227252
Kadir RHashim AWirza RMustapha A(2011)3D visualization of simple natural language statement using semantic descriptionProceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part I10.5555/2074785.2074792(36-44)Online publication date: 9-Nov-2011
https://dl.acm.org/doi/10.5555/2074785.2074792
Rouhizadeh MCoyne BSproat R(2011)Collecting semantic information for locations in the scenario-based lexical knowledge resource of a text-to-scene conversion systemProceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part IV10.5555/2041497.2041543(378-387)Online publication date: 12-Sep-2011
https://dl.acm.org/doi/10.5555/2041497.2041543
Coyne BRambow OHirschberg JSproat R(2010)Frame semantics in text-to-scene generationProceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part IV10.5555/1893971.1894017(375-384)Online publication date: 8-Sep-2010
https://dl.acm.org/doi/10.5555/1893971.1894017
Yokota M(2007)Towards intuitive spatiotemporal communication between human and ubiquitous intelligence based on mental image directed semantic theoryProceedings of the 4th international conference on Ubiquitous Intelligence and Computing10.5555/2391319.2391432(1066-1078)Online publication date: 11-Jul-2007
https://dl.acm.org/doi/10.5555/2391319.2391432
Johansson RWilliams DBerglund ANugues PHirst GNirenburg S(2004)CarsimProceedings of the 2nd Workshop on Text Meaning and Interpretation10.5555/1628275.1628283(57-64)Online publication date: 25-Jul-2004
https://dl.acm.org/doi/10.5555/1628275.1628283
Nugues PDupuy SEgges A(2003)Information extraction to generate visual simulations of car accidents from written descriptionsProceedings of the 2003 international conference on Computational science and its applications: PartI10.5555/1756748.1756754(31-40)Online publication date: 18-May-2003
https://dl.acm.org/doi/10.5555/1756748.1756754
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents