article

Free access

“Put-that-there”: Voice and gesture at the graphics interface

Author:

Richard A. BoltAuthors Info & Claims

ACM SIGGRAPH Computer Graphics, Volume 14, Issue 3

Pages 262 - 270

https://doi.org/10.1145/965105.807503

Published: 01 July 1980 Publication History

PDF eReader

Abstract

Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.

The work described herein involves the user commanding simple shapes about a large-screen graphics display surface. Because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression. Conversely, gesture aided by voice gains precision in its power to reference.

References

[1]

Negroponte, N The Media Room. Report for ONR and DARPA. MIT, Architecture Machine Group, Cambridge, MA, December 1978.

Google Scholar

[2]

Bolt, R.A. Spatial Data-Management. DARPA Report. MIT, Architecture Machine Group, Cambridge, MA, March 1979.

Google Scholar

[3]

Reddy, D.R. Speech recognition by machine: a review. Proceeding of the IEEE, 64, 4 (April 1976), 501-531.

Crossref

Google Scholar

[4]

Robinson, A.L. More people are talking to computers as speech recognition enters the real world. (Research News) (First of two articles) Science, 203, (16 February 1979), 634-638.

Google Scholar

[5]

Sondeheimer, N.K. Spatial reference and natural-language machine control. International Journal of Man-Machine Studies, 8, (1976), 329-336.

Crossref

Google Scholar

[6]

Winston, P. Learning structural descriptions from examples. MIT Project MAC, TR-76, 1970.

Digital Library

Google Scholar

[7]

Olson, D.R. Language and thought: Aspects of a cognitive theory of semantics. Psychological Review, 77, (1970), 257-273.

Crossref

Google Scholar

Cited By

View all

Verma AJauhar NMangal NParthasarathi M(2025)ISL recognition system in real time using TensorFlow APIArtificial Intelligence in Biomedical and Modern Healthcare Informatics10.1016/B978-0-443-21870-5.00050-9(525-539)Online publication date: 2025
https://doi.org/10.1016/B978-0-443-21870-5.00050-9
Septon TVillarreal-Narvaez SDevroey XDumas B(2024)Exploiting Semantic Search and Object-Oriented Programming to Ease Multimodal Interface DevelopmentCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3664244(74-80)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3664244
Rosenberg KKazi RWei LXia HPerlin K(2024)DrawTalking: Building Interactive Worlds by Sketching and SpeakingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676334(1-25)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676334
Show More Cited By

Index Terms

“Put-that-there”: Voice and gesture at the graphics interface
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Speech recognition
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Graphics input devices

Recommendations

“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques

Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.

The work described ...
“Put-that-there”: voice and gesture at the graphics interface
Readings in intelligent user interfaces
On the feasibility of voice input to an on-line computer processing system

An on-line digital computer processing system is considered in which an ordinary telephone is the complete terminal device, input to the computer being provided as a sequence of spoken words, and output to the user being audio responses from the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGGRAPH Computer Graphics

ACM SIGGRAPH Computer Graphics Volume 14, Issue 3

July 1980

327 pages

ISSN:0097-8930

DOI:10.1145/965105

Issue’s Table of Contents

SIGGRAPH '80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques
July 1980
336 pages
ISBN:0897910214
DOI:10.1145/800250
Chairmen:
James J. Thomas,
Robert A. Ellis,
Harvey Z. Kriloff

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 1980

Published in SIGGRAPH Volume 14, Issue 3

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,183
Total Citations
View Citations
9,995
Total Downloads

Downloads (Last 12 months)884
Downloads (Last 6 weeks)146

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Verma AJauhar NMangal NParthasarathi M(2025)ISL recognition system in real time using TensorFlow APIArtificial Intelligence in Biomedical and Modern Healthcare Informatics10.1016/B978-0-443-21870-5.00050-9(525-539)Online publication date: 2025
https://doi.org/10.1016/B978-0-443-21870-5.00050-9
Septon TVillarreal-Narvaez SDevroey XDumas B(2024)Exploiting Semantic Search and Object-Oriented Programming to Ease Multimodal Interface DevelopmentCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3664244(74-80)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3664244
Rosenberg KKazi RWei LXia HPerlin K(2024)DrawTalking: Building Interactive Worlds by Sketching and SpeakingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676334(1-25)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676334
Alhakamy A(2024)Extended Reality (XR) Toward Building Immersive Solutions: The Key to Unlocking Industry 4.0ACM Computing Surveys10.1145/365259556:9(1-38)Online publication date: 25-Apr-2024
https://dl.acm.org/doi/10.1145/3652595
Aghel Manesh SZhang TOnishi YHara KBateman SLi JTang A(2024)How People Prompt Generative AI to Create Interactive VR ScenesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661547(2319-2340)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661547
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Rosenberg KKazi RWei LXia HPerlin K(2024)DrawTalking: Towards Building Interactive Worlds by Sketching and SpeakingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651089(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651089
Cao YKazi RWei LAneja DXia H(2024)Elastica: Adaptive Live Augmented Presentations with Elastic Mappings Across ModalitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642725(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642725
Masson DMalacria SCasiez GVogel D(2024)DirectGPT: A Direct Manipulation Interface to Interact with Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642462(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642462
Stec KLarsen L(2024)Gestural Interfaces in Human–Computer InteractionThe Cambridge Handbook of Gesture Studies10.1017/9781108638869.027(661-682)Online publication date: 1-May-2024
https://doi.org/10.1017/9781108638869.027
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations