Article

Free access

Glove-TalkII: an adaptive gesture-to-formant interface

Authors:

Sidney Fels,

Geoffrey HintonAuthors Info & Claims

CHI '95: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 456 - 463

https://doi.org/10.1145/223904.223966

Published: 01 May 1995 Publication History

All formats PDF

References

[1]

A. G. Bell, "Making a Talking-Machine", Beinn Bhreagh Recorder, 1909, November, 61-72

Google Scholar

[2]

Broomhead, D. and Lowe, D., Multivariable functional interpolation and adaptive networks, Complex Systems, 2, 321-355, 1988

Google Scholar

[3]

G. Dewey, Relativ Frequency of English Speech Sounds, Harvard University Press, Cambridge, Mass, 1950

Google Scholar

[4]

Homer D. and R. R. Riesz and S. S. A. Watkins, A Synthetic Speaker, Journal of the Franklin Institute, 227 (6), 1939, 739--764.

Crossref

Google Scholar

[5]

S. Fels and G. Hinton, {Glove-Talk}: A Neural Network Interface Between a Data-Glove and a Speech Synthesizer, IEEE Transaction on Neural Networks, 4, 1993, 2-8.

Digital Library

Google Scholar

[6]

S. Fels and G. Hinton, {Glove-TalkII}: Mapping Hand Gestures to Speech Using Neural Networks, In D.S. Touretzky (Ed.) booktitle = nips 7, Denver, Morgan Kaufmann, San Mateo, year = 1995

Google Scholar

[7]

S. S. Fels, Glove-{T}alk{II}: Mapping Hand Gestures to Speech Using Neural Networks, August, Dissertation, 1994

Google Scholar

[8]

P. M. Fitts Perceptual--motor skill learning, In A. W. Melton (Ed.) Categories of human learning, New York, NY, Academic Press, 1964

Google Scholar

[9]

Rumelhart, D.E. and McClelland, J.L. and the PDP research group, Parallel distributed processing: Explorations in the microstructure of cognition. Vols. I and II Cambridge, MA, MIT Press, 1986.

Digital Library

Google Scholar

[10]

P. Ladefoged, A course in Phonetics (2 ed.) Harcourt Brace Javanovich, New York, 1982

Google Scholar

[11]

E. Lewis, A `{C}' Implementation of the {JSRU} Text-to-Speech System, 1989, Computer Science Dept., University of Bristol

Google Scholar

[12]

H. A. Rey, Curious George, Houghton Mifflin Company, Boston, 1941

Google Scholar

[13]

Rumelhart, D.E. and McClelland, J.L. and the PDP research group, Parallel distributed processing: Explorations in the microstructure of cognition. Vols. I and II" Cambridge, MA, MIT Press, 1986.

Digital Library

Google Scholar

[14]

J. M. Rye and J. N. Holmes, A versatile software parallel-formant speech synthesizer, JSRU-RR-1016, Joint Speech Research Unit, Malvern, UK, 1982.

Google Scholar

[15]

Dr. Seuss, Green Eggs and Ham Beginner Books, New York, 1960.

Google Scholar

[16]

Wolfgang Ritter von Kempelen, Mechanismus der menschlichen Sprache nebst Beschreibungeiner sprechenden Maschine. Mit einer Einleitung vonHerbert E. Brekle und Wolfgang Wild. Stuttgart-Bad Cannstatt F. Frommann, Stuttgart, 1970

Google Scholar

Cited By

View all

Kimura NKono MRekimoto JBrewster SFitzpatrick GCox AKostakos V(2019)SottoVoceProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300376(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300376
Krakauer JHadjiosif AXu JWong AHaith A(2019)Motor LearningComprehensive Physiology10.1002/cphy.c170043(613-663)Online publication date: 14-Mar-2019
https://doi.org/10.1002/cphy.c170043
Fiebrink R(2016)Machine Learning as Meta-Instrument: Human-Machine Partnerships Shaping Expressive Instrumental CreationMusical Instruments in the 21st Century10.1007/978-981-10-2951-6_10(137-151)Online publication date: 10-Dec-2016
https://doi.org/10.1007/978-981-10-2951-6_10
Show More Cited By

Index Terms

Glove-TalkII: an adaptive gesture-to-formant interface
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Speech recognition
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Glove-TalkII: mapping hand gestures to speech using neural networks
NIPS'94: Proceedings of the 7th International Conference on Neural Information Processing Systems

Glove-TalkII is a system which translates hand gestures to speech through an adaptive interface. Hand gestures are mapped continuously to 10 control parameters of a parallel formant speech synthesizer. The mapping allows the hand to act as an artificial ...
Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls

Glove-TalkII is a system which translates hand gestures to speech through an adaptive interface. Hand gestures are mapped continuously to ten control parameters of a parallel formant speech synthesizer. The mapping allows the hand to act as an ...
Glove-talkii: mapping hand gestures to speech using neural networks. an approach to building adaptive interfaces

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '95: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 1995

598 pages

ISBN:0201847051

Publisher

ACM Press/Addison-Wesley Publishing Co.

United States

Publication History

Published: 01 May 1995

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

CHI95

Sponsor:

SIGCHI

CHI95: Conference on Human Factor in Computing Systems

May 7 - 11, 1995

Colorado, Denver, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
707
Total Downloads

Downloads (Last 12 months)155
Downloads (Last 6 weeks)28

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kimura NKono MRekimoto JBrewster SFitzpatrick GCox AKostakos V(2019)SottoVoceProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300376(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300376
Krakauer JHadjiosif AXu JWong AHaith A(2019)Motor LearningComprehensive Physiology10.1002/cphy.c170043(613-663)Online publication date: 14-Mar-2019
https://doi.org/10.1002/cphy.c170043
Fiebrink R(2016)Machine Learning as Meta-Instrument: Human-Machine Partnerships Shaping Expressive Instrumental CreationMusical Instruments in the 21st Century10.1007/978-981-10-2951-6_10(137-151)Online publication date: 10-Dec-2016
https://doi.org/10.1007/978-981-10-2951-6_10
Turk MHale KStanney K(2014)Gesture RecognitionHandbook of Virtual Environments10.1201/b17360-12(211-231)Online publication date: 13-Aug-2014
https://doi.org/10.1201/b17360-12
Lee Y(2013)Implementation of an interactive interview system using hand gesture recognitionNeurocomputing10.1016/j.neucom.2011.10.046116(272-279)Online publication date: Sep-2013
https://doi.org/10.1016/j.neucom.2011.10.046
Lee MBillinghurst MBaek WGreen RWoo W(2013)A usability study of multimodal input in an augmented reality environmentVirtual Reality10.1007/s10055-013-0230-017:4(293-305)Online publication date: 1-Nov-2013
https://dl.acm.org/doi/10.1007/s10055-013-0230-0
Pritchard BFels Sd'Alessandro NWitvoet MWang JHassall CDay-Fraser HCadell MTan DBegole BKellogg W(2011)PerformanceCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979724(2403-2407)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979724
Pritchard BFels Sd'Alessandro NWitvoet MWang JHassall CDay-Fraser HCadell MTan DBegole BKellogg W(2011)PerformanceCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979547(2403-2407)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979547
Fiebrink RCook PTrueman DTan DFitzpatrick GGutwin CBegole BKellogg W(2011)Human model evaluation in interactive supervised learningProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1978942.1978965(147-156)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1978942.1978965
Billinghurst MThomas B(2011)Mobile Collaborative Augmented RealityRecent Trends of Mobile Collaborative Augmented Reality Systems10.1007/978-1-4419-9845-3_1(1-19)Online publication date: 4-Aug-2011
https://doi.org/10.1007/978-1-4419-9845-3_1
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Glove-TalkII: mapping hand gestures to speech using neural networks

Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls

Glove-talkii: mapping hand gestures to speech using neural networks. an approach to building adaptive interfaces