research-article

PETA: a pedagogical embodied teaching agent

Authors:

Richard Leibbrandt,

Martin Luerssen,

Mike LawsonAuthors Info & Claims

PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

Article No.: 60, Pages 1 - 8

https://doi.org/10.1145/1389586.1389658

Published: 16 July 2008 Publication History

Abstract

We describe a hybrid real and virtual system that monitors and teaches children in an everyday classroom environment without requiring any special virtual reality set ups or any knowledge that there is a computer involved. This system is truly pervasive in that it interacts with a child who is playing with normal physical toys using speech. A simulated virtual head provides a focus and the opportunity for microphonological language teaching, whilst a simulated world allows the teacher to demonstrate using her set of blocks -- much as a teacher might demonstrate at the front of the class. However this system allows individual students, or pairs of students, to interact with the task in a computer-free way and receive feedback from PETA, the Teaching Head, as if from their own private tutor.

References

[1]

Bradski, G. R. 1998. Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal, 1998, Q2, 15

[2]

Davis, C, Kim, J. Kuratate, T. & Burnham, D. 2007. Making a thinking-talking head. Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP 2007). Hilvarenbeek. The Netherlands.

[3]

Feldman, J. A., Lakoff, G., Stolcke, A. & Hollbach Weber, S. 1990. Miniature language acquisition: a touchstone for cognitive science. Technical report, ICSI, Berkeley, CA.

[4]

Harnad, S. 1990. The Symbol Grounding Problem, Physica D 42: 335--346.

Digital Library

[5]

Homes, D. A. 1998. Perceptually Grounded Language Learning. B.Sc. Honours Thesis, Dept of Computer Science, Flinders University, Adelaide.

[6]

Hume, D. 1984. Creating Interactive Worlds with Multiple Actors, Computer Science Honours Thesis, Electrical Engineering and Computer Science, Uni. of NSW, Sydney.

[7]

Kalawsky, R. S. 1999. VRUSE-a computerized diagnostic tool: for usability evaluation of virtual/synthetic environment systems. Applied Ergonomics, 30, 11--25.

[8]

Kindler, A. 2002. Survey of the states' limited English proficient students and available educational programs and services, 2000--2001 summary report. National Clearinghouse for English Language Acquisition & Language Instruction Educational Programs.

[9]

Krashen, S. D. 1981. Principles and Practice in Second Language Acquisition. English Language Teaching series. London: Prentice-Hall International UK Ltd.

[10]

Lienhart, R. & Maydt, J. 2002 An Extended Set of Haar-like Features for Rapid Object Detection, IEEE ICIP 2002, 1, 900--903.

[11]

Li Santi, M., Leibbrandt, R. E. & Powers, D. M. W. 2007. Developing 3D Worlds for Language Learning, Australian Society for Cognitive Science Conference, Adelaide, Australia.

[12]

Lucas, T. 1993. Secondary schooling for students becoming bilingual. In M. B. Arias & U. Casanova (Eds.), Bilingual education: politics, practice and research pp. 113--143. Chicago: University of Chicago Press.

[13]

MacWhinney, B. 1997. Second language acquisition and the Competition Model. In A. M. B. de Groot & J. Kroll (Eds.), Tutorials in bilingualism: Psychological perspectives pp. 169--199. Mahwah, NJ: Erlbaum.

[14]

Montessori, M. 1907. House of children: a planet without schools or teachers. http://www.montessori.edu/maria.html accessed 15 Feb 2008.

[15]

Piaget, J. 1928/2001. Judgment and reasoning in the child. New York: Harcourt, Brace and Company.

[16]

Powers, D. M. W., Leibbrandt, R. E., Li Santi, M. & Luerssen, M. H. 2007. A multimodal environment for immersive language learning - space, time, viewpoint and physics, Joint HCSNet-HxI Workshop on Human Issues in Interaction and Interactive Interfaces, Sydney, Australia.

[17]

Powers, D. M. W. & Turk, C. 1989. Machine Learning of Natural Language, Research Monograph, New York/Berlin: Springer-Verlag.

Digital Library

[18]

Powers, D M. W. 2003. Recall and Precision versus the Bookmaker. International Conference on Cognitive Science, pp529--534. http://david.wardpowers.info/BM/BMPaper.pdf accessed 11 May 2008.

[19]

Powers, D. M. W. 2007, Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation, School of Informatics and Engineering, Flinders University Adelaide Australia, Technical Report SIE-07-001, December 2007

[20]

Powers, D. M. W. (in press), Evaluation Evaluation, ECAI July 21--25 2008.

Digital Library

[21]

Roussou, M., Gillingham, M., Moher, T. 1998. Evaluation of an Immersive Collaborative Virtual Learning Environment for K-12 Education. American Educational Research Association Annual Meeting (AERA), San Diego, CA.

[22]

Viola, P. A. & Jones, M. J. 2001. Rapid object detection using a boosted cascade of simple features. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'01), IEEE Computer Society, 511--518.

[23]

Weinreich, U. 1953/1974. Languages in Contact, Berlin: Walter de Gruyter.

[24]

Weizenbaum, J. 1976. Computer Power and Human Reason: From Judgment To Calculation. San Francisco: W. H. Freeman.

Digital Library

[25]

Yang, D. & Powers, D. M. W. 2006. Word sense disambiguation using lexical cohesion in the context. Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics (COLING-ACL) 2006, Sydney, Australia, 929--936.

Digital Library

[26]

Yang, D. & Powers, D. M. W. 2005. Measuring semantic similarity in the taxonomy of WordNet. Australia Computer Science Conference (ACSC2005). pp315--322

Digital Library

[27]

Yang, D. & Powers, D. M. W. 2008. Automatic Thesaurus Construction, Australia Computer Science Conference (ACSC2009), pp147--156

Digital Library

Cited By

Tillman DVelonaki M(2023)On Display: Robots as CultureCultural Robotics: Social Robots and Their Emergent Cultural Ecologies10.1007/978-3-031-28138-9_16(257-274)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-28138-9_16
Kappagantula SAdamo-Villani NWu MPopescu V(2020)Automatic Deictic Gestures for Animated Pedagogical AgentsIEEE Transactions on Learning Technologies10.1109/TLT.2019.292213413:1(1-13)Online publication date: 1-Jan-2020
https://doi.org/10.1109/TLT.2019.2922134
Sciuto ASaini AForlizzi JHong JKoskinen ILim YCerratto-Pargman TChow KOdom W(2018)"Hey Alexa, What's Up?"Proceedings of the 2018 Designing Interactive Systems Conference10.1145/3196709.3196772(857-868)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3196709.3196772
Show More Cited By

Index Terms

PETA: a pedagogical embodied teaching agent
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Language teaching in a mixed reality games environment
PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

How do you develop a game that is provably educational, that is engaging from pre-school to adult, and that independently targets different language ability and world experience/maturity?

Our purpose is to teach students of German or English as a Second ...
Embodied conversational agents in computer assisted language learning

This paper describes two systems using embodied conversational agents (ECAs) for language learning. The first system, called Ville, is a virtual language teacher for vocabulary and pronunciation training. The second system, a dialogue system called DEAL,...
Why virtual, why environments? Implementing virtual reality concepts in computer-assisted language learning

The research area of computer-assisted language learning (CALL) has recently shifted from seeing the computer as a tool or partner to seeing it as a virtual environment where learners can collaborate and interact with a wide variety of native speakers. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments

July 2008

607 pages

ISBN:9781605580678

DOI:10.1145/1389586

Editors:
Fillia Makedon
University of Texas at Arlington
,
Lynne Baillie
Telecom Research Center Vienna (FTW), Austria
,
Grammati Pantziou
TEI of Athens (Department of Informatics), Greece
,
Ilias Maglogiannis
University of Central Greece (Department of Computer Science and Biomedical Informatics), Greece

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Motorola: Motorola
NSF
SERC: SERC
NIST: National Institute of Standards & Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Australian Research Council

Conference

PETRA '08

Sponsor:

Motorola
SERC
NIST

PETRA '08: The 1st International Conference on PErvasive Technologies Related to Assistive Environments

July 16 - 18, 2008

Athens, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
296
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)4

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tillman DVelonaki M(2023)On Display: Robots as CultureCultural Robotics: Social Robots and Their Emergent Cultural Ecologies10.1007/978-3-031-28138-9_16(257-274)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-28138-9_16
Kappagantula SAdamo-Villani NWu MPopescu V(2020)Automatic Deictic Gestures for Animated Pedagogical AgentsIEEE Transactions on Learning Technologies10.1109/TLT.2019.292213413:1(1-13)Online publication date: 1-Jan-2020
https://doi.org/10.1109/TLT.2019.2922134
Sciuto ASaini AForlizzi JHong JKoskinen ILim YCerratto-Pargman TChow KOdom W(2018)"Hey Alexa, What's Up?"Proceedings of the 2018 Designing Interactive Systems Conference10.1145/3196709.3196772(857-868)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3196709.3196772
Anasingaraju SWu MAdamo-Villani NPopescu VCook SNathan MAlibali MAoki MPan Z(2016)Digital learning activities delivered by eloquent instructor avatarsSIGGRAPH ASIA 2016 Symposium on Education10.1145/2993352.2993355(1-7)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/2993352.2993355
Tewari AGoyal NChan MYau TCanny JSchroeder UUnwin TKleine DToyama K(2010)SPRINGProceedings of the 4th ACM/IEEE International Conference on Information and Communication Technologies and Development10.1145/2369220.2369265(1-11)Online publication date: 13-Dec-2010
https://dl.acm.org/doi/10.1145/2369220.2369265
Milne MLuerssen MLewis TLeibbrandt RPowers D(2010)Development of a virtual agent based social tutor for children with autism spectrum disordersThe 2010 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2010.5596584(1-9)Online publication date: Jul-2010
https://doi.org/10.1109/IJCNN.2010.5596584
Powers DLeibbrandt RPfitzner DLuerssen MLewis TAbrahamyan AStevens K(2008)Language teaching in a mixed reality games environmentProceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments10.1145/1389586.1389668(1-7)Online publication date: 16-Jul-2008
https://dl.acm.org/doi/10.1145/1389586.1389668

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents