research-article

The mathematical imagery trainer: from embodied interaction to conceptual learning

Authors:

Dragan Trninic,

Daniel Reinholz,

Dor AbrahamsonAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1989 - 1998

https://doi.org/10.1145/1978942.1979230

Published: 07 May 2011 Publication History

Abstract

We introduce an embodied-interaction instructional design, the Mathematical Imagery Trainer (MIT), for helping young students develop grounded understanding of proportional equivalence (e.g., 2/3 = 4/6). Taking advantage of the low-cost availability of hand-motion tracking provided by the Nintendo Wii remote, the MIT applies cognitive-science findings that mathematical concepts are grounded in mental simulation of dynamic imagery, which is acquired through perceiving, planning, and performing actions with the body. We describe our rationale for and implementation of the MIT through a design-based research approach and report on clinical interviews with twenty-two 4th-6th grade students who engaged in problem-solving tasks with the MIT.

Supplementary Material

MOV File (paper487.mov)

Download
106.82 MB

References

[1]

Abrahamson, D. Embodied design: Constructing means for constructing meaning. Educational Studies in Mathematics 70, 1 (2009), 27--47.

[2]

Alibali, M.W., Bassok, M., Olseth, K.L., et al. Illuminating mental representations through speech and gesture. Psychological Science 10, 4 (1999), 327--333.

[3]

Antle, A.N., Corness, G., Bakker, S., et al. Designing to support reasoned imagination through embodied metaphor, in Proceeding of the 7th ACM Conference on Creativity and Cognition (Berkeley CA, 2009), 275--284.

Digital Library

[4]

Antle, A.N., Corness, G., and Droumeva, M. What the body knows: Exploring the benefits of embodied metaphors in hybrid physical digital environments. Interacting with Computers 21 (2009), 66--75.

Digital Library

[5]

Artigue, M. Learning mathematics in a CAS environment: The genesis of a reflection about instrumentation and the dialectics between technical and conceptual work. International Journal of Computers for Mathematical Learning 7, 3 (2002), 245--274.

[6]

Bamberger, J. and Schon, D. Learning as reflective conversation with materials. In F. Steier (Ed.), Research and Reflexivity, Sage, London, 1991, 186--209.

[7]

Barsalou, L.W. Grounded cognition. Annual Review of Psychology 59 (2008), 617--645.

[8]

Bott, J.N., Crowley, J.G., and LaViola, J.J. Exploring 3D gestural interfaces for music creation in video games. In Proceedings of the 4th international Conference on Foundations of Digital Games (Orlando FL, 2009), 18--25.

Digital Library

[9]

Church, R.B. and Goldin-Meadow, S. The mismatch between gesture and speech as an index of transitional knowledge. Cognition 23 (1986), 43--71.

[10]

Clinton, K.A. Embodiment in digital worlds: What being a videogame player has to teach us about learning. Paper presented at the Annual Meeting of the American Educational Research Association (San Diego CA, 2004).

[11]

Collins, A. Towards a design science of education. In Scanlon, E. and O'Shea, T. eds. New directions in educational technology, Springer, Berlin, 1992, 15--22.

[12]

Confrey, J. The evolution of design studies as methodology. In Sawyer, R.K. ed. The Cambridge handbook of the learning sciences, Cambridge University Press, Cambridge MA, 2005, 135--151.

[13]

Cress, U., Fischer, U., Moeller, et al. The use of a digital dance mat for training kindergarten children in a magnitude comparison task. In Proceedings of the 9th International Conference of the Learning Sciences (2010), 105--112.

Digital Library

[14]

Davis, G.E. Fractions, ratio, and proportional reasoning {Special Issue}. The Journal of Mathematical Behavior 22, 2 (2003).

[15]

Farber, A. and Parker, L. Discovering Music through Dalcroze Eurhythmics. Music Educators Journal 74, 3 (1987) 43--45.

[16]

Fuson, K.C. and Abrahamson, D. Understanding ratio and proportion as an example of the Apprehending Zone and Conceptual-Phase problem-solving models. In Campbell, J. ed. Handbook of mathematical cognition, Psychology Press, New York, 2005, 213--234.

[17]

Goldin-Meadow, S. and Singer, M.A. From children's hands to adults' ears: gesture's role in teaching and learning. Developmental Psychology 39, 3 (2003), 509--520.

[18]

Hatano, G., Miyake, Y., and Binks, M. Performance of expert abacus operators. Cognition 5, 1 (1977), 57--71.

[19]

Karmiloff-Smith, A. The child is a theoretician, not an inductivist. Mind &#38; Language 3, 3 (1988), 183--195.

[20]

Kosslyn, S.M. 2005. Mental images and the brain. Cognitive Neuropsychology 22, 3/4 (2005), 333--347.

[21]

Lakoff, G. and Nunez, R.E. Where mathematics comes from: How the embodied mind brings mathematics into being. Basic Books, New York, 2000.

[22]

Lamon, S.J. Rational numbers and proportional reasoning: Toward a theoretical framework for research. In Lester, F.K. ed. Second handbook of research on mathematics teaching and learning, Information Age Publishing, Charlotte NC, 2007, 629--667.

[23]

Lee, H., Kim, H., Gupta, G., and Mazalek, A. WiiArts: creating collaborative art experience with WiiRemote interaction. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (Bonn, Germany, 2008), 33--36.

Digital Library

[24]

Lee, J.C. Hacking the Nintendo Wii Remote. IEEE Pervasive Computing 7, 3 (2008), 39--45.

Digital Library

[25]

Marshall, P., Cheng, P.C.-H., and Luckin, R. Tangibles in the balance: a discovery learning task with physical or graphical materials. In Proceedings of the 4th ACM International Conference on Tangible, Embedded, and Embodied Interaction (2010), 153--160.

Digital Library

[26]

Nemirovsky, R., Tierney, C. and Wright, T. Body motion and graphing. Cognition and Instruction 16, 2 (1998), 119--172.

[27]

Norman, D.A. Cognitive artifacts. In Carroll, J.M. ed. Designing interaction: Psychology at the human-computer interface. Cambridge University Press, New York, 1991, 17--38.

Digital Library

[28]

Papert, S. An exploration in the space of mathematics education. International Journal of Computers for Mathematical Learning 1 (1996), 95--123.

[29]

Pirie, S.E.B. and Kieren, T. Growth in mathematical understanding: How can we characterize it and how can we represent it? Educational Studies in Mathematics 26 (1994), 165--190.

[30]

Pratt, D. and Noss, R. Designing for mathematical abstraction. International Journal of Computers for Mathematical Learning 15, 2 (2010), 81--97.

[31]

Radford, L. Gestures, speech and the sprouting of signs: A semiotic-cultural approach to students' types of generalization. Mathematical Thinking and Learning 5, 1 (2003), 37--70.

[32]

Roschelle, J., Shechtman, N., Tatar, D., et al. Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics: Three Large-Scale Studies. American Educational Research Journal 47, 4 (2010), 833--878.

[33]

Salomon, G., Perkins, D.N., and Globerson, T. Partners in cognition: Extending human intelligences with intelligent technologies. Educational Researcher 20, 3 (1991), 2--9.

[34]

Saxe, G.B. and Esmonde, I. Studying cognition in flux: a historical treatment of fu in the shifting structure of Oksapmin mathematics. Mind, Culture, and Activity 12, 3--4 (2005), 171--225.

[35]

Schoenfeld, A. H., Smith, J. P., and Arcavi, A. Learning: The microgenetic analysis of one student's evolving understanding of a complex subject matter domain. In R. Glaser ed. Advances in instructional psychology, Erlbaum, Hillsdale NJ, 1991, 55--175.

[36]

Schwartz, D.L. Physical Imagery: Kinematic versus Dynamic Models. Cognitive Psychology 38 (1999), 433--464.

[37]

Schwartz, D.L. and Black, T. Inferences through imagined actions: Knowing by simulated doing. Journal of Experimental Psychology 25, 1 (1999), 116--136.

[38]

Schwartz, J.L. Can technology help us make the mathematics curriculum intellectually stimulating and socially responsible? International Journal of Computers for Mathematical Learning 4, 2 (1999), 99--119.

[39]

Shirai, A., Geslin, E., and Richir, S. WiiMedia: motion analysis methods and applications using a consumer video game controller. In Proceedings of the 2007 ACM SIGGRAPH Symposium on Video Games (San Diego CA, 2007), 133--140.

Digital Library

[40]

Stigler, J.W. 'Mental abacus'?: The effect of abacus training on Chinese children's mental calculation. Cognitive Psychology 16, 2 (1984), 145--17.

[41]

Vergnaud, G. The theory of conceptual fields. In Nunes, T. ed. Giving meaning to mathematical signs: psychological, pedagogical and cultural processes. Human Development {Special Issue} 52 (2009), 83--94.

[42]

Verillon, P. and Rabardel, P. Cognition and artifacts: A contribution to the study of thought in relation to instrumented activity. European Journal of Psychology of Education 10, 1 (1995), 77--101.

[43]

Yin, R.K. Case study research: design and methods. Sage, London, 2009.

Cited By

Chatain JGashaj VMuttappillil BSumner RKapur M(2024)Designing for Embodied Sense-making of Mathematics: Perspectives on Directed and Spontaneous Bodily ActionsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661571(3318-3335)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661571
Torgersson OBaykal GEriksson E(2024)Learning from Learning - Design-Based Research Practices in Child-Computer InteractionProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655754(338-354)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655754
Swidan OSchacht FLudwig MFlood V(2024)Instrumental Orchestration with Emerging Digital TechnologyHandbook of Digital Resources in Mathematics Education10.1007/978-3-031-45667-1_31(779-799)Online publication date: 22-Jun-2024
https://doi.org/10.1007/978-3-031-45667-1_31
Show More Cited By

Index Terms

The mathematical imagery trainer: from embodied interaction to conceptual learning
1. Information systems
  1. Information systems applications
2. Social and professional topics
  1. Professional topics

Index terms have been assigned to the content through auto-classification.

Recommendations

Toward an embodied-interaction design framework for mathematical concepts
IDC '11: Proceedings of the 10th International Conference on Interaction Design and Children

Recent, empirically supported theories of cognition indicate that human reasoning, including mathematical problem solving, is based in tacit spatial-temporal simulated action. Implications of these findings for the philosophy and design of instruction ...
The choreography of conceptual development in computer supported instructional environments
IDC '12: Proceedings of the 11th International Conference on Interaction Design and Children

A key affordance of computational learning environments is that they can be designed to instantiate specific rules and causal relationships between user inputs and perceptual output. In this sense, designers can attempt to engineer specific trajectories ...
The choreography of conceptual development in computer supported instructional environments
IDC '12: Proceedings of the 11th International Conference on Interaction Design and Children

A key affordance of computational learning environments is that they can be designed to instantiate specific rules and causal relationships between user inputs and perceptual output. In this sense, designers can attempt to engineer specific trajectories ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
1,358
Total Downloads

Downloads (Last 12 months)89
Downloads (Last 6 weeks)13

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chatain JGashaj VMuttappillil BSumner RKapur M(2024)Designing for Embodied Sense-making of Mathematics: Perspectives on Directed and Spontaneous Bodily ActionsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661571(3318-3335)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661571
Torgersson OBaykal GEriksson E(2024)Learning from Learning - Design-Based Research Practices in Child-Computer InteractionProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655754(338-354)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655754
Swidan OSchacht FLudwig MFlood V(2024)Instrumental Orchestration with Emerging Digital TechnologyHandbook of Digital Resources in Mathematics Education10.1007/978-3-031-45667-1_31(779-799)Online publication date: 22-Jun-2024
https://doi.org/10.1007/978-3-031-45667-1_31
Swidan OSchacht FLudwig MFlood V(2024)Instrumental Orchestration with Emerging Digital TechnologyHandbook of Digital Resources in Mathematics Education10.1007/978-3-030-95060-6_31-1(1-21)Online publication date: 10-Feb-2024
https://doi.org/10.1007/978-3-030-95060-6_31-1
Chatain JKapur MSumner R(2023)Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction DesignExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585805(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585805
Müller CReiher MKapur M(2023)Embodied preparation for learning basic quantum chemistry: A mixed‐method studyJournal of Computer Assisted Learning10.1111/jcal.1290940:2(715-730)Online publication date: 28-Nov-2023
https://doi.org/10.1111/jcal.12909
Reinboth TFarkaš I(2022)Ultimate Grounding of Abstract Concepts: A Graded AccountJournal of Cognition10.5334/joc.2145:1Online publication date: 11-Mar-2022
https://doi.org/10.5334/joc.214
Chatain JRamp VGashaj VFayolle VKapur MSumner RMagnenat S(2022)Grasping Derivatives: Teaching Mathematics through Embodied Interactions using Tablets and Virtual RealityProceedings of the 21st Annual ACM Interaction Design and Children Conference10.1145/3501712.3529748(98-108)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3501712.3529748
Alberto RShvarts ADrijvers PBakker A(2022)Action-based embodied design for mathematics learningInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10041932:COnline publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1016/j.ijcci.2021.100419
Closser AErickson JSmith HVaratharaj ABotelho A(2022)Blending learning analytics and embodied design to model students’ comprehension of measurement using their actions, speech, and gesturesInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10039132:COnline publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1016/j.ijcci.2021.100391
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents