research-article

Quantitative measurement of virtual vs. physical object embodiment through kinesthetic figural after effects

Authors:

Miguel NacentaAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2903 - 2912

https://doi.org/10.1145/2556288.2557282

Published: 26 April 2014 Publication History

Abstract

Over the past decade, multi-touch surfaces have become commonplace, with many researchers and practitioners describing the benefits of their natural, physical-like interactions. We present a pair of studies that empirically investigates the psychophysical effects of direct interaction with both physical and virtual artefacts. We use the phenomenon of Kinesthetic Figural After Effects-a change in understanding of the physical size of an object after a period of exposure to an object of different size. Our studies show that, while this effect is robustly reproducible when using physical artefacts, this same effect does not manifest when manipulating virtual artefacts on a direct, multi-touch tabletop display. We contribute quantitative evidence suggesting a psychophysical difference in our response to physical vs. virtual objects, and discuss future research directions to explore measurable phenomena to evaluate the presence of physical-like changes from virtual on-screen objects.

References

[1]

Arzy, S., Thut, G., Mohr, C., Michel, C.M., and Blanke, O. Neural basis of embodiment: distinct contributions of temporoparietal junction and extrastriate body area. Journal of Neuroscience 26, 31 (2006), 8074--8081.

[2]

Benford, S., Browers, J., Fahlen, E.L., Greenhalgh, C., Snowdon, D. User embodiment in collaborative virtual environments. In Proc. CHI, ACM Press (1995), 242249.

Digital Library

[3]

Benko, H., Harrison, C., Wilson, A.D. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. UIST, ACM Press (2011), 441--450.

Digital Library

[4]

Botvinick, M. & Cohen, J. Rubber hands 'feel' touch that eyes see. Nature 391, 6669 (1998), 756.

[5]

Brozzoli, C., Cardinali L., Pavani F., and Farnè A. Action-specific remapping of peripersonal space. Neuropsychologia 48, 3 (2010), 796--802.

[6]

Buxton, B., Multi-touch Systems that I Have Known and Loved. http://www.billbuxton.com/multitouchOverview.html. Original: 2007. Last retrieved: Jan 2014.

[7]

Cardinali, L., Frassinetti, F., Brozzoli, C., Urquizar, C., Roy, A. C., Farnè, A. Tool-use induces morphological updating of the body schema. Current Biology 19, 12 (2009), R478--R479.

[8]

Churchill, A.V. Quantitative Tactual-Kinesthetic Judgment. Perceptual and Motor Skills 20 (1965), 1147--1148.

[9]

Coyle, D., Moore, J. Kristensson, P.O., Fletcher, P.C., Blackwell, A.F. I did that! Measuring Users-Experience of Agency in their own Actions. In Proc. CHI'12.

Digital Library

[10]

Dourish, P. Where the Action Is: The Foundations of Embodied Interaction. MIT Press, 2001.

Digital Library

[11]

Durgin, F.H., Evans, L., Dunphy, N., Klostermann, S., Simmons, K. Rubber hands feel the touch of light. Psychological Science 18, 2 (2007), 152--157.

[12]

Gibson, J. J. The visual perception of objective motion and subjective movement. Psychol. Rev 61 (1954), 304--314.

[13]

Gibson, J. J., & Backlund, F. An aftereffect in haptic space perception. Quart. J. Exp. Psychol, (1963).

[14]

Gibson, J. J. The perception of visual surfaces. Amer. J. Psychol, 43 (1950), 367--384.

[15]

Hancock, M., Cate, T.T., and Carpendale, S. Sticky tools: Full 6DOF force-based interaction for multi-touch tables. In Proc. ITS, ACM Press (2009), 133--140.

Digital Library

[16]

Heinemann, E.G. Figural after effects in kinesthesis: Effects of object width and repeated presentations. Journal of Experimental Psychology 61, 1 (1961), 51--56.

[17]

Holmes, N.P. and Spence, C. Beyond the body schema: Visual, prosthetic, and technological contributions tobodily perception and awareness. Human body perception from the inside out, (2006), 15--64.

[18]

Ishii, H., Lakatos, D., Bonanni, L., Labrune, J.B. Radical atoms: beyond tangible bits, toward transformable materials. Interactions 19 (2012), 38--51.

Digital Library

[19]

Jordà, S., Geiger, G. Alonso, M., Kaltenbrunner, M., The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. TEI, ACM Press (2007), 139--146.

Digital Library

[20]

Kelvin, R. P. Discrimination of size by sight and touch. Quart. J. exp. Psychol 69, 6 (1954), 23--34.

[21]

Kidd, A.H., Beere, D.B. Relationship between kinaesthetic figural aftereffect and certain personality variables. Perceptual and Motor Skills 26 (1968) 577--587.

[22]

Kohler, W., and Dinnerstein, D. Figural after-effects in kinaesthesis. Miscellanea psychologica Albert Michotte. Louvain: Editions de 1'Institut Superieur de Philosophie, (1949), 196--220.

[23]

Leap Motion. http://www.leapmotion.com. Last retrieved: Jan 2014.

[24]

Maravita, A. and Iriki, A. Tools for the body (schema). TRENDS in Cognitive Sciences 8, 2 (2004), 79--86.

[25]

Marino, B., Stucchi, N., Nava, E., Haggard, P., and Maravita, A. Distorting the visual size of the hand affects hand pre-shaping during grasping. Experimental Brain Research 202, 2 (2010), 499--505.

[26]

McDonnell, P.M., Scott, R.N., Dickison, J., Theriault, R.A., Wood, B. Do artificial limbs become part of the user? New evidence. Journal of Rehabilitation Research and Development 26, 2 (1989), 17--24.

[27]

Nacenta, M.A., Pinelle, D., Gutwin, C., Mandryk, R. Individual and group support in tabletop interaction techniques. In Tabletops -- Horizontal Interactive Displays, C. Müller-Tomfelde, Ed. Springer (2010), 303--333.

[28]

Patel, H. and Morreale, P. 2014. Education and learning: electronic books or traditional printed books? J. Comput. Sci. Coll. 29, 3 (2014), 21--28.

Digital Library

[29]

Petrie, A. Individuality in pain and suffering (2nd ed.). U. Chicago Press, 1978, 107--127.

[30]

Phelan J.G, Brooks R., Brashears G.C. Relationship of kinesthetic figural aftereffect to masculinity-femininity and expectation for internal versus external control of reinforcement. Perceptual and Motor Skills 31 (1970), 863--866.

[31]

Platt, D., Holzman, P.S., Larson, D. Individual consistencies in kinesthetic figural aftereffects. Perceptual and Motor Skills 32 (1971), 787--795.

[32]

Polanyi, M. The tacit dimension. Anchor Books, Garden City, N.Y, 1966.

[33]

Processing. http://processing.org. Last retrieved: Jan 2014.

[34]

Reactable Systems S.L., Reactable Mobile. http://reactable.com/products/mobile/. Last retrieved: Jan 2014.

[35]

Sheridan, T.B. Further musings on the psychophysics of presence. Systems, Man, and Cybernetics 2 (1994), 1073--1077.

[36]

Tang, A., Neustaedter, C., Greenberg, S. VideoArms: Embodiments for mixed presence groupware. In People and Computers XX -- Engage, N. Bryann-Kinns, A. Blanford, P. Curzon, L. Nigay, Eds., Springer (2010), 85--102.

[37]

Ullmer, B., Ishii, H. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39 (2000), 915--931.

Digital Library

[38]

de Vignemont, F. Embodiment, ownership and disownership. Consciousness and Cognition 20 (2010), 82--93.

[39]

Welch, R.B. and Warren, D.H. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88, 3 (1980), 638--667.

Cited By

Bozgeyikli L(2024)Real-Virtual Objects: Exploring Bidirectional Embodied Tangible Interaction with a Virtual Human in World-Fixed Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00038(147-156)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00038
Bozgeyikli LBozgeyikli E(2022)Tangiball: Foot-Enabled Embodied Tangible Interaction with a Ball in Virtual Reality2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00103(812-820)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00103
Drogemuller ACunningham AWalsh JBaumeister JSmith RThomas BKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Haptic and Visual Comprehension of a 2D Graph Layout Through PhysicalisationProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445704(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445704
Show More Cited By

Index Terms

Quantitative measurement of virtual vs. physical object embodiment through kinesthetic figural after effects
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Measuring Readiness-to-Hand through Differences in Attention to the Task vs. Attention to the Tool
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

New interaction techniques, like multi-touch, tangible interaction, and mid-air gestures often promise to be more intuitive and natural; however, there is little work on how to measure these constructs. One way is to leverage the phenomenon of tool ...
SLAP widgets: bridging the gap between virtual and physical controls on tabletops
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are cast from silicone or made of acrylic, and include sliders, knobs, keyboards, and buttons. They add ...
SLAP widgets: bridging the gap between virtual and physical controls on tabletops
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, transparent widgets for use on vision-based multi-touch tabletops. SLAP Widgets are cast from silicone or made of acrylic and include sliders, knobs, keyboards, and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
410
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bozgeyikli L(2024)Real-Virtual Objects: Exploring Bidirectional Embodied Tangible Interaction with a Virtual Human in World-Fixed Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00038(147-156)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00038
Bozgeyikli LBozgeyikli E(2022)Tangiball: Foot-Enabled Embodied Tangible Interaction with a Ball in Virtual Reality2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00103(812-820)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00103
Drogemuller ACunningham AWalsh JBaumeister JSmith RThomas BKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Haptic and Visual Comprehension of a 2D Graph Layout Through PhysicalisationProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445704(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445704
Bozgeyikli L(2021)Give Me a Hand: Exploring Bidirectional Mutual Embodied Tangible Interaction in Virtual Reality2021 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE50685.2021.9427733(1-6)Online publication date: 10-Jan-2021
https://doi.org/10.1109/ICCE50685.2021.9427733
Alzayat ALee S(2021)Virtual products as an extension of my body: Exploring hedonic and utilitarian shopping value in a virtual reality retail environmentJournal of Business Research10.1016/j.jbusres.2021.03.017130(348-363)Online publication date: Jun-2021
https://doi.org/10.1016/j.jbusres.2021.03.017
Ramkumar NFereydooni NShaer OKun AKhamis MSorce SCauchard JGentile V(2019)Visual behavior during engagement with tangible and virtual representations of archaeological artifactsProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324930(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324930
Bozgeyikli LBozgeyikli EHarrison SBardzell SNeustaedter CTatar D(2019)TangiballCompanion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion10.1145/3301019.3323904(135-140)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3301019.3323904
Alzayat AHancock MNacenta MBrewster SFitzpatrick GCox AKostakos V(2019)Quantitative Measurement of Tool Embodiment for Virtual Reality Input AlternativesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300673(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300673
Knibbe JSchjerlund JPetraeus MHornbæk KMandryk RHancock MPerry MCox A(2018)The Dream is CollapsingProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174057(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174057
Le Goc MDragicevic PHuron SBoy JFekete JCostabile MBuono PMatera M(2016)A Better Grasp on Pictures Under GlassProceedings of the International Working Conference on Advanced Visual Interfaces10.1145/2909132.2909247(76-83)Online publication date: 7-Jun-2016
https://dl.acm.org/doi/10.1145/2909132.2909247

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents