Cited By
View all- Brazil CRys M(2024)The effect of VR on fine motor performance by older adults: a comparison between real and virtual tasksVirtual Reality10.1007/s10055-024-01009-928:2Online publication date: 20-May-2024
Virtual Reality for Object Location Spatial Memory: A Comparison of Handheld Controllers and Force Feedback Gloves
Article No.: 24, Pages 1 - 9
Abstract
Object Location Spatial Memory (OLSM) is used in everyday tasks for which it is important to remember where objects are in space. The spatial image of the environment to perform such OLSM tasks is created based on inputs from three spatial senses (visual, auditory, and haptic). Various causes, ranging from traumatic brain injury to Alzheimer’s disease and dementia, can compromise OLSM, requiring OLSM rehabilitation techniques. Virtual reality (VR) can provide a safe environment for engaging rehabilitation experiences. In the last years, new technologies for multi-modal interaction such as force feedback gloves (FGs) have appeared on the market, but their possible advantages over handheld controllers (HCs) that come together with head-mounted displays have not been evaluated in the context of OLSM tasks. This paper investigates whether adding haptic input can lead to more effective OLSM training by comparing a pair of HCs with a pair of FGs in performing the same OLSM task, i.e. placing different objects in memorized locations. We conducted a within-subjects user study with 24 participants who performed the OLSM task in two conditions: with HCs and with FGs. Presence was measured with the IPQ questionnaire, and results showed statistically significant differences in favor of interacting with FGs on the general item about the sense of being there. Participants judged the system usability high in both conditions. Perceived fatigue was higher when using FGs. We expected better performance with FGs thanks to the addition of haptic input, but no statistically significant differences were found in the total number of correctly placed objects. Results showed that the time to complete the task was lower with the HCs than FGs. Future comparisons with other types of FGs may confirm that this type of OLSM task does not benefit from specialized haptic hardware, supporting the possibility of performing OLSM rehabilitation exercises at patients’ home with affordable commercial VR kits.
References
[1]
Adilzhan Adilkhanov, Matteo Rubagotti, and Zhanat Kappassov. 2022. Haptic Devices: Wearability-Based Taxonomy and Literature Review. IEEE Access 10 (2022), 91923–91947. https://doi.org/10.1109/ACCESS.2022.3202986
[2]
Thomas Alsop. 2023. VR headset sales volume growth 2017-2027. https://www.statista.com/forecasts/1331897/vr-headset-sales-volume-growth-worldwide
[3]
Alan Baddeley. 2010. Working memory. Current Biology 20, 4 (Feb. 2010), R136–R140. https://doi.org/10.1016/j.cub.2009.12.014
[4]
John Brooke. 1996. SUS: A ’Quick and Dirty’ Usability Scale. In Usability Evaluation In Industry. CRC Press.
[5]
Sarah A. Douglas, Arthur E. Kirkpatrick, and I. Scott MacKenzie. 1999. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems(CHI ’99). Association for Computing Machinery, New York, NY, USA, 215–222. https://doi.org/10.1145/302979.303042
[6]
Aviv Elor, Michael Powell, Evanjelin Mahmoodi, Mircea Teodorescu, and Sri Kurniawan. 2022. Gaming Beyond the Novelty Effect of Immersive Virtual Reality for Physical Rehabilitation. IEEE Transactions on Games 14, 1 (March 2022), 107–115. https://doi.org/10.1109/TG.2021.3069445
[7]
Ivana Gazova, Kamil Vlček, Jan Laczó, Zuzana Nedelska, Eva Hyncicova, Ivana Mokrisova, Katerina Sheardova, and Jakub Hort. 2012. Spatial navigation-A unique window into physiological and pathological aging. Frontiers in aging neuroscience 4 (June 2012), 16. https://doi.org/10.3389/fnagi.2012.00016
[8]
Patrick Gebhardt, Xingyao Yu, Andreas Köhn, and Michael Sedlmair. 2022. MolecuSense: Using Force-Feedback Gloves for Creating and Interacting with Ball-and-Stick Molecules in VR. In Proceedings of the 15th International Symposium on Visual Information Communication and Interaction(VINCI ’22). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3554944.3554956
[9]
Anthony G. Greenwald. 1976. Within-subjects designs: To use or not to use?Psychological Bulletin 83, 2 (1976), 314–320. https://doi.org/10.1037/0033-2909.83.2.314
[10]
The Khronos Group. 2016. OpenXR - High-performance access to AR and VR —collectively known as XR— platforms and devices. https://www.khronos.org/OpenXR/
[11]
Vincent Hayward, Oliver R. Astley, Manuel Cruz‐Hernandez, Danny Grant, and Gabriel Robles‐De‐La‐Torre. 2004. Haptic interfaces and devices. Sensor Review 24, 1 (Jan. 2004), 16–29. https://doi.org/10.1108/02602280410515770
[12]
Thomas Hinterecker, Caroline Leroy, Mintao Zhao, Martin V. Butz, Heinrich H. Bülthoff, and Tobias Meilinger. 2018. No advantage for remembering horizontal over vertical spatial locations learned from a single viewpoint. Memory & Cognition 46, 1 (Jan. 2018), 158–171. https://doi.org/10.3758/s13421-017-0753-9
[13]
HTC. 2023. VIVE European Union | Discover Virtual Reality Beyond Imagination. https://www.vive.com/eu/
[14]
Jiawei Huang and Alexander Klippel. 2020. The Effects of Visual Realism on Spatial Memory and Exploration Patterns in Virtual Reality. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology(VRST ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3385956.3418945
[15]
IBM. 2022. Software SPSS. https://www.ibm.com/it-it/spss
[16]
IDC. 2023. AR/VR Headset Shipments. https://www.idc.com/getdoc.jsp?containerId=prUS48969722
[17]
Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. ACM Press.
[18]
Roy P. C. Kessels, Edward H. F. de Haan, L. Jaap Kappelle, and Albert Postma. 2001. Varieties of human spatial memory: a meta-analysis on the effects of hippocampal lesions. Brain Research Reviews 35, 3 (July 2001), 295–303. https://doi.org/10.1016/S0165-0173(01)00058-3
[19]
Roy P. C Kessels, L Jaap Kappelle, Edward H. F de Haan, and Albert Postma. 2002. Lateralization of spatial-memory processes: evidence on spatial span, maze learning, and memory for object locations. Neuropsychologia 40, 8 (Jan. 2002), 1465–1473. https://doi.org/10.1016/S0028-3932(01)00199-3
[20]
Roy P. C. Kessels, Stefan Rijken, Liesbeth W. a. Joosten-Weyn Banningh, Nelleke Van Schuylenborgh-Van Es, and Marcel G. M. Olde Rikkert. 2010. Categorical spatial memory in patients with mild cognitive impairment and Alzheimer dementia: Positional versus object-location recall. Journal of the International Neuropsychological Society 16, 1 (Jan. 2010), 200–204. https://doi.org/10.1017/S1355617709990944
[21]
Philip Kortum and S. Camille Peres. 2014. The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale. International Journal of Human–Computer Interaction 30, 7 (July 2014), 575–584. https://doi.org/10.1080/10447318.2014.904177
[22]
Julian Kreimeier and Timo Götzelmann. 2018. FeelVR: Haptic Exploration of Virtual Objects. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference(PETRA ’18). Association for Computing Machinery, New York, NY, USA, 122–125. https://doi.org/10.1145/3197768.3201526
[23]
Julian Kreimeier, Sebastian Hammer, Daniel Friedmann, Pascal Karg, Clemens Bühner, Lukas Bankel, and Timo Götzelmann. 2019. Evaluation of different types of haptic feedback influencing the task-based presence and performance in virtual reality. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’19). Association for Computing Machinery, New York, NY, USA, 289–298. https://doi.org/10.1145/3316782.3321536
[24]
Hai-Ning Liang, Feiyu Lu, Yuwei Shi, Vijayakumar Nanjappan, and Konstantinos Papangelis. 2019. Evaluating the effects of collaboration and competition in navigation tasks and spatial knowledge acquisition within virtual reality environments. Future Generation Computer Systems 95 (June 2019), 855–866. https://doi.org/10.1016/j.future.2018.02.029
[25]
Jack M. Loomis, Roberta L. Klatzky, and Nicholas A. Giudice. 2013. Representing 3D Space in Working Memory: Spatial Images from Vision, Hearing, Touch, and Language. In Multisensory Imagery, Simon Lacey and Rebecca Lawson (Eds.). Springer, New York, NY, 131–155. https://doi.org/10.1007/978-1-4614-5879-1_8
[26]
E. Macaluso and A. Maravita. 2010. The representation of space near the body through touch and vision. Neuropsychologia 48, 3 (Feb. 2010), 782–795. https://doi.org/10.1016/j.neuropsychologia.2009.10.010
[27]
Maria Grazia Maggio, Giuseppa Maresca, Rosaria De Luca, Maria Chiara Stagnitti, Bruno Porcari, Maria Cristina Ferrera, Franco Galletti, Carmela Casella, Alfredo Manuli, and Rocco Salvatore Calabrò. 2019. The Growing Use of Virtual Reality in Cognitive Rehabilitation: Fact, Fake or Vision? A Scoping Review. Journal of the National Medical Association 111, 4 (Aug. 2019), 457–463. https://doi.org/10.1016/j.jnma.2019.01.003
[28]
Shachar Maidenbaum, Ansh Patel, Elisabeth Stein, and Joshua Jacobs. 2019. Spatial Memory Rehabilitation in Virtual Reality – Extending findings from Epilepsy Patients to the General Population. In 2019 International Conference on Virtual Rehabilitation (ICVR). 1–7. https://doi.org/10.1109/ICVR46560.2019.8994573 ISSN: 2331-9569.
[29]
Fabien Mathy and Jacob Feldman. 2012. What’s magic about magic numbers? Chunking and data compression in short-term memory. Cognition 122, 3 (March 2012), 346–362. https://doi.org/10.1016/j.cognition.2011.11.003
[30]
George A. Miller. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63, 2 (1956), 81–97. https://doi.org/10.1037/h0043158
[31]
Daniel R. Montello, David Waller, Mary Hegarty, and Anthony E. Richardson. 2003. Spatial Memory of Real Environments, Virtual Environments, and Maps. In Human Spatial Memory. Psychology Press.
[32]
Hye Sung Moon, Grady Orr, and Myounghoon Jeon. 2022. Hand Tracking with Vibrotactile Feedback Enhanced Presence, Engagement, Usability, and Performance in a Virtual Reality Rhythm Game. International Journal of Human–Computer Interaction (June 2022), 1–12. https://doi.org/10.1080/10447318.2022.2087000
[33]
Takuro Nakao, Kai Kunze, Megumi Isogai, Shinya Shimizu, and Yun Suen Pai. 2020. FingerFlex: Shape Memory Alloy-based Actuation on Fingers for Kinesthetic Haptic Feedback. In Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia(MUM ’20). Association for Computing Machinery, New York, NY, USA, 240–244. https://doi.org/10.1145/3428361.3428404
[34]
F. Gabriele Pratticò, Davide Calandra, Matteo Piviotti, and Fabrizio Lamberti. 2021. Assessing the User Experience of Consumer Haptic Devices for Simulation-based Virtual Reality. In 2021 IEEE 11th International Conference on Consumer Electronics (ICCE-Berlin). 1–6. https://doi.org/10.1109/ICCE-Berlin53567.2021.9719998
[35]
Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The Experience of Presence: Factor Analytic Insights. Presence: Teleoperators and Virtual Environments 10, 3 (June 2001), 266–281. https://doi.org/10.1162/105474601300343603
[36]
Maria T. Schultheis and Albert A. Rizzo. 2001. The application of virtual reality technology in rehabilitation. Rehabilitation Psychology 46 (2001), 296–311. https://doi.org/10.1037/0090-5550.46.3.296
[37]
Senseglove. 2023. VR & Haptic Technology Gloves | SenseGlove | Feel the virtual like it’s real. https://www.senseglove.com/
[38]
Mel Slater and Sylvia Wilbur. 1997. A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments 6, 6 (Dec. 1997), 603–616. https://doi.org/10.1162/pres.1997.6.6.603
[39]
Heidi Sveistrup. 2004. Motor rehabilitation using virtual reality. Journal of NeuroEngineering and Rehabilitation 1, 1 (Dec. 2004), 10. https://doi.org/10.1186/1743-0003-1-10
[40]
Unity Technologies. 2022. Unity Real-Time Development Platform | 3D, 2D VR & AR Engine. https://unity.com/
[41]
Qisong Wang, Bo Kang, and Per Ola Kristensson. 2022. Supporting Playful Rehabilitation in the Home using Virtual Reality Headsets and Force Feedback Gloves. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 504–513. https://doi.org/10.1109/VR51125.2022.00070
[42]
Paul N. Wilson, Nigel Foreman, and Danaë Stanton. 1997. Virtual reality, disability and rehabilitation. Disability and Rehabilitation 19, 6 (Jan. 1997), 213–220. https://doi.org/10.3109/09638289709166530
[43]
Ria Wolkorte, Dorothea J. Heersema, and Inge Zijdewind. 2015. Reduced Dual-Task Performance in MS Patients Is Further Decreased by Muscle Fatigue. Neurorehabilitation and Neural Repair 29, 5 (June 2015), 424–435. https://doi.org/10.1177/1545968314552529
[44]
Mengxin Xu, Maria Murcia-Lopez, and Anthony Steed. 2017. Object location memory error in virtual and real environments. In 2017 IEEE Virtual Reality (VR). IEEE, Los Angeles, CA, USA, 315–316. https://doi.org/10.1109/VR.2017.7892303
[45]
M. Zyda. 2005. From visual simulation to virtual reality to games. Computer 38, 9 (Sept. 2005), 25–32. https://doi.org/10.1109/MC.2005.297
Index Terms
- Virtual Reality for Object Location Spatial Memory: A Comparison of Handheld Controllers and Force Feedback Gloves
Recommendations
CAVE and Fishtank Virtual-Reality Displays: A Qualitative and Quantitative Comparison
We present the results from a qualitative and quantitative user study comparing fishtank virtual-reality (VR) and CAVE displays. The results of the qualitative study show that users preferred the fishtank VR display to the CAVE system for our scientific ...
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyThis paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...
The Importance of Virtual Hands and Feet for Virtual Reality Climbing
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsVirtual reality (VR) climbing systems registering physical climbing walls with immersive virtual environments (IVEs) have been a focus of past research. Such systems can provide physical user experiences similar to climbing in (extreme) outdoor ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2023
416 pages
ISBN:9798400708060
DOI:10.1145/3605390
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 September 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
CHItaly 2023
CHItaly 2023: 15th Biannual Conference of the Italian SIGCHI Chapter
September 20 - 22, 2023
Torino, Italy
Acceptance Rates
Overall Acceptance Rate 109 of 242 submissions, 45%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 267Total Downloads
- Downloads (Last 12 months)267
- Downloads (Last 6 weeks)38
Reflects downloads up to 28 Sep 2024
Other Metrics
Citations
Cited By
View all- Brazil CRys M(2024)The effect of VR on fine motor performance by older adults: a comparison between real and virtual tasksVirtual Reality10.1007/s10055-024-01009-928:2Online publication date: 20-May-2024
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in