Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3013971.3014012acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Evaluating virtual reality experience and performance: a brain based approach

Published: 03 December 2016 Publication History

Abstract

The recent trend and parallel development/adoption of Virtual Reality, Brain Sensing Measures and associated technology such as Augmented Reality by large corporations, and the rise in the interests in the consumer market have set a positive tone for research in these disciplines. An important human factors area that is a catalyst to broad VR applications is the measure of perception, mental workload, and immersion amongst other issues, which are determining factors in the experience of using virtual environments. Traditional approaches in studying these issues use well-developed subjective measures via questionnaires. A new opportunity in the parallel developments in wearable physiological sensors such as brain scanners could potentially be an objective approach in resolving many subjective uncertainties amongst other prospects. Here, we propose the integration of these two emerging fields in order to provide a continuous, objective, physiological measure of an individual's VR experience for the purposes of enhancing user experience and improving performance. This positional paper attempts to merge two complementary field of work, and discusses implications which could potentially open up avenues of research which were traditionally difficult due to the limitations of equipment, or the lack of quantified approach.

References

[1]
Ch'ng, E. (2012) New Ways of Accessing Information Spaces Using 3D Multitouch Tables. Proceedings of the Art, Design and Virtual Worlds Conference, Cyberworlds 2012, Darmstadt, Germany, 25--27 September 2012.
[2]
Ch'ng E and Cooke N. (2015) User Study on 3D Multitouch Interaction (3DMi) and Gaze on Surface Computing. InInternational Conference of Design, User Experience, and Usability 2015 Aug 2 (pp. 425--433). Springer International Publishing.
[3]
Fedkiw, R., Stam, J., and Jensen, H. W. 2001. Visual simulation of smoke. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 15--22.
[4]
Jobson, D. J., Rahman, Z., and Woodell, G. A. 1995. Retinex image processing: Improved fidelity to direct visual observation. In Proceedings of the IS&T Fourth Color Imaging Conference: Color Science, Systems, and Applications, vol. 4, The Society for Imaging Science and Technology, 124--125.
[5]
Kane, M. J., and Engle, R. W. The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective. Psychonomic bulletin & review 9, 4 (2002), 637--671.
[6]
Darken, Rudolph P., and John L. Sibert. "Navigating large virtual spaces." International Journal of Human-Computer Interaction 8.1 (1996): 49--71.
[7]
Kaur, K. (1998). Designing virtual environments for usability. Unpublished doctoral dissertation, University College London.
[8]
Hart, Sandra G., and Lowell E. Staveland. "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research." Advances in psychology 52 (1988): 139--183.
[9]
Hart, Sandra G. "NASA-task load index (NASA-TLX); 20 years later." Proceedings of the human factors and ergonomics society annual meeting. Vol. 50. No. 9. Sage Publications, 2006.
[10]
Hix, D., Swan, J., Gabbard, J., McGee, M., Durbin, J., & King, T. (1999). User-centered design and evaluation of a real-time battlefield visualization virtual environment. Proceedings of IEEE Virtual Reality, 96--103.
[11]
Bowman, Doug A., Donald B. Johnson, and Larry F. Hodges. "Testbed evaluation of virtual environment interaction techniques." Presence 10.1 (2001): 75--95.
[12]
Miller, E. K., and Cohen, J. D. An integrative theory of prefrontal cortex function. Annual review of neuroscience 24, 1 (2001), 167--202.
[13]
Herndon, Kenneth P., Andries van Dam, and Michael Gleicher. "The challenges of 3D interaction: a CHI'94 workshop." ACM SIGCHI Bulletin 26.4 (1994): 36--43.
[14]
Nash, Eric B., et al. "A review of presence and performance in virtual environments." International Journal of human-computer Interaction 12.1 (2000): 1--41.
[15]
Stanney, Kay M., Ronald R. Mourant, and Robert S. Kennedy. "Human factors issues in virtual environments: A review of the literature." Presence7.4 (1998): 327--351.
[16]
Reid, Gary B., and Thomas E. Nygren. "The subjective workload assessment technique: A scaling procedure for measuring mental workload." Advances in psychology 52 (1988): 185--218.
[17]
Rose, F. D., et al. "Training in virtual environments: transfer to real world tasks and equivalence to real task training." Ergonomics 43.4 (2000): 494--511.
[18]
Tsang, Pamela S., and Velma L. Velazquez. "Diagnosticity and multidimensional subjective workload ratings." Ergonomics 39.3 (1996): 358--381.
[19]
Rubio, Susana, et al. "Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and workload profile methods." Applied Psychology 53.1 (2004): 61--86.
[20]
Mestre, Daniel, et al. "Immersion et présence." Le traité de la réalité virtuelle. Paris: Ecole des Mines de Paris (2006): 309--38.
[21]
Nash, Eric B., et al. "A review of presence and performance in virtual environments." International Journal of human-computer Interaction 12.1 (2000): 1--41.
[22]
Witmer, Bob G., and Michael J. Singer. "Measuring presence in virtual environments: A presence questionnaire." Presence: Teleoperators and virtual environments 7.3 (1998): 225--240.
[23]
Niedermeyer, Ernst, and FH Lopes da Silva, eds. Electroencephalography: basic principles, clinical applications, and related fields. Lippincott Williams & Wilkins, 2005.
[24]
Tan, Desney, and Anton Nijholt. "Brain-computer interfaces and human-computer interaction." Brain-Computer Interfaces. Springer London, 2010. 3--19.
[25]
Anderson, Erik W., et al. "A user study of visualization effectiveness using EEG and cognitive load." Computer Graphics Forum. Vol. 30. No. 3. Blackwell Publishing Ltd, 2011.
[26]
Pike, M., Wilson, M. L., Divoli, A., & Medelyan, A. "CUES: Cognitive Usability Evaluation System". EuroHCIR, 2010. 12, 1--4.
[27]
Frey, Jérémy, et al. "Review of the use of electroencephalography as an evaluation method for human-computer interaction." arXiv preprint arXiv:1311.2222 (2013).
[28]
Peck, Evan M. M., et al. "Using fNIRS brain sensing to evaluate information visualization interfaces." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2013.
[29]
Solovey, Erin Treacy, et al. "Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines." Proceedings of the 22nd annual ACM symposium on User interface software and technology. ACM, 2009.
[30]
Villringer, Arno, et al. "Near infrared spectroscopy (NIRS): a new tool to study hemodynamic changes during activation of brain function in human adults." Neuroscience letters 154.1 (1993): 101--104.
[31]
Fuster, Joaquin M. "Prefrontal cortex." Comparative Neuroscience and Neurobiology. Birkhäuser Boston, 1988. 107--109.
[32]
Pike, Matthew F., et al. "Measuring the effect of think aloud protocols on workload using fNIRS." Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2014.
[33]
Baddeley, Alan D., and Graham Hitch. "Working memory." Psychology of learning and motivation 8 (1974): 47--89.
[34]
Wickens, Christopher D. "Multiple resources and mental workload." Human Factors: The Journal of the Human Factors and Ergonomics Society 50.3 (2008): 449--455.

Cited By

View all
  • (2024)VR Training Effectiveness Evaluation Based on Activity Data AnalysisOpen Science in Engineering10.1007/978-3-031-42467-0_92(989-1001)Online publication date: 1-Jan-2024
  • (2023)Factors Influencing Engagement in Hybrid Virtual and Augmented RealityACM Transactions on Computer-Human Interaction10.1145/358995230:4(1-27)Online publication date: 30-Mar-2023
  • (2022)H-GOMS: a model for evaluating a virtual-hand interaction system in virtual environmentsVirtual Reality10.1007/s10055-022-00674-y27:2(497-522)Online publication date: 22-Jul-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1
December 2016
381 pages
ISBN:9781450346924
DOI:10.1145/3013971
  • Conference Chairs:
  • Yiyu Cai,
  • Daniel Thalmann
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. brain computer interfaces
  2. cognitive ergonomics
  3. human computer interaction
  4. human factors
  5. quantitative measures
  6. user experience
  7. virtual reality

Qualifiers

  • Research-article

Conference

VRCAI '16
Sponsor:

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)1
Reflects downloads up to 30 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)VR Training Effectiveness Evaluation Based on Activity Data AnalysisOpen Science in Engineering10.1007/978-3-031-42467-0_92(989-1001)Online publication date: 1-Jan-2024
  • (2023)Factors Influencing Engagement in Hybrid Virtual and Augmented RealityACM Transactions on Computer-Human Interaction10.1145/358995230:4(1-27)Online publication date: 30-Mar-2023
  • (2022)H-GOMS: a model for evaluating a virtual-hand interaction system in virtual environmentsVirtual Reality10.1007/s10055-022-00674-y27:2(497-522)Online publication date: 22-Jul-2022
  • (2019)Creating a 4D Photoreal VR Environment to Teach Civil Engineering2019 IEEE International Conference on Engineering, Technology and Education (TALE)10.1109/TALE48000.2019.9225972(1-8)Online publication date: Dec-2019
  • (2019)A Review on Usability and Performance Evaluation in Virtual Reality Systems2019 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI49370.2019.00210(1107-1114)Online publication date: Dec-2019
  • (2017)Effects on User Experience in an Edutainment Virtual EnvironmentProceedings of the European Conference on Cognitive Ergonomics10.1145/3121283.3121284(1-8)Online publication date: 19-Sep-2017
  • (2017)Graph theoretical analysis of EEG functional network during multi-workload flight simulation experiment in virtual reality environment2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)10.1109/EMBC.2017.8037722(3957-3960)Online publication date: Jul-2017

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media