Abstract
The opportunity to develop new natural user interfaces has come forward due to the recent development of inexpensive full body tracking sensors, which has made this technology accessible to millions of users. In this paper, we present a comparative study between two natural user interfaces, and a cardiorespiratory training exergame developed based on the study results. The focus was on studying interfaces that could easily be used by an elderly population for interaction with floor projection displays. One interface uses both feet position to control a cursor and feet distance to trigger activation. In the alternative interface, the cursor is controlled by forearm ray casting into the projection floor and interaction is activated by hand pose. These modes of interaction were tested with 19 elderly participants in a point-and-click and a drag-and-drop task using a between-subjects experimental design. The usability, perceived workload and performance indicators were measured for each interface. Results show a clear preference towards the feet-controlled interface and a marginally better performance for this method. The results from the study served as a guide to the design of a cardiorespiratory fitness exergame for the elderly. The game “Grape Stomping” uses ground projection and mapping to display real-size winery elements. These virtual elements are used to simulate, in a playful way, the process of grape maceration through repeated stomping. A playtest session with nine elderly users was completed and its insights are presented in addition to the description of the game.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
European Commission, Economic and Financial Affairs: The 2012 Ageing Report (2012)
Fozard, J.: Vision and hearing in aging. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the Psychology of Aging, pp. 143–156. Academic Press, San Diego (1990)
World Health Organization: Global recommendations on physical activity for health (2010). http://www.who.int/dietphysicalactivity/publications/9789241599979/en/
Microsoft News Center: Xbox Execs Talk Momentum and the Future of TV (2013). http://news.microsoft.com/2013/02/11/xbox-execs-talk-momentum-and-the-future-of-tv/
Microsoft’s Q2: Record $24.52 billion revenue and 3.9 million Xbox One sales. http://www.theverge.com/2014/1/23/5338162/microsoft-q2-2014-financial-earnings
Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)
Chen, C., Liu, K., Jafari, R., Kehtarnavaz, N.: Home-based Senior Fitness Test measurement system using collaborative inertial and depth sensors. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4135–4138 (2014)
Gonçalves, A., Gouveia, É., Cameirão, M., Bermúdez i Badia, S.: Automating senior fitness testing through gesture detection with depth sensors. In: Proceedings of the IET International Conference on Technologies for Active and Assisted Living (TechAAL 2015). Institution of Engineering and Technology, London (2015)
Da Gama, A., Chaves, T., Figueiredo, L., Teichrieb, V.: Guidance and movement correction based on therapeutics movements for motor rehabilitation support systems. In: 2012 14th Symposium on Virtual and Augmented Reality (SVR), pp. 191–200 (2012)
Spasojević, S., Santos-Victor, J., Ilić, T., Milanović, S., Potkonjak, V., Rodić, A.: A vision-based system for movement analysis in medical applications: the example of Parkinson disease. In: Nalpantidis, L., Krüger, V., Eklundh, J.-O., Gasteratos, A. (eds.) ICVS 2015. LNCS, vol. 9163, pp. 424–434. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20904-3_38
Jones, B., et al.: RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 637–644. ACM, New York (2014)
Gonçalves, A., Cameirão, M.: Evaluating body tracking interaction in floor projection displays with an elderly population. In: Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS, Lisbon, Portugal, pp. 24–32 (2016)
Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 177–186. ACM, New York (2011)
Boulos, M.N.K., Blanchard, B.J., Walker, C., Montero, J., Tripathy, A., Gutierrez-Osuna, R.: Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation. Int. J. Health Geogr. 10, 45 (2011)
Francese, R., Passero, I., Tortora, G.: Wiimote and Kinect: gestural user interfaces add a natural third dimension to HCI. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 116–123. ACM, New York (2012)
Roupé, M., Bosch-Sijtsema, P., Johansson, M.: Interactive navigation interface for Virtual Reality using the human body. Comput. Environ. Urban Syst. 43, 42–50 (2014)
Tan, J.H., Chao, C., Zawaideh, M., Roberts, A.C., Kinney, T.B.: Informatics in radiology: developing a touchless user interface for intraoperative image control during interventional radiology procedures. RadioGraphics. 33, E61–E70 (2013)
Bigdelou, A., Schwarz, L., Navab, N.: An adaptive solution for intra-operative gesture-based human-machine interaction. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 75–84. ACM, New York (2012)
Fikkert, W., van der Vet, P., van der Veer, G., Nijholt, A.: Gestures for large display control. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS (LNAI), vol. 5934, pp. 245–256. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12553-9_22
Vatavu, R.-D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video, pp. 45–48. ACM, New York (2012)
Golod, I., Heidrich, F., Möllering, C., Ziefle, M.: Design principles of hand gesture interfaces for microinteractions. In: Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces, pp. 11–20. ACM, New York (2013)
Lee, S.-S., Chae, J., Kim, H., Lim, Y., Lee, K.: Towards more natural digital content manipulation via user freehand gestural interaction in a living room. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 617–626. ACM, New York (2013)
Bragdon, A., DeLine, R., Hinckley, K., Morris, M.R.: Code space: Touch + Air gesture hybrid interactions for supporting developer meetings. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 212–221. ACM, New York (2011)
Hopmann, M., Salamin, P., Chauvin, N., Vexo, F., Thalmann, D.: Natural activation for gesture recognition systems. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 173–183. ACM, New York (2011)
Krogh, P., Ludvigsen, M., Lykke-Olesen, A.: “Help Me Pull That Cursor” A collaborative interactive floor enhancing community interaction. Australas. J. Inf. Syst. 11, 75–87 (2004)
Augsten, T., et al.: Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 209–218. ACM, New York (2010)
Larsen, L.H., Schou, L., Lund, H.H., Langberg, H.: The physical effect of exergames in healthy elderly—a systematic review. GAMES Health Res. Dev. Clin. Appl. 2, 205–212 (2013)
Molina, K.I., Ricci, N.A., de Moraes, S.A., Perracini, M.R.: Virtual reality using games for improving physical functioning in older adults: a systematic review. J. Neuroeng. Rehabil. 11, 156 (2014)
Vanden Abeele, V.A., Van Rompaey, V.: Introducing human-centered research to game design: designing game concepts for and with senior citizens. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 1469–1474. ACM (2006)
Gerling, K., Masuch, M.: When gaming is not suitable for everyone: playtesting Wii games with frail elderly. In: 1st Workshop on Game Accessibility (2011)
Sayago, S., Rosales, A., Righi, V., Ferreira, S.M., Coleman, G.W., Blat, J.: On the conceptualization, design, and evaluation of appealing, meaningful, and playable digital games for older people. Games Cult. 11, 53–80 (2016)
Folstein, M.F., Folstein, S.E., McHugh, P.R.: Mini-mental state. J. Psychiatr. Res. 12, 189–198 (1975)
Roberta E. Rikli, C.J.J.: The Reliability and Validity of a 6-Minute Walk Test as a Measure of Physical Endurance in Older Adults (1998)
Brooke, J.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189, 194 (1996)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Advances in Psychology, pp. 139–183. North-Holland, Amsterdam (1988)
Mousavi Hondori, H., Khademi, M., Dodakian, L., McKenzie, A., Lopes, C.V., Cramer, S.C.: Choice of human-computer interaction mode in stroke rehabilitation. Neurorehabil. Neural. Repair. 30, 258–265 (2015)
Cunha, C.A., Cunha, R.: Culture and Customs of Portugal. ABC-CLIO (2010)
Oja, P., Tuxworth, B., et al.: Eurofit for adults: assessment of health-related fitness. Council of Europe (1995)
Rikli, R.E., Jones, C.J.: Development and validation of a functional fitness test for community-residing older adults. J. Aging Phys. Act. 7, 129–161 (1999)
Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. CRC Press, Boca Raton (2005)
Acknowledgment
The authors thank Funchal’s Santo António municipal gymnasium for their cooperation, Teresa Paulino for the development of the experimental tasks, Fábio Pereira for his help during the data collection process, and Diogo Freitas and John Sousa for their contributions in the development of the first prototype of “Grape Stomping”.
This work was supported by the Fundação para a Ciência e Tecnologia through the AHA project (CMUPERI/HCI/0046/2013) and LARSyS – UID/EEA/50009/2013.
Author information
Authors and Affiliations
Contributions
Afonso Gonçalves designed and carried out the floor projection interaction study, designed the “Grape Stomping” game and wrote the paper. Filipa Nóbrega developed the game and contributed to the writing of the paper. Mónica Cameirão supervised the study, contributed to the game design and writing of the paper. John Muñoz, Élvio Gouveia and Sergi Bermudez i Badia contributed to the game design and writing of the paper.
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Gonçalves, A., Nóbrega, F., Cameirão, M., Muñoz, J.E., Gouveia, É., Bermudez i Badia, S. (2019). From Body Tracking Interaction in Floor Projection Displays to Elderly Cardiorespiratory Training Through Exergaming. In: Holzinger, A., Pope, A., Plácido da Silva, H. (eds) Physiological Computing Systems. PhyCS PhyCS PhyCS 2016 2017 2018. Lecture Notes in Computer Science(), vol 10057. Springer, Cham. https://doi.org/10.1007/978-3-030-27950-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-27950-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27949-3
Online ISBN: 978-3-030-27950-9
eBook Packages: Computer ScienceComputer Science (R0)