research-article

Integrating the Wii controller with enJine: 3D interfaces extending the frontiers of a didactic game engine

Authors:

João Bernardes,

Ricardo Nakamura,

Daniel Tokunaga,

Romero ToriAuthors Info & Claims

Computers in Entertainment (CIE), Volume 7, Issue 1

Article No.: 12, Pages 1 - 19

https://doi.org/10.1145/1486508.1486520

Published: 27 February 2009 Publication History

Abstract

The goal of the work described here is to integrate a 3D input device, the Wii controller, and enJine, a didactic engine, motivated by the growing use of 3D interfaces. This article discusses how this increases enJine's didactic and technological potential, and details the adopted solution as a layered architecture. Two interaction styles were tested with the implemented solution. Test results show a variety of data about the controller, confirming that this solution works as desired and that using it to modify a game so it can use the WiiMote as its input device is a simple task.

References

[1]

Ailive. 2008. LiveMove white paper. http://www.ikuni.com/papers/LiveMoveWhitePaper_en.pdf.

[2]

Attygalle, S., Duff, M., Rikakis, T., and Jiping, H. 2008. Low-cost, at-home assessment system with Wii Remote based motion capture. In Proceedings of the Conference on Virtual Rehabilitation, IEEE, 168--174.

[3]

Avetana. 2008. http://www.avetana-gmbh.de/avetana-gmbh/produkte/jsr82.eng.xml.

[4]

Azuma, R. 1997. A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 4 (Aug.), 355--385.

Digital Library

[5]

Barakonyi, I., Markus W., Thomas, P., and Schmalstieg, D. 2005. MonkeyBridge: Autonomous agents in augmented reality games. In Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACM, New York.

Digital Library

[6]

Belcher, J. 2007. Embodied interfaces for interactive percussion instruction. Master's dissertation. http://scholar.lib.vt.edu/theses/available/etd-5312007-113346/.

[7]

Billinghurst, M., Kato, H., and Poupyrev, I. 2000. Artoolkit: A computer vision based augmented reality toolkit. In Proceedings of the IEEE Virtual Reality 2000 Conference.

[8]

Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters.

Digital Library

[9]

Bluesock. 2008. http://bluesock.dev.java.net.

[10]

Bluetooth Specification. http://www.bluetooth.com/Bluetooth/Technology/Building/Specifications.

[11]

Bowman, D., Kruijff, E., Laviolla, J.J., Jr., and Poupyrev, I. 2005. 3D User Interfaces. Addison-Wesley, Reading, MA.

[12]

Bruegge, B. et al. 2007. Pinocchio: Conducting a virtual symphony orchestra. In Proceedings of the International Conference on Advances in Computer Entertainment Technology, ACM, New York, 294--295.

Digital Library

[13]

Cabral, M., Morimoto, C., and Zuffo, M. 2005. On the usability of gesture interfaces in virtual reality environments. In Proceedings of the 2005 Latin American Conference on Human-Computer Interaction, ACM, New York, 100--108.

Digital Library

[14]

Calife, D., Tomoyose, A., Spinola, D., Bernardes, J. L., Jr., and Tori, R. 2007. Robot ARena: Infrastructure for applications involving spatial augmented reality and robots. In Proceedings of the IX Symposium on Virtual and Augmented Reality.

[15]

Carless, S. 2005. Xbox CFO estimates initial Xbox 360 sales. http://www.gamasutra.com/php-bin/news_index.php?story=7109%3C/link%3E.

[16]

Dobson, J. 2006. Nintendo: 600,000 Wii, 454,000 Zelda Sold In First Eight Days. Available on: http://www.gamasutra.com/php-bin/news_index.php?story=11864

[17]

Dragicevic, P. and Fekete, J. 2004. Support for input adaptability in the ICON toolkit. In Proceedings of the 6th International Conference on Multimodal Interfaces, ACM, New York, 212--219.

Digital Library

[18]

Farias, T., Teixeira, J., Rodrigues, C., Pessoa, S., Costa, N., Teichrieb, V., and Kelner, J. 2006. CIDA: An interaction devices management platform. In Proceedings of the Symposium on Virtual Reality, SBC, 271--284.

[19]

Forbes, K. 2007. cWiimote library. http://simulatedcomicproduct.com.

[20]

Galego, B. and Simone, L. 2007. Leveraging online virtual worlds for upper extremity rehabilitation. In Proceedings of the IEEE Bioengineering Conference, IEEE, 267--268.

[21]

Geiger, C., Reimann, C., Sticklein, J., and Paelke, V. 2002. JARToolKit—A Java binding for ARToolKit. Augmented reality toolkit. In Proceedings of the First IEEE International Workshop.

[22]

GLOVEPIE. http://carl.kenner.googlepages.com/glovepie.

[23]

Gomes, P. and Pamplona, V. 2005. M3GE: um motor de jogos 3D para dispositivos móveis com suporte a Mobile 3D Graphics API. In Proceedings of the Brazilian Symposium on Computer Games and Electronic Entertainment, SBC, 55--65.

[24]

Govil, A., You, S., and Neumann, U. 2000. A video-based augmented reality golf simulator. In Proceedings of the 8th ACM International Conference on Multimedia, ACM, New York.

Digital Library

[25]

Hay, S., Newman, J., and Harle, R. 2008. Optical tracking using commodity hardware. In Proceedings of the Mixed and Augmented Reality, IEEE, 159--160.

Digital Library

[26]

Hoetzlein, R. and Schwartz, D. 2005. GameX: A platform for incremental instruction in computer graphics and game design. In Proceedings of the ACM SIGGRAPH 2005 Educator's Program, ACM Press, New York.

Digital Library

[27]

Huang, T. and Pavlovic, V. 1995. Hand gesture modelling, Analysis and synthesis. In Proceedings of the International Workshop on Automatic Face and Gesture Recognition. IEEE, 73--79.

[28]

INVENSENSE. 2008, Invensense#8482; IDG-600 motion sensing solution showcased in Nintendo's new Wii Motionplus accessory. Available on: http://www.invensense.com/news/071508.html

[29]

Ishii, H. and Ullmer, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of The SIGCHI Conference on Human Factors In Computing Systems, ACM, New York, 234--241.

Digital Library

[30]

Java Bluetooth.Com. 2008. Development kits. http://www.javabluetooth.com/development_kits.html.

[31]

Kim, K. et al. 2005. ARPushPush: Augmented reality game in indoor environment. In Proceedings of the International Workshop on Pervasive Gaming Applications.

[32]

Kolsch, M. and Turk, M. 2005. Hand tracking with flocks of features. In Proceedings of 2005 Conference on Computer Vision and Pattern Recognition. IEEE.

Digital Library

[33]

Lee, J. C. 2008. Hacking the Nintendo Wii remote. IEEE Pervasive Computing 7, 3, 39--45.

Digital Library

[34]

Magerkurth, C., Engelke, T., and Memisoglu, M. 2004. Augmenting the virtual domain with physical and social elements. Computers in Entertainment 2, 4 (Oct).

Digital Library

[35]

Mandryk, R., Maranan, D., and Inkpen, K. 2002. False prophets: Exploring hybrid board/video games. In Proceedings of the Conference of Human Factors in Computing Systems. 640--641.

Digital Library

[36]

Marcel, S. 2008. Gestures for multi-modal interfaces: A review. 2002. http://citeseer.ist.psu.edu/marcel02gestures.html.

[37]

Moser, R. 1997. A fantasy adventure game as a learning environment. In Proceedings of the Innovation and Technology in Computer Science Education Conference (ITiCSE), ACM, New York, 114--116.

Digital Library

[38]

Nakamura, R., Bernardes, J. L., and Tori, R. 2006. enJine: Architecture and application of an open-source didactic game engine. In Digital Proceedings of the Brazilian Symposium on Games and Digital Entertainment. http://www.cin.ufpe.br/~sbgames/proceedings/index.htm.

[39]

Nintendo Wii remote. http://wii.nintendo.com/controller.Jsp.

[40]

Ohshima, T., Satoh, K., Yamamoto, H., and Tamura, H. 1999. RV-border guards: A multi-player entertainment in mixed reality space. In Proceedings of the IEEE and ACM Second International Workshop on Augmented Reality, ACM, New York.

[41]

OPENGL ES. 2008. http://www.khronos.org/opengles

[42]

Pascale, M. and Prattichizzo, D. 2005. The haptik library: A component based architecture for uniform access to haptic devices. IEEE Robotics and Automation Magazine (in press).

[43]

Pavlovic, V., Sharma, R., and Huang, T. 1997. Visual interpretation of hand gestures for human computer interaction: A review. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 7, 677--695.

Digital Library

[44]

Rasco, B. 2007. Where's the Wiimote&quest; Using Kalman filtering to extract accelerometer data. http://www.gamasutra.com/view/feature/1494/wheres_the_wiimote_using_kalman_.php.

[45]

Sweedyk, E., De Laet, M., Slattery, M. C., and Kuffner, J. 2005. Computer games and CS education: Why and how. In Proceedings of the Innovation and Technology in Computer Science Education Conference (ITiCSE), ACM, New York, 256--257.

Digital Library

[46]

Schlömer, T., Poppinga, B., Henze, N., and Boll S. 2008. Gesture Recognition with a Wii Controller. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, Bonn, Germany, February 2008, 11--14.

Digital Library

[47]

Souza, M. and Ribeiro, T., AR wiiSquash: Utilização do wiiMote como interface de interação com o usuário em Jogos de Realidade Aumentada baseada em projetores. Monograph, Centro Universitário Senac, Sao Paulo, 2008. 43 p.

[48]

Thompson et al. 2006. JSR 82. http://jcp.org/en/jsr/detail?id=82/.

[49]

Tokunaga, D., Vicentim, A., Muto, M., Bernardes, J., and Tori, R. 2008. GESKTOP 3D: Explorando novas formas de interação 3D baseadas em gestos. In Proceedings of the X Symposium on Virtual and Augmented Reality, SBC, 125--128.

[50]

Tori, R., Bernardes, J., and Nakamura, R. 2006. Teaching introductory computer graphics using Java 3D, games and customized software: A Brazilian experience. In Digital Proceedings of the 34th International Conference and Exhibition on Computer Graphics and Interactive Techniques, ACM SIGGRAPH Educators Program, ACM, New York.

Digital Library

[51]

Tsuda, F., Hokama, P., Rodrigues, T., and Bernardes, J. 2007. Integration of jARToolKit and enJine: Extending with AR the potential use of a didactic game engine. In Proceedings of the IX Symposium on Virtual and Augmented Reality, SBC, 51--59.

[52]

Wieringen, V. M. and Eklund, J. M. 2008. Real-time signal processing of accelerometer data for wearable medical patient monitoring devices. In Proceedings of the Engineering in Medicine and Biology Society, IEEE, 2397--2400.

[53]

WIILI. http://www.wiili.org.

[54]

Wilson, P. H., Duckworth, J., Mumford, N., Eldridge, R., Guilielmetti, M., Thomas, P., Shum, D., and Rudolph, H. 2007. A virtual tabletop workspace for the assessment of upper limb function in traumatic brain injury (TBI). In Proceedings of the Virtual Rehabilitation Conference, IEEE, 14--19.

[55]

Wu, W. and Huang, T. 1999. Vision-Based Gesture Recognition: A Review. Springer, New York.

Cited By

Sanchez-Azqueta CGimeno CCelma SAldea C(2016)Using the Wiimote to Learn MEMS in a Physics Degree ProgramIEEE Transactions on Education10.1109/TE.2015.247263959:3(169-174)Online publication date: Aug-2016
https://doi.org/10.1109/TE.2015.2472639
Petrović VIvetić D(2014)Active Learning Attributes of Wii Peripherals in CS EducationProcedia - Social and Behavioral Sciences10.1016/j.sbspro.2014.05.078141(447-452)Online publication date: Aug-2014
https://doi.org/10.1016/j.sbspro.2014.05.078
Petrovic VIvetic DKonjovic Z(2011)The versatility of the Wii controller in CS education2011 IEEE 9th International Symposium on Intelligent Systems and Informatics10.1109/SISY.2011.6034383(59-64)Online publication date: Sep-2011
https://doi.org/10.1109/SISY.2011.6034383

Index Terms

Recommendations

Wii: Wii. History of video game consoles (seventh generation), Wii launch, Wii Remote, Wii system software, Wii Menu, Nintendo Wi- Fi Connection, WiiConnect24, Internet Channel
Towards a Constructionist Serious Game Engine
CompSysTech '16: Proceedings of the 17th International Conference on Computer Systems and Technologies 2016

Game developers have been using commercial game engines to create serious games. The development of serious game is a process that requires game and instructional design. Constructionist environments and games are becoming more popular in the last years ...
Wii all play: the console game as a computational meeting place
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper, we present results from a qualitative study of collocated group console gaming. We focus on motivations for, perceptions of, and practices surrounding the shared use of console games by a variety of established groups of gamers. These ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers in Entertainment

Computers in Entertainment Volume 7, Issue 1

SPECIAL ISSUE: Media Arts and Games

February 2009

209 pages

EISSN:1544-3574

DOI:10.1145/1486508

Issue’s Table of Contents

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2009

Accepted: 01 November 2008

Revised: 01 November 2008

Received: 01 November 2007

Published in CIE Volume 7, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
1,105
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sanchez-Azqueta CGimeno CCelma SAldea C(2016)Using the Wiimote to Learn MEMS in a Physics Degree ProgramIEEE Transactions on Education10.1109/TE.2015.247263959:3(169-174)Online publication date: Aug-2016
https://doi.org/10.1109/TE.2015.2472639
Petrović VIvetić D(2014)Active Learning Attributes of Wii Peripherals in CS EducationProcedia - Social and Behavioral Sciences10.1016/j.sbspro.2014.05.078141(447-452)Online publication date: Aug-2014
https://doi.org/10.1016/j.sbspro.2014.05.078
Petrovic VIvetic DKonjovic Z(2011)The versatility of the Wii controller in CS education2011 IEEE 9th International Symposium on Intelligent Systems and Informatics10.1109/SISY.2011.6034383(59-64)Online publication date: Sep-2011
https://doi.org/10.1109/SISY.2011.6034383

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents