short-paper

Free hand interface for controlling applications based on Wii remote IR sensor

Authors:

Jiaqing Lin,

Hiroaki Nishino,

Tsuneo Kagawa,

Kouichi UtsumiyaAuthors Info & Claims

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Pages 139 - 142

https://doi.org/10.1145/1900179.1900207

Published: 12 December 2010 Publication History

Get Access

Abstract

Wii remote, a remote controller device attached to Nintendo game console, provides an inexpensive and compact hardware solution with an embedded infrared camera and accelerometers useful for tracking objects in a 3D space. We present an approach for building a unified gesture-based interface with the Wii remote device. We adopt it for tracking a user's hand motions and using the tracked motions to control applications. For example, the user can easily browse pictures, read e-books, and make presentations via the unified free hand interaction (FHI) method based on the Wii remote device. When the user utilizes his/her hand for making a simple gesture in the proposed system, the gesture will be registered by the system for controlling applications. He/she can simultaneously hold another Wii remote by the other hand for making auxiliary operations, or he/she can edit some specific functions of the registered gestures such as zooming in and out, changing page, and confirming operations.

References

[1]

Johnny Chung Lee, "Hacking the Nintendo Wii Remote," IEEE Pervasive Computeing, Volume 7, Issue 3, pp. 39--45, July 2008.

Digital Library

Google Scholar

[2]

Johnny Chung Lee's Projects, http://johnnylee.net/projevts/wii/.

Google Scholar

[3]

Torben Schou and Henry J. Gardner, "A Wii Remote, a Game Engine, Five Sensor Bars and a Virtual Reality Theatre," the 19^th Australasian conference on Computer-Humam Interaction: Entertaining User Interfaces, vol. 251, pp. 231--234, November 2007.

Digital Library

Google Scholar

[4]

Nishino, H., Murayama, K., Kagawa, T., and Utsumiya, K.: A Japanese Calligraphy Trainer Based on Skill Acquisition Through Haptization, Proc. of the IEEE 24th Int'l Conf. on Advanced Information Networking and Applications (AINA2010), pp. 1225--1232, April 2010.

Digital Library

Google Scholar

[5]

Wingrave, Chadwick A., Williamson, Brian, Varcholik, Paul D., Rose, Jeremy, Miller, Andrew, Charbonneau, Emiko, Bott, Jared, LaViola Jr., Joseph J., "The Wiimote and Beyond: Spatially Convenient Devices for 3D User Interface," Computer Graphics and Applications, IEEE, Volume 30, Issue 2, pp. 71--85, March-April 2010.

Digital Library

Google Scholar

[6]

Managed Library for Nintendo's Wiimote, blog, http://blogs.msdn.com/coding4fun/archive/2007/03/14/1879033.aspx.

Google Scholar

[7]

Yang-Wai Chhow, "3D Spatial Interaction with the Wii Remote for Head-Mounted Display Virtual Reality," World Academy of Science, Engineering and Technology 50, 2009.

Google Scholar

[8]

S. Seedharam, E. S. Zurita and B. Plimmer, "3D input for 3D worlds," in Proc. of Australasian Computer-Human Interaction Conference (OzCHI 2007), Adelaide, Australia, 2007, pp. 227--230.

Digital Library

Google Scholar

[9]

M. Lapping-Carr, O. C. Jenkins, D. H. Grollman, J. N. Schowertfeger and T. R. Hinkle, "Wiimote interfaces for lifelong robot learning," in Proc. of AAAI Symposium on using AI to Motivate Greater Participation in Computer Science, Palo Alto, C.A., 2008.

Google Scholar

[10]

M. Tamai, W. Wu, K. Nahrstedt, K. Yasumoto, "A view control interface for 3D tele-immersive environment," in Proc. of IEEE International Conference on Multimedia and Expo, Hannover, Germany, 2008, pp. 1101--1104.

Google Scholar

[11]

Johnny Lee, Scott Hudson, Pau Dietz, "Hybrid Infrared and Visible Light Projection for Location Tracking," in Proc. of the 20th annual ACM symposium on User interface software and technology, 2007, pp. 57--60.

Digital Library

Google Scholar

Cited By

View all

Bernhaupt RPirker M(2014)User interface guidelines for the control of interactive television systems via smart phone applicationsBehaviour & Information Technology10.1080/0144929X.2013.81078233:8(784-799)Online publication date: 1-Aug-2014
https://dl.acm.org/doi/10.1080/0144929X.2013.810782
Cox DWolford JJensen CBeardsley DMorency LBohus DAghajan HCassell JNijholt AEpps J(2012)An evaluation of game controllers and tablets as controllers for interactive tv applicationsProceedings of the 14th ACM international conference on Multimodal interaction10.1145/2388676.2388713(181-188)Online publication date: 22-Oct-2012
https://dl.acm.org/doi/10.1145/2388676.2388713
Bernhaupt RBoutonnet MGatellier BGimenez YPouchepanadin CSouiba LArbanowski SSteglich SKnoche HHess J(2012)A set of recommendations for the control of IPTV-systems via smart phones based on the understanding of users practices and needsProceedings of the 10th European Conference on Interactive TV and Video10.1145/2325616.2325645(143-152)Online publication date: 4-Jul-2012
https://dl.acm.org/doi/10.1145/2325616.2325645
Show More Cited By

Recommendations

Hands-free gesture control with a capacitive textile neckband
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

We present a novel sensing modality for hands-free gesture controlled user interfaces, based on active capacitive sensing. Four capacitive electrodes are integrated into a textile neckband, allowing continuous unobtrusive head movement monitoring. We ...
Hand-free natural user interface for VR HMD with IR based facial gesture tracking sensor
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

We proposed a hand-free Natural User Interface (NUI) for VR Head-Mounted-Display (HMD) with infra-red (IR) based sensor tracking facial gestures. We have realized NUI based on the real-time recognition of user intuitions for VR HMD without any ...
A hand gesture interface device

This paper reports on the development of a hand to machine interface device that provides real-time gesture, position and orientation information. The key element is a glove and the device as a whole incorporates a collection of technologies. Analog ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

December 2010

399 pages

ISBN:9781450304597

DOI:10.1145/1900179

General Chairs:
Hyun Seung Yang
KAIST, Korea
,
Kazumasa Enami
National Institute of Information and Communications Technology, Japan
,
Nadia Magnenat-Thalmann
MIRALab, University of Geneva, Switzerland
,
Jim Chen
George Mason University
,
Program Chairs:
Seiki Inoue
NHK Science and Technical Research Labs, Japan
,
Zhigeng Pan
State Key Lab of CAD&CG, Zhejiang University, China
,
Jong -IL Park
Hanyang University, Korea

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Ministry of Internal Affairs and Communications (MIC) in Japan, Strategic Information and Communications R&D Promotion Programme (SCOPE)

Conference

VRCAI '10

Sponsor:

SIGGRAPH

VRCAI '10: Virtual Reality Continuum and its Applications in Industry

December 12 - 13, 2010

Seoul, South Korea

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
424
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bernhaupt RPirker M(2014)User interface guidelines for the control of interactive television systems via smart phone applicationsBehaviour & Information Technology10.1080/0144929X.2013.81078233:8(784-799)Online publication date: 1-Aug-2014
https://dl.acm.org/doi/10.1080/0144929X.2013.810782
Cox DWolford JJensen CBeardsley DMorency LBohus DAghajan HCassell JNijholt AEpps J(2012)An evaluation of game controllers and tablets as controllers for interactive tv applicationsProceedings of the 14th ACM international conference on Multimodal interaction10.1145/2388676.2388713(181-188)Online publication date: 22-Oct-2012
https://dl.acm.org/doi/10.1145/2388676.2388713
Bernhaupt RBoutonnet MGatellier BGimenez YPouchepanadin CSouiba LArbanowski SSteglich SKnoche HHess J(2012)A set of recommendations for the control of IPTV-systems via smart phones based on the understanding of users practices and needsProceedings of the 10th European Conference on Interactive TV and Video10.1145/2325616.2325645(143-152)Online publication date: 4-Jul-2012
https://dl.acm.org/doi/10.1145/2325616.2325645
Lin JNishino HKagawa TUtsumiya K(2012)A Tangible Medical Image Processing Assistant with Haptic ModalityProceedings of the 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)10.1109/CISIS.2012.125(723-728)Online publication date: 4-Jul-2012
https://dl.acm.org/doi/10.1109/CISIS.2012.125
Lin JNishino HKagawa TUtsumiya K(2012)A method of two-handed gesture interactions with applications based on commodity devicesComputers & Mathematics with Applications10.1016/j.camwa.2011.07.05263:2(448-457)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1016/j.camwa.2011.07.052
Lin JNishino HKagawa TUtsumiya K(2011)A Method of Two-Handed Gesture Interactions with Applications Based on Commodity DevicesProceedings of the 2011 International Conference on Complex, Intelligent, and Software Intensive Systems10.1109/CISIS.2011.117(697-702)Online publication date: 30-Jun-2011
https://dl.acm.org/doi/10.1109/CISIS.2011.117

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Hands-free gesture control with a capacitive textile neckband

Hand-free natural user interface for VR HMD with IR based facial gesture tracking sensor

A hand gesture interface device