Bare Hand Interface for Interaction in the Video See-Through HMD Based Wearable AR Environment

In this paper, we propose a natural and intuitive bare hand interface for wearable augmented reality environment using the video see-through HMD. The proposed methodology automatically learned color distribution of the hand object through the template matching and tracking the hand objects by using the Meanshift algorithm under the dynamic background and moving camera. Furthermore, even though users are not wearing gloves, extracting of the hand object from arm is enabled by applying distance transform and using radius of palm. The fingertip points are extracted by convex hull processing and assigning constraint to the radius of palm area. Thus, users don’t need attaching fiducial markers on fingertips. Moreover, we implemented several applications to demonstrate the usefulness of proposed algorithm. For example, “AR-Memo" can help user to memo in the real environment by using a virtual pen which is augmented on the user’s finger, and user can also see the saved memo on his/her palm by augmenting it while moving around anywhere. Finally, we experimented performance and did usability studies.

Authors and Affiliations

1. GIST U-VR Lab., Gwangju, 500-712, South Korea

   Taejin Ha & Woontack Woo

Editors and Affiliations

1. Microsoft Research Cambridge, Socio-Digital Systems, 7 J.J: Thomson Ave, CB3 OFB, Cambridge, UK

   Richard Harper

2. Technische Universiteit Eindhoven, Den Dolech 2, 5600MB, Eindhoven, The Netherlands

   Matthias Rauterberg

3. Microsoft Research Cambridge UK, Roger Needham Building , 7 J J Thomson Ave, CB3 0FB, Cambridge, UK

   Marco Combetto

Reprints and permissions

© 2006 IFIP International Federation for Information Processing

Policies and ethics