Abstract
Smart wearables are body-worn small devices that require novel user interaction due to its compactness and wearability. Current UI/UX of smart wearables is rooted in a smartphone-like UI/UX that is inadequate in many cases constrained by such small form factors. To overcome these limitations, research efforts are invested for augmenting wearable devices with various sensors and improving efficiency of existing input modalities through careful orchestration. In this paper, we propose a new concept called lightful user interaction exploiting a readily available ambient light sensor as a novel and alternative user interface for smart wearables. We design and model lightful user interaction based on typical usages of representative smart wearables. Then, we demonstrate the proposed lightful user interaction through three implemented applications such as PIN entry, morse code, and control indicator, respectively. At the end, we evaluate the concept and applications in terms of occluded display area, input expressivity and lightweight implementation aspects to make a case for a promising novel and alternative UI for smart wearables.
Similar content being viewed by others
References
Ahn Y, Hwang S, Yoon H, Gim J, Ryu J-H (2015) Bandsense: pressure-sensitive multi-touch interaction on a wristband. CHI 2015:251–254. doi:10.1145/2702613.2725441
Amma C, Georgi M, Schultz T (2014) Airwriting: a wearable handwriting recognition system. Pers ubiquitous Comput 18(1):191–203. doi:10.1007/s00779-013-0637-3
Arias O, Wurm J, Hoang K, Jin Y (2015) Privacy and security in internet of things and wearable devices. IEEE Trans Multi-Scale Comput Syst 99. doi:10.1109/TMSCS.2015.2498605
Gaff B (2015) Legal issues with wearable technology. Computer 48(9):10–12. doi:10.1109/MC.2015.280
Goldstein M, Chincholle D, Backström M (2000) Assessing two new wearable input paradigms: the finger-joint-gesture palm-keypad glove and the invisible phone clock. Pers Technol 4(2–3):123–133. doi:10.1007/BF01324119
Grossman T, Chen XA, Fitzmaurice G (2015) Typing on glasses: adapting text entry to smart eyewear. MobileHCI 2015:144–152. doi:10.1145/2785830.2785867
Han J, Ahn S, Lee G (2015) Transture: continuing a touch gesture on a small screen into the air. CHI EA 2015:1295–1300. doi:10.1145/2702613.2732849
Hong J, Heo S, Isokoski P, Lee G (2015) Splitboard: a simple split soft keyboard for wristwatch-sized touch screens. CHI 2015:1233–1236. doi:10.1145/2702123.2702273
Jiang H, Chen X, Zhang S, Zhang X, Kong W, Zhang T (2015) Software for wearable devices: Challenges and Opportunities. In: COMPSAC 2015, vol 3, pp 592–597. doi:10.1109/COMPSAC.2015.269
Kerber F, Lessel P, Krüger A (2015) Same-side hand interactions with arm-placed devices using emg. CHI EA 2015:1367–1372. doi:10.1145/2702613.2732895
Komninos A, Dunlop M (2014) Text input on a smart watch. IEEE Pervasive Comput 13(4):50–58. doi:10.1109/MPRV.2014.77
Lee C-D, Huang H-C, Yeh H-Y (2013) The development of sun-tracking system using image processing. Sensors 13(5):5448–5459. doi:10.3390/s130505448
Leiva LA, Sahami A, Catala A, Henze N, Schmidt A (2015) Text entry on tiny qwerty soft keyboards. CHI 2015:669–678. doi:10.1145/2702123.2702388
Lu Z, Chen X, Li Q, Zhang X, Zhou P (2014) A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices. IEEE Trans Hum-Mach Syst 44(2):293–299. doi:10.1109/THMS.2014.2302794
Madria S, Kumar V, Dalvi R (2014) Sensor cloud: a cloud of virtual sensors. IEEE Softw 31(2):70–77. doi:10.1109/MS.2013.141
Miao F, He Y, Liu J, Li Y, Ayoola I (2015) Identifying typical physical activity on smartphone with varying positions and orientations identifying typical physical activity on smartphone with varying positions and orientations. Biomed Eng 14(32). doi:10.1186/s12938-015-0026-4
Min J-K, Doryab A, Wiese J, Amini S, Zimmerman J, Hong JI (2014) Toss ’n’ turn: Smartphone as sleep and sleep quality detector. CHI 2014:477–486. doi:10.1145/2556288.2557220
Nakanishi M, Horikoshi T (2013) Intuitive substitute interface. Pers Ubiquitous Comput 17(8):1797–1805. doi:10.1007/s00779-013-0651-5
Oakley I, Lee D (2014) Interaction on the edge: offset sensing for small devices. CHI 2014:169–178. doi:10.1145/2556288.2557138
Oakley I, Lee D, Islam MR, Esteves A (2015) Beats: tapping gestures for smart watches. CHI 2015:1237–1246. doi:10.1145/2702123.2702226
Oney S, Harrison C, Ogan A, Wiese J (2013) Zoomboard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. CHI 2013:2799–2802. doi:10.1145/2470654.2481387
Raghunath MT, Narayanaswami C (2002) User interfaces for applications on a wrist watch. Pers Ubiquitous Comput 6(1):17–30. doi:10.1007/s007790200002
Selavo L, Wood A, Cao Q, Sookoor T, Liu H, Srinivasan A, Wu Y, Kang W, Stankovic J, Young D, Porter J (2007) Luster: wireless sensor network for environmental research. SenSys 2007:103–116. doi:10.1145/1322263.1322274
Shilkrot R, Huber J, Meng Ee W, Maes P, Nanayakkara SC (2015) Fingerreader: a wearable device to explore printed text on the go. In CHI 2015, pp 2363–2372. doi:10.1145/2702123.2702421
Starner T (2014) How wearables worked their way into the mainstream. IEEE Pervasive Comput 13(4):10–15. doi:10.1109/MPRV.2014.66
Timmermann J, Heuten W, Boll S (2015) Input methods for the borg-rpe-scale on smartwatches. EAI Endorsed Trans Energy Web 15(6). doi:10.4108/icst.pervasivehealth.2015.259220
Wahl F, Kantermann T, Amft O (2014) How much light do you get? Estimating daily light exposure using smartphones. ISWC 2014:43–46. doi:10.1145/2634317.2634346
Xia H, Grossman T, Fitzmaurice G (2015) Nanostylus: enhancing input on ultra-small displays with a finger-mounted stylus. UIST 2015:447–456. doi:10.1145/2807442.2807500
Xiao R, Laput G, Harrison C (2014) Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In: CHI 2014, pp 193–196. doi:10.1145/2556288.2557017
Yang Y, Chae S, Shim J, Han T-D (2015) Emg sensor-based two-hand smart watch interaction. In: UIST 2015 Adjunct, pp 73–74. doi:10.1145/2815585.2815724
Yoon H, Lee J-E, Park S-H, Lee K-T (2016) Position and force sensitive n-ary user interface framework for wrist-worn wearables. SCIS ISIS 2016:671–675. doi:10.1109/SCIS&ISIS.2016.174
Yoon H, Park M-S, Park S-H, Lee K-T (2015) Luxui: repurposing ambient light sensor for contact-based explicit interaction on smartwatch. ICTC 2015:1264–1266. doi:10.1109/ICTC.2015.7354792
Yoon H, Park SH, Lee K-T (2015) Exploiting ambient light sensor for authentication on wearable devices. In CyberSec 2015, pp 95–100. doi:10.1109/CyberSec.2015.27
Zhang Y, Harrison C (2015) Tomo: wearable, low-cost electrical impedance tomography for hand gesture recognition. UIST 2015:167–173. doi:10.1145/2807442.2807480
Acknowledgments
This research was financially supported by the Ministry of Trade, Industry and Energy (MOTIE) and Korea Institute for Advancement of Technology (KIAT) through the International Cooperative R&D program [N001228, Development of UI/UX Technology to Overcome the Limitation of Wearable Device UIs]. The authors would like to thank Interactive Contents Team members of Contents Convergence Research Center at KETI, especially Saet-Byeol Yu, Eun-Ae Jang, Ji-Eun Lee, and Min-Sung Park for their support on developing and polishing ideas presented in this paper. Images used in Figs. 1 and 2 are public domain images under Creative Commons CC0. Smartwatch icon on Fig. 4 is by Sherrinford from thenounproject.com.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yoon, H., Park, SH. & Lee, KT. Lightful user interaction on smart wearables. Pers Ubiquit Comput 20, 973–984 (2016). https://doi.org/10.1007/s00779-016-0959-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-016-0959-z