Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical Perspective
Authors: 
Hechuan Zhang, Xuewei Liang, 
Ying Lei, 
Yanjun Chen, Zhenxuan He, Yu Zhang, Lihan Chen, Hongnan Lin, Teng Han, Feng TianAuthors Info & Claims
Article No.: 51, Pages 1 - 18
Abstract
Typing in mid-air is often perceived as intuitive yet presents challenges due to finger coactivation, a neuromechanical phenomenon that involves involuntary finger movements stemming from the lack of physical constraints. Previous studies were used to examine and address the impacts of finger coactivation using algorithmic approaches. Alternatively, this paper explores the neuromechanical effects of finger coactivation on mid-air typing, aiming to deepen our understanding and provide valuable insights to improve these interactions. We utilized a wearable device that restrains finger coactivation as a prop to conduct two mid-air studies, including a rapid finger-tapping task and a ten-finger typing task. The results revealed that restraining coactivation not only reduced mispresses, which is a classic coactivated error always considered as harm caused by coactivation. Unexpectedly, the reduction of motor control errors and spelling errors, thinking as non-coactivated errors, also be observed. Additionally, the study evaluated the neural resources involved in motor execution using functional Near Infrared Spectroscopy (fNIRS), which tracked cortical arousal during mid-air typing. The findings demonstrated decreased activation in the primary motor cortex of the left hemisphere when coactivation was restrained, suggesting a diminished motor execution load. This reduction suggests that a portion of neural resources is conserved, which also potentially aligns with perceived lower mental workload and decreased frustration levels.
Supplemental Material
MP4 File
UIST8511
- Download
- 68.15 MB
References
[1]
Katrin Amunts, Lutz Jäncke, Hartmut Mohlberg, Helmuth Steinmetz, and Karl Zilles. 2000. Interhemispheric asymmetry of the human motor cortex related to handedness and gender. Neuropsychologia 38, 3 (2000), 304–312.
[2]
Tomoko Aoki, Peter R Francis, and Hiroshi Kinoshita. 2003. Differences in the abilities of individual fingers during the performance of fast, repetitive tapping movements. Experimental Brain Research 152 (2003), 270–280.
[3]
Ramamurthy Arunachalam, Vajira S Weerasinghe, and Kerry R Mills. 2005. Motor control of rapid sequential finger tapping in humans. Journal of neurophysiology 94, 3 (2005), 2162–2170.
[4]
Serdar Ates, Claudia JW Haarman, and Arno HA Stienen. 2017. SCRIPT passive orthosis: design of interactive hand and wrist exoskeleton for rehabilitation at home after stroke. Autonomous Robots 41 (2017), 711–723.
[5]
Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics 7, 2 (2002), 256–263.
[6]
Elizabeth B Brokaw, Iian Black, Rahsaan J Holley, and Peter S Lum. 2011. Hand Spring Operated Movement Enhancer (HandSOME): a portable, passive hand exoskeleton for stroke rehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering 19, 4 (2011), 391–399.
[7]
Yanjun Chen, Xuewei Liang, Si Chen, Yuwen Chen, Hongnan Lin, Hechuan Zhang, Chutian Jiang, Feng Tian, Yu Zhang, Shanshan Yao, and Teng Han. 2022. HapTag: A Compact Actuator for Rendering Push-Button Tactility on Soft Surfaces. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 70, 11 pages. https://doi.org/10.1145/3526113.3545644
[8]
Inrak Choi, Nick Corson, Lizzie Peiros, Elliot W Hawkes, Sean Keller, and Sean Follmer. 2017. A soft, controllable, high force density linear brake utilizing layer jamming. IEEE Robotics and Automation Letters 3, 1 (2017), 450–457.
[9]
Inrak Choi, Elliot W Hawkes, David L Christensen, Christopher J Ploch, and Sean Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, New York, NY, USA, 986–993.
[10]
Cristian Cuadra, Wiktoria Wojnicz, Ziga Kozinc, and Mark L Latash. 2020. Perceptual and motor effects of muscle co-activation in a force production task. Neuroscience 437 (2020), 34–44.
[11]
Simone Dalla Bella and Caroline Palmer. 2011. Rate effects on timing, key velocity, and finger kinematics in piano performance. PloS one 6, 6 (2011), e20518.
[12]
John Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance envelopes of virtual keyboard text input strategies in virtual reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, NY, USA, 289–300.
[13]
Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. Pinchtype: Text entry for virtual and augmented reality using comfortable thumb to fingertip pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–7.
[14]
Anna Maria Feit, Daryl Weir, and Antti Oulasvirta. 2016. How we type: Movement strategies and performance in everyday typing. In Proceedings of the 2016 chi conference on human factors in computing systems. ACM Press, New York, NY, USA, 4262–4273.
[15]
J Fish and JF Soechting. 1992. Synergistic finger movements in a skilled motor task. Experimental Brain Research 91 (1992), 327–334.
[16]
Frank A Fishburn, Ruth S Ludlum, Chandan J Vaidya, and Andrei V Medvedev. 2019. Temporal derivative distribution repair (TDDR): a motion correction method for fNIRS. Neuroimage 184 (2019), 171–179.
[17]
Conor R. Foy, John J. Dudley, Aakar Gupta, Hrvoje Benko, and Per Ola Kristensson. 2021. Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 287, 11 pages. https://doi.org/10.1145/3411764.3445671
[18]
Shinichi Furuya, Martha Flanders, and John F Soechting. 2011. Hand kinematics of piano playing. Journal of neurophysiology 106, 6 (2011), 2849–2864.
[19]
S Furuya, A Nakamura, and N Nagata. 2014. Acquisition of individuated finger movements through musical practice. Neuroscience 275 (2014), 444–454.
[20]
Shinichi Furuya and John F Soechting. 2012. Speed invariance of independent control of finger movements in pianists. Journal of neurophysiology 108, 7 (2012), 2060–2068.
[21]
Hyunjae Gil, Yonghwan Shin, Hyungki Son, Inwook Hwang, Ian Oakley, and Jin Ryong Kim. 2020. Characterizing In-Air Eyes-Free Typing Movements in VR. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology. ACM Press, New York, NY, USA, 1–10.
[22]
Verónica Gracia-Ibáñez, Margarita Vergara, and J-L Sancho-Bru. 2016. Interdependency of the maximum range of flexion–extension of hand metacarpophalangeal joints. Computer methods in BiomeChaniCs and BiomediCal engineering 19, 16 (2016), 1800–1807.
[23]
Yizheng Gu, Chun Yu, Zhipeng Li, Zhaoheng Li, Xiaoying Wei, and Yuanchun Shi. 2020. Qwertyring: Text entry on physical surfaces using a ring. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1–29.
[24]
Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, and Daniel Vogel. 2019. Rotoswype: Word-gesture typing using a ring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–12.
[25]
Sidhant Gupta, Dan Morris, Shwetak N Patel, and Desney Tan. 2013. Airwave: Non-contact haptic feedback using air vortex rings. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM Press, New York, NY, USA, 419–428.
[26]
Charlotte Häger-Ross and Marc H Schieber. 2000. Quantifying the independence of human finger movements: comparisons of digits, hands, and movement frequencies. Journal of Neuroscience 20, 22 (2000), 8542–8550.
[27]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload. Advances in Psychology, Vol. 52. North-Holland, Amsterdam, 139–183.
[28]
Hiroyuki Hayashi, Hideki Shimizu, Shoji Okumura, and Kazuhiro Miwa. 2014. Necessary metacarpophalangeal joints range of motion to maintain hand function. Hong Kong Journal of Occupational Therapy 24, 2 (2014), 51–55.
[29]
Koichi Hiraoka, Shun Ito, Momoko Lutton, Maya Nakano, and Noritaka Yonei. 2020. Long-term practice of isolated finger movements reduces enslaved response of tonically contracting little finger abductor to tonic index finger abduction. Experimental Brain Research 238 (2020), 499–512.
[30]
Xin Hou, Zong Zhang, Chen Zhao, Lian Duan, Yilong Gong, Zheng Li, and Chaozhe Zhu. 2021. NIRS-KIT: a MATLAB toolbox for both resting-state and task fNIRS data analysis. Neurophotonics 8, 1 (2021), 010802–010802.
[31]
Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. Hifinger: One-handed text entry technique for virtual environments based on touches between fingers. Sensors 19, 14 (2019), 3063.
[32]
Yudai Kimoto, Takanori Oku, and Shinichi Furuya. 2019. Neuromuscular and biomechanical functions subserving finger dexterity in musicians. Scientific reports 9, 1 (2019), 12224.
[33]
Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical keyboards in virtual reality: Analysis of typing performance and effects of avatar hands. In Proceedings of the 2018 CHI conference on human factors in computing systems. ACM, New York, NY, USA, 1–9.
[34]
Koen LM Koenraadt, Jacques Duysens, Bart M Meddeler, and Noël LW Keijsers. 2013. Hand tapping at mixed frequencies requires more motor cortex activity compared to single frequencies: an fNIRS study. Experimental brain research 231 (2013), 231–237.
[35]
Panayiotis Koutsabasis and Panagiotis Vogiatzidakis. 2019. Empirical research in mid-air interaction: A systematic review. International Journal of Human–Computer Interaction 35, 18 (2019), 1747–1768.
[36]
Tatsuya Koyama, Ikuo Yamano, Kenjiro Takemura, and Takashi Maeno. 2002. Multi-fingered exoskeleton haptic device using passive force feedback for dexterous teleoperation. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 3. IEEE, New York, NY, USA, 2905–2910.
[37]
Catherine E Lang and Marc H Schieber. 2004. Human finger independence: limitations due to passive mechanical coupling versus active neuromuscular control. Journal of neurophysiology 92, 5 (2004), 2802–2810.
[38]
Mark L Latash and Vladimir M Zatsiorsky. 2009. Multi-finger prehension: control of a redundant mechanical system. Springer US, Boston, MA, 597–618.
[39]
DoYoung Lee, Jiwan Kim, and Ian Oakley. 2021. Fingertext: Exploring and optimizing performance for wearable, mobile and one-handed typing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–15.
[40]
Penelope A Lewis and R Christopher Miall. 2003. Distinct systems for automatic and cognitively controlled time measurement: evidence from neuroimaging. Current opinion in neurobiology 13, 2 (2003), 250–255.
[41]
Zong-Ming Li, Shouchen Dun, Daniel A Harkness, and Teresa L Brininger. 2004. Motion enslaving among multiple fingers of the human hand. Motor Control 8, 1 (2004), 1–15.
[42]
Chen Liang, Chi Hsia, Chun Yu, Yukang Yan, Yuntao Wang, and Yuanchun Shi. 2023. DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU Rings. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1–30.
[43]
Janeen D Loehr and Caroline Palmer. 2007. Cognitive and biomechanical influences in pianists’ finger tapping. Experimental brain research 178 (2007), 518–528.
[44]
Janeen D Loehr and Caroline Palmer. 2009. Sequential and biomechanical factors constrain timing and motion in tapping. Journal of Motor Behavior 41, 2 (2009), 128–136.
[45]
Huub Maas, HEJ Dirkjan Veeger, and Dick F Stegeman. 2018. Understanding the constraints of finger motor control., 182–186 pages.
[46]
Joel R Martin, Mark L Latash, and Vladimir M Zatsiorsky. 2009. Interaction of finger enslaving and error compensation in multiple finger force production. Experimental brain research 192 (2009), 293–298.
[47]
Alex Mazursky, Shan-Yuan Teng, Romain Nith, and Pedro Lopes. 2021. MagnetIO: Passive yet Interactive Soft Haptic Patches Anywhere. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 213, 15 pages. https://doi.org/10.1145/3411764.3445543
[48]
Tara L McIsaac and Andrew J Fuglevand. 2007. Motor-unit synchrony within and across compartments of the human flexor digitorum superficialis. Journal of neurophysiology 97, 1 (2007), 550–556.
[49]
Luke E Miller, Matthew R Longo, and Ayse P Saygin. 2014. Tool morphology constrains the effects of tool use on body representations.Journal of Experimental Psychology: Human Perception and Performance 40, 6 (2014), 2143.
[50]
J Mooney. 2012. Medical Dictionary for the Health Professions and Nursing.
[51]
Jun Nishida, Soichiro Matsuda, Hiroshi Matsui, Shan-Yuan Teng, Ziwei Liu, Kenji Suzuki, and Pedro Lopes. 2020. HandMorph: a Passive Exoskeleton that Miniaturizes Grasp. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM Press, New York, NY, USA, 565–578.
[52]
Jun Nishida, Yudai Tanaka, Romain Nith, and Pedro Lopes. 2022. DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. ACM Press, New York, NY, USA, 1–12.
[53]
Romain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, and Pedro Lopes. 2021. DextrEMS: Increasing dexterity in electrical muscle stimulation by combining it with brakes. In The 34th annual ACM symposium on user interface software and technology. ACM Press, New York, NY, USA, 414–430.
[54]
Alexander Otte, Tim Menzner, Travis Gesslein, Philipp Gagel, Daniel Schneider, and Jens Grubert. 2019. Towards utilizing touch-sensitive physical keyboards for text entry in virtual reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, New York, NY, USA, 1729–1732.
[55]
Jaebum Park and Dayuan Xu. 2017. Multi-finger interaction and synergies in finger flexion and extension force production. Frontiers in human neuroscience 11 (2017), 318.
[56]
Evan Pezent, Simone Fani, Janelle Clark, Matteo Bianchi, and Marcia K O’Malley. 2019. Spatially separating haptic guidance from task dynamics through wearable devices. IEEE transactions on haptics 12, 4 (2019), 581–593.
[57]
Michiel Plooij, Glenn Mathijssen, Pierre Cherelle, Dirk Lefeber, and Bram Vanderborght. 2015. Lock your robot: A review of locking devices in robotics. IEEE Robotics & Automation Magazine 22, 1 (2015), 106–117.
[58]
Ely Rabin and Andrew M Gordon. 2004. Tactile feedback contributes to consistency of finger movements during typing. Experimental Brain Research 155 (2004), 362–369.
[59]
Ismo Rakkolainen, Antti Sand, and Roope Raisamo. 2019. A survey of mid-air ultrasonic tactile feedback. In 2019 IEEE International Symposium on Multimedia (ISM). IEEE, New York, NY, USA, 94–944.
[60]
Karen T Reilly and Geoffrey R Hammond. 2000. Independence of force production by digits of the human hand. Neuroscience letters 290, 1 (2000), 53–56.
[61]
Marc H Schieber and Lyndon S Hibbard. 1993. How somatotopic is the motor cortex hand area?Science 261, 5120 (1993), 489–492.
[62]
Marc H Schieber and Marco Santello. 2004. Hand function: peripheral and central constraints on performance. Journal of applied physiology 96, 6 (2004), 2293–2300.
[63]
Habib Sherkat, Marco Antonio Pinto-Orellana, and Peyman Mirtaheri. 2020. Shade: absorption spectroscopy enhancement with ambient light estimation and narrow-band detection. Optik 220 (2020), 165116.
[64]
Yatharth Singhal, Richard Huynh Noeske, Ayush Bhardwaj, and Jin Ryong Kim. 2022. Improving Finger Stroke Recognition Rate for Eyes-Free Mid-Air Typing in VR. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 346, 9 pages. https://doi.org/10.1145/3491102.3502100
[65]
Semyon Slobounov, W Ray, C Cao, and H Chiang. 2007. Modulation of cortical activity as a result of task-specific practice. Neuroscience letters 421, 2 (2007), 126–131.
[66]
JOHN F Soechting and Martha Flanders. 1992. Organization of sequential typing movements. Journal of Neurophysiology 67, 5 (1992), 1275–1290.
[67]
Natalie M Sommer, Burak Kakillioglu, Trevor Grant, Senem Velipasalar, and Leanne Hirshfield. 2021. Classification of fNIRS finger tapping data with multi-labeling and deep learning. IEEE Sensors Journal 21, 21 (2021), 24558–24569.
[68]
Srinath Sridhar, Anna Maria Feit, Christian Theobalt, and Antti Oulasvirta. 2015. Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3643–3652. https://doi.org/10.1145/2702123.2702136
[69]
Paul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier, Hugo Romat, and Christian Holz. 2022. TapType: Ten-finger text entry on everyday surfaces via Bayesian inference. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–16.
[70]
Zhongda Sun, Minglu Zhu, Xuechuan Shan, and Chengkuo Lee. 2022. Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions. Nature communications 13, 1 (2022), 5224.
[71]
Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2019. Experimental analysis of barehand mid-air mode-switching techniques in virtual reality. In Proceedings of the 2019 CHI conference on human factors in computing systems. ACM Press, New York, NY, USA, 1–14.
[72]
Robert Susik and Szymon Grabowski. 2023. Keydrop: Dynamic Keyboard Layout for Faster Typing and Fewer Typos. International Journal of Human–Computer Interaction 0, 0 (2023), 1–9.
[73]
Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation’s dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–12.
[74]
Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Touch&Fold: A foldable haptic actuator for rendering touch in mixed reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–14.
[75]
Shan-Yuan Teng, KD Wu, Jacqueline Chen, and Pedro Lopes. 2022. Prolonging VR Haptic Experiences by Harvesting Kinetic Energy from the User. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. ACM Press, New York, NY, USA, 1–18.
[76]
Pramodsingh H Thakur, Amy J Bastian, and Steven S Hsiao. 2008. Multidigit movement synergies of the human hand in an unconstrained haptic exploration task. Journal of Neuroscience 28, 6 (2008), 1271–1281.
[77]
Emanuel Todorov and Zoubin Ghahramani. 2004. Analysis of the synergies underlying complex hand manipulation. In The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 2. IEEE, New York, NY, USA, 4637–4640.
[78]
Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. Elasticvr: Providing multilevel continuously-changing resistive force and instant impact using elasticity for vr. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–10.
[79]
DARCY A Umphred and ROLANDO T LAZARO FAPTA. 2013. Foundations for clinical practice in neurological rehabilitation.
[80]
Josien C Van Den Noort, Nathalie Van Beek, Thomas Van Der Kraan, DirkJan HEJ Veeger, Dick F Stegeman, Peter H Veltink, and Huub Maas. 2016. Variable and asymmetric range of enslaving: fingers can act independently over small range of flexion. Plos one 11, 12 (2016), e0168636.
[81]
Hiske van Duinen and Simon C Gandevia. 2011. Constraints for control of the human hand. The Journal of physiology 589, 23 (2011), 5583–5593.
[82]
Koos Jaap Van-Zwieten, Klaus P Schmidt, G Jan Bex, Peter L Lippens, and Wim Duyvendak. 2015. An analytical expression for the DIP–PIP flexion interdependence in human fingers. Acta of Bioengineering and Biomechanics 17, 1 (2015), 129–135.
[83]
Luis Vargas, He Helen Huang, Yong Zhu, and Xiaogang Hu. 2021. Closed-loop control of a prosthetic finger via evoked proprioceptive information. Journal of neural engineering 18, 6 (2021), 066029.
[84]
Willem B Verwey. 2001. Concatenating familiar movement sequences: The versatile cognitive processor. Acta psychologica 106, 1-2 (2001), 69–95.
[85]
Herbert P von Schroeder and Michael J Botte. 1993. The functional significance of the long extensors and juncturae tendinum in finger extension. The Journal of hand surgery 18, 4 (1993), 641–647.
[86]
Rongxi Wang, Jinjin Xu, Wenxin Zhang, Jianmin Gao, Yufan Li, and Fumin Chen. 2022. Reliability analysis of complex electromechanical systems: State of the art, challenges, and prospects. Quality and Reliability Engineering International 38, 7 (2022), 3935–3969.
[87]
Selina C Wriessnegger, Günther Bauernfeind, Kerstin Schweitzer, Silvia Kober, Christa Neuper, and Gernot R Müller-Putz. 2012. The interplay of prefrontal and sensorimotor cortices during inhibitory control of learned motor behavior. Frontiers in Neuroengineering 5 (2012), 17.
[88]
Nan Yang and Amol D Mali. 2016. Modifying keyboard layout to reduce finger-travel distance. In 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI). IEEE, New York, NY, USA, 165–168.
[89]
Xin Yi, Chun Yu, Mingrui Zhang, Sida Gao, Ke Sun, and Yuanchun Shi. 2015. Atk: Enabling ten-finger freehand typing in air based on 3d hand tracking data. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM Press, New York, NY, USA, 539–548.
[90]
Difeng Yu, Kaixuan Fan, Heng Zhang, Diego Monteiro, Wenge Xu, and Hai-Ning Liang. 2018. PizzaText: text entry for virtual reality systems using dual thumbsticks. IEEE transactions on visualization and computer graphics 24, 11 (2018), 2927–2935.
[91]
Wei Shin Yu, Hiske van Duinen, and Simon C Gandevia. 2010. Limits to the control of the human thumb and fingers in flexion and extension. Journal of neurophysiology 103, 1 (2010), 278–289.
[92]
Vladimir M Zatsiorsky, Zong-Ming Li, and Mark L Latash. 1998. Coordinated force production in multi-finger tasks: finger interaction and neural network modeling. Biological cybernetics 79, 2 (1998), 139–150.
[93]
Vladimir M Zatsiorsky, Zong-Ming Li, and Mark L Latash. 2000. Enslaving effects in multi-finger force production. Experimental brain research 131 (2000), 187–195.
[94]
Mingrui Ray Zhang, Shumin Zhai, and Jacob O Wobbrock. 2022. TypeAnywhere: A QWERTY-Based Text Entry Solution for Ubiquitous Computing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, USA, 1–16.
[95]
Igor Zubrycki and Grzegorz Granosik. 2017. Novel haptic device using jamming principle for providing kinaesthetic feedback in glove-based control interface. Journal of Intelligent & Robotic Systems 85, 3-4 (2017), 413–429.
Index Terms
- Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical Perspective
Recommendations
Functional connectivity and coactivation of the nucleus accumbens: A combined functional connectivity and structure-based meta-analysis
This article investigates the functional connectivity patterns of the nucleus accumbens (NAcc) in 18 healthy participants using a resting state functional connectivity (rsFC) protocol. Also, a meta-analytic connectivity modeling (MACM) was used to ...
Voluntary finger movement in man: Cerebral potentials and theory
Three different brain potentials preceeding voluntary rapid finger flexion can be recorded from the skull surface by time reversed averaging. The early cortical activity preceding unilateral movement is bilateral and widespread (Bereitschaftspotential, ...
Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsTyping with ten fingers on a virtual keyboard in virtual or augmented reality exposes a challenging input interpretation problem. There are many sources of noise in this interaction context and these exacerbate the challenge of accurately translating ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
2334 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- National Key R&D Program of China
- Natural Science Foundation of China
Conference
UIST '24
UIST '24: The 37th Annual ACM Symposium on User Interface Software and Technology
October 13 - 16, 2024
PA, Pittsburgh, USA
Acceptance Rates
Overall Acceptance Rate 561 of 2,567 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 301Total Downloads
- Downloads (Last 12 months)301
- Downloads (Last 6 weeks)92
Reflects downloads up to 27 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in