Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills

Published: 14 September 2021 Publication History

Abstract

When beginners play the piano, the activity of the forearm muscles tends to be greater than that of experts because beginners move their fingers with more force than necessary. Reducing forearm muscle activity is important for pianists to prevent fatigue and injury. However, it is difficult for beginners to learn how to do so by themselves. We propose using electrical muscle stimulation (EMS) to teach beginners how to reduce this muscle activity while playing a tremolo: a rapid alternation between two notes. Since experts use wrist rotation efficiently when playing tremolos, we propose an EMS-based support system that applies EMS not to muscles that are relevant to moving the fingers but to the supinator and pronator teres muscles, which are involved in wrist rotation. We conducted a user study with 16 beginners to investigate how the forearm muscle activity on the extensor pollicis longus and digitorum muscles changed when using our EMS-based support system. We divided the participants into two groups: an experimental group who practiced by themselves with EMS and a control group who practiced by themselves without EMS and then practiced with instruction. When practicing by themselves, practicing with EMS was more effective than that without EMS; the activity levels of the extensor pollicis longus and digitorum muscles were significantly lower with EMS, and the participants felt less fatigue when playing tremolos. By comparing the improvement in reducing muscle activity between practicing with EMS and practicing with instruction, there was no significant difference. The results suggest that our EMS-based support system can reduce target muscle activity by applying EMS to other muscles to teach beginners how to move limbs efficiently.

Supplementary Material

niijima (niijima.zip)
Supplemental movie, appendix, image and software files for, Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills

References

[1]
Naji A Alibeji, Nicholas Andrew Kirsch, and Nitin Sharma. 2015. A muscle synergy-inspired adaptive control scheme for a hybrid walking neuroprosthesis. Frontiers in bioengineering and biotechnology 3 (2015), 203. https://doi.org/10.3389/fbioe.2015.00203
[2]
David G Allen, Graham Douglas Lamb, and H Westerblad. 2008. Skeletal muscle fatigue: cellular mechanisms. Physiological reviews (2008). https://doi.org/10.1152/physrev.00015.2007
[3]
Soichi Ando, Noriyuki Kida, and Shingo Oda. 2002. Practice effects on reaction time for peripheral and central visual fields. Perceptual and motor skills 95, 3 (2002), 747--751. https://doi.org/10.2466/pms.2002.95.3.747
[4]
Soichi Ando, Noriyuki Kida, and Shingo Oda. 2004. Retention of practice effects on simple reaction time for peripheral and central visual fields. Perceptual and Motor Skills 98, 3 (2004), 897--900. https://doi.org/10.2466/pms.98.3.897-900
[5]
Jumpei Arata, Keiichi Ohmoto, Roger Gassert, Olivier Lambercy, Hideo Fujimoto, and Ikuo Wada. 2013. A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism. In 2013 IEEE International Conference on Robotics and Automation. IEEE, 3902--3907. https://doi.org/10.1109/ICRA.2013.6631126
[6]
Roger B Dannenberg, Marta Sanchez, Annabelle Joseph, Peter Capell, Robert Joseph, and Ronald Saul. 1990. A computer-based multi-media tutor for beginning piano students. Journal of New Music Research 19, 2--3 (1990), 155--173. https://doi.org/10.1080/09298219008570563
[7]
Andrea d'Avella and Emilio Bizzi. 2005. Shared and specific muscle synergies in natural motor behaviors. Proceedings of the national academy of sciences 102, 8 (2005), 3076--3081. https://doi.org/10.1073/pnas.0500199102
[8]
Carlo J De Luca, L Donald Gilmore, Mikhail Kuznetsov, and Serge H Roy. 2010. Filtering the surface EMG signal: Movement artifact and baseline noise contamination. Journal of biomechanics 43, 8 (2010), 1573--1579. https://doi.org/10.1016/j.jbiomech.2010.01.027
[9]
Tim Duente, Justin Schulte, Max Pfeiffer, and Michael Rohs. 2018. Muscleio: Muscle-based input and output for casual notifications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--21. https://doi.org/10.1145/3214267
[10]
Ayaka Ebisu, Satoshi Hashizume, Kenta Suzuki, Akira Ishii, Mose Sakashita, and Yoichi Ochiai. 2017. Stimulated percussions: method to control human for learning music by using electrical muscle stimulation. In Proceedings of the 8th Augmented Human International Conference. 1--5. https://doi.org/10.1145/3041164.3041202
[11]
Shinya Fujii, Kazutoshi Kudo, Tatsuyuki Ohtsuki, and Shingo Oda. 2009. Tapping performance and underlying wrist muscle activity of non-drummers, drummers, and the world's fastest drummer. Neuroscience letters 459, 2 (2009), 69--73. https://doi.org/10.1016/j.neulet.2009.04.055
[12]
Shinya Fujii, Kazutoshi Kudo, Masahiro Shinya, Tatsuyuki Ohtsuki, and Shingo Oda. 2009. Wrist muscle activity during rapid unimanual tapping with a drumstick in drummers and nondrummers. Motor Control 13, 3 (2009), 237--250. https://doi.org/10.1123/mcj.13.3.237
[13]
Shinichi Furuya, Martha Flanders, and John F Soechting. 2011. Hand kinematics of piano playing. Journal of neurophysiology 106, 6 (2011), 2849--2864. https://doi.org/10.1152/jn.00378.2011
[14]
Shinichi Furuya, Tatsushi Goda, Haruhiro Katayose, Hiroyoshi Miwa, and Noriko Nagata. 2011. Distinct inter-joint coordination during fast alternate keystrokes in pianists with superior skill. Frontiers in human neuroscience 5 (2011), 50. https://doi.org/10.3389/fnhum.2011.00050
[15]
Shinichi Furuya and Hiroshi Kinoshita. 2007. Roles of proximal-to-distal sequential organization of the upper limb segments in striking the keys by expert pianists. Neuroscience letters 421, 3 (2007), 264--269. https://doi.org/10.1016/j.neulet.2007.05.051
[16]
S Furuya and H Kinoshita. 2008. Expertise-dependent modulation of muscular and non-muscular torques in multi-joint arm movements during piano keystroke. Neuroscience 156, 2 (2008), 390--402. https://doi.org/10.1016/j.neuroscience.2008.07.028
[17]
Shinichi Furuya and Hiroshi Kinoshita. 2008. Organization of the upper limb movement for piano key-depression differs between expert pianists and novice players. Experimental Brain Research 185, 4 (2008), 581--593. https://doi.org/10.1007/s00221-007-1184-9
[18]
Shinichi Furuya, Rieko Osu, and Hiroshi Kinoshita. 2009. Effective utilization of gravity during arm downswing in keystrokes by expert pianists. Neuroscience 164, 2 (2009), 822--831. https://doi.org/10.1016/j.neuroscience.2009.08.024
[19]
Yasuhisa Hasegawa, Yasuyuki Mikami, Kosuke Watanabe, and Yoshiyuki Sankai. 2008. Five-fingered assistive hand with mechanical compliance of human finger. In 2008 IEEE international conference on robotics and automation. IEEE, 718--724. https://doi.org/10.1109/ROBOT.2008.4543290
[20]
Mahmoud Hassan, Florian Daiber, Frederik Wiehr, Felix Kosmalla, and Antonio Krüger. 2017. Footstriker: An EMS-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1--18. https://doi.org/10.1145/3053332
[21]
Agi Horspool and Sandra S Yang. 2010. A comparison of university student perceptions and success learning music online and face-to-face. MERLOT Journal of Online Learning and Teaching 6, 1 (2010), 15--29.
[22]
Kevin Huang, Ellen Yi-Luen Do, and Thad Starner. 2008. PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills. In 2008 12th IEEE international symposium on wearable computers. IEEE, 41--44. https://doi.org/10.1109/ISWC.2008.4911582
[23]
Shunichi Kasahara, Jun Nishida, and Pedro Lopes. 2019. Preemptive action: Accelerating human reaction using electrical muscle stimulation without compromising agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--15. https://doi.org/10.1145/3290605.3300873
[24]
Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving agency during electrical muscle stimulation training speeds up reaction time directly after removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--9. https://doi.org/10.1145/3411764.3445147
[25]
Tamaki Kitamura and Masanobu Miura. 2006. Constructing a support system for self-learning playing the piano at the beginning stage. In Proceedings of International Conference on Music Perception and Cognition. Citeseer, 258--262.
[26]
Nathan B Kruse, Steven C Harlos, Russell M Callahan, and Michelle L Herring. 2013. Skype music lessons in the academy: Intersections of music education, applied music and technology. Journal of Music, Technology & Education 6, 1 (2013), 43--60. https://doi.org/10.1386/jmte.6.1.43_1
[27]
Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++ Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2515--2524. https://doi.org/10.1145/2702123.2702128
[28]
Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding force feedback to mixed reality experiences and games using electrical muscle stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13. https://doi.org/10.1145/3173574.3174020
[29]
Pedro Lopes, Doăa Yüksel, François Guimbretière, and Patrick Baudisch. 2016. Muscle-plotter: An interactive system based on electrical muscle stimulation that produces spatial output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 207--217. https://doi.org/10.1145/2984511.2984530
[30]
Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, et al. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--15. https://doi.org/10.1145/3313831.3376242
[31]
Arinobu Niijima, Takashi Isezaki, Ryosuke Aoki, Tomoki Watanabe, and Tomohiro Yamada. 2017. hitoeCap: wearable EMG sensor for monitoring masticatory muscles with PEDOT-PSS textile electrodes. In Proceedings of the 2017 ACM International Symposium on Wearable Computers. 215--220. https://doi.org/10.1145/3123021.3123068
[32]
Arinobu Niijima, Takashi Isezaki, Ryosuke Aoki, Tomoki Watanabe, and Tomohiro Yamada. 2018. Biceps fatigue estimation with an E-textile headband. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. 222--223. https://doi.org/10.1145/3267242.3267281
[33]
Arinobu Niijima, Takashi Isezaki, Ryosuke Aoki, Tomoki Watanabe, and Tomohiro Yamada. 2018. Controlling maximal voluntary contraction of the upper limb muscles by facial electrical stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--7. https://doi.org/10.1145/3173574.3173968
[34]
Arinobu Niijima, Toki Takeda, Ryosuke Aoki, and Yukio Koike. 2021. Reducing muscle activity when playing tremolo by using electrical muscle stimulation. In Augmented Humans Conference 2021. 289--291. https://doi.org/10.1145/3458709.3458977
[35]
Jun Nishida and Kenji Suzuki. 2017. BioSync: A paired wearable device for blending kinesthetic experience. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3316--3327. https://doi.org/10.1145/3025453.3025829
[36]
Chuanxin M Niu, Yong Bao, Cheng Zhuang, Si Li, Tong Wang, Lijun Cui, Qing Xie, and Ning Lan. 2019. Synergy-based FES for post-stroke rehabilitation of upper-limb motor functions. IEEE Transactions on Neural Systems and Rehabilitation Engineering 27, 2 (2019), 256--264. https://doi.org/10.1109/TNSRE.2019.2891004
[37]
Dietrich Parlitz, Thomas Peschel, and Eckart Altenmüller. 1998. Assessment of dynamic finger forces in pianists: effects of training and expertise. Journal of biomechanics 31, 11 (1998), 1063--1067. https://doi.org/10.1016/S0021-9290(98)00113-4
[38]
Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise control for pedestrians: Controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2505--2514. https://doi.org/10.1145/2702123.2702190
[39]
Max Pfeiffer, Stefan Schneegass, Florian Alt, and Michael Rohs. 2014. Let me grab this: a comparison of EMS and vibration for haptic feedback in free-hand interaction. In Proceedings of the 5th augmented human international conference. 1--8. https://doi.org/10.1145/2582051.2582099
[40]
Pamela D Pike. 2020. Preparing an emerging professional to teach piano online: A case study. International Journal on Innovations in Online Education 4, 2 (2020). https://doi.org/10.1615/IntJInnovOnlineEdu.2020034417
[41]
Pamela D Pike and Kristin Shoemaker. 2013. The effect of distance learning on acquisition of piano sight-reading skills. Journal of Music, Technology & Education 6, 2 (2013), 147--162. https://doi.org/10.1386/jmte.6.2.147_1
[42]
Thomas Reilly, Barry Drust, and Neil Clarke. 2008. Muscle fatigue during football match-play. Sports Medicine 38, 5 (2008), 357--367. https://doi.org/10.2165/00007256-200838050-00001
[43]
Chad G Rose and Marcia K O'Malley. 2018. Hybrid rigid-soft hand exoskeleton to assist functional dexterity. IEEE Robotics and Automation Letters 4, 1 (2018), 73--80. https://doi.org/10.1109/LRA.2018.2878931
[44]
Samuel Rota, Baptiste Morel, Damien Saboul, Isabelle Rogowski, and Christophe Hautier. 2014. Influence of fatigue on upper limb muscle activity and performance in tennis. Journal of Electromyography and Kinesiology 24, 1 (2014), 90--97. https://doi.org/10.1016/j.jelekin.2013.10.007
[45]
Primož Strojnik, Alojz Kralj, and I Ursic. 1979. Programmed six-channel electrical stimulator for complex stimulation of leg muscles during walking. IEEE Transactions on Biomedical Engineering 2 (1979), 112--116. https://doi.org/10.1109/TBME.1979.326520
[46]
Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation's dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--12. https://doi.org/10.1145/3411764.3445761
[47]
Nobuhiro Takahashi, Shinichi Furuya, and Hideki Koike. 2020. Soft Exoskeleton Glove with Human Anatomical Architecture: Production of Dexterous Finger Movements and Skillful Piano Performance. IEEE Transactions on Haptics (2020). https://doi.org/10.1109/TOH.2020.2993445
[48]
Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 543--552. https://doi.org/10.1145/1978942.1979018
[49]
Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Supportive training system for sports skill acquisition based on electrical stimulation. In 2017 IEEE World Haptics Conference (WHC). IEEE, 466--471. https://doi.org/10.1109/WHC.2017.7989946
[50]
Shingo Tsukada, Hiroshi Nakashima, and Keiichi Torimitsu. 2012. Conductive polymer combined silk fiber bundle for bioelectrical signal recording. PloS one 7, 4 (2012), e33689. https://doi.org/10.1371/journal.pone.0033689
[51]
Xiao Xiao and Hiroshi Ishii. 2010. MirrorFugue: communicating hand gesture in remote piano collaboration. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction. 13--20. https://doi.org/10.1145/1935701.1935705
[52]
Xiao Xiao and Hiroshi Ishii. 2016. Inspect, embody, invent: a design framework for music learning and beyond. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5397--5408. https://doi.org/10.1145/2858036.2858577

Cited By

View all
  • (2024)The effect of electrical muscle stimulation on intentional binding and explicit sense of agencyPeerJ10.7717/peerj.1797712(e17977)Online publication date: 19-Sep-2024
  • (2024)Growth Record of Kanagawa Prefectural Yokosuka Senior High School Students Becoming Sports Analysts--Introducing NTT Human Informatics Laboratories' Contribution Activities to the Local CommunityNTT Technical Review10.53829/ntr202401sc122:1(90-96)Online publication date: Jan-2024
  • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
  • Show More Cited By

Index Terms

  1. Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 5, Issue 3
    Sept 2021
    1443 pages
    EISSN:2474-9567
    DOI:10.1145/3486621
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 September 2021
    Published in IMWUT Volume 5, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. electrical muscle stimulation
    2. electromyography
    3. muscle activity
    4. piano
    5. tremolo

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)111
    • Downloads (Last 6 weeks)15
    Reflects downloads up to 19 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The effect of electrical muscle stimulation on intentional binding and explicit sense of agencyPeerJ10.7717/peerj.1797712(e17977)Online publication date: 19-Sep-2024
    • (2024)Growth Record of Kanagawa Prefectural Yokosuka Senior High School Students Becoming Sports Analysts--Introducing NTT Human Informatics Laboratories' Contribution Activities to the Local CommunityNTT Technical Review10.53829/ntr202401sc122:1(90-96)Online publication date: Jan-2024
    • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
    • (2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
    • (2024)Multimodal Haptic Feedback for Virtual Collisions Combining Vibrotactile and Electrical Muscle StimulationIEEE Transactions on Haptics10.1109/TOH.2024.335426817:1(33-38)Online publication date: Jan-2024
    • (2023)Induced effects of electrical muscle stimulation and visual stimulation on visual sensory reweighting dynamics during standing on a balance boardPLOS ONE10.1371/journal.pone.028583118:5(e0285831)Online publication date: 22-May-2023
    • (2023)Learning Effects and Retention of Electrical Muscle Stimulation in Piano PlayingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611373(104-108)Online publication date: 8-Oct-2023
    • (2023)Interactive Benefits from Switching Electrical to Magnetic Muscle StimulationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606812(1-12)Online publication date: 29-Oct-2023
    • (2023)Standing Balance Improved by Electrical Muscle Stimulation to Popliteus MusclesProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582711(27-34)Online publication date: 12-Mar-2023
    • (2023)PianoWatch: An Intelligent Piano Understanding and Evaluation System Using Smartwatch2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SECON58729.2023.10287516(222-230)Online publication date: 11-Sep-2023
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media