Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3526113.3545666acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano

Published: 28 October 2022 Publication History

Abstract

When playing scales on the piano, playing all notes evenly is a basic technique to improve the quality of music. However, it is difficult for beginners to do this because they need to achieve appropriate muscle synergies of the forearm and shoulder muscles, i.e., pressing keys as well as sliding their hands sideways. In this paper, we propose a system using electrical muscle stimulation (EMS) to teach beginners how to improve their muscle synergies while playing scales. We focus on “thumb-under” method and assist with it by applying EMS to the deltoid muscle. We conducted a user study to investigate whether our EMS-based system can help beginners learn new muscle synergies in playing ascending scales. We divided the participants into two groups: an experimental group that practiced with EMS and a control group that practiced without EMS. The results showed that practicing with EMS was more effective in improving the evenness of scales than without EMS and that the muscle synergies changed after practicing.

References

[1]
Soichi Ando, Noriyuki Kida, and Shingo Oda. 2002. Practice effects on reaction time for peripheral and central visual fields. Perceptual and motor skills 95, 3 (2002), 747–751. https://doi.org/10.2466/pms.2002.95.3.747
[2]
Soichi Ando, Noriyuki Kida, and Shingo Oda. 2004. Retention of practice effects on simple reaction time for peripheral and central visual fields. Perceptual and Motor Skills 98, 3 (2004), 897–900. https://doi.org/10.2466/pms.98.3.897-900
[3]
Jumpei Arata, Keiichi Ohmoto, Roger Gassert, Olivier Lambercy, Hideo Fujimoto, and Ikuo Wada. 2013. A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism. In 2013 IEEE International Conference on Robotics and Automation. IEEE, 3902–3907. https://doi.org/10.1109/ICRA.2013.6631126
[4]
Michael W Berry, Murray Browne, Amy N Langville, V Paul Pauca, and Robert J Plemmons. 2007. Algorithms and applications for approximate nonnegative matrix factorization. Computational statistics & data analysis 52, 1 (2007), 155–173. https://doi.org/10.1016/j.csda.2006.11.006
[5]
Chuan C Chang. 2016. Fundamentals of piano practice.
[6]
Vincent CK Cheung, Andrea Turolla, Michela Agostini, Stefano Silvoni, Caoimhe Bennis, Patrick Kasi, Sabrina Paganoni, Paolo Bonato, and Emilio Bizzi. 2012. Muscle synergy patterns as physiological markers of motor cortical damage. Proceedings of the National Academy of Sciences 109, 36(2012), 14652–14656. https://doi.org/10.1073/pnas.1212056109
[7]
Jacob Cohen. 1992. A power primer. Psychological bulletin 112, 1 (1992), 155. https://doi.org/10.1037//0033-2909.112.1.155
[8]
Carlo J De Luca, L Donald Gilmore, Mikhail Kuznetsov, and Serge H Roy. 2010. Filtering the surface EMG signal: movement artifact and baseline noise contamination. Journal of biomechanics 43, 8 (2010), 1573–1579. https://doi.org/10.1016/j.jbiomech.2010.01.027
[9]
Stanislas Dehaene. 2020. How we learn: The new science of education and the brain. Penguin UK.
[10]
Ayaka Ebisu, Satoshi Hashizume, Kenta Suzuki, Akira Ishii, Mose Sakashita, and Yoichi Ochiai. 2017. Stimulated percussions: method to control human for learning music by using electrical muscle stimulation. In Proceedings of the 8th Augmented Human International Conference. 1–5. https://doi.org/10.1145/3041164.3041202
[11]
Shinichi Furuya and Eckart Altenmüller. 2013. Flexibility of movement organization in piano performance. Frontiers in human neuroscience 7 (2013), 173. https://doi.org/10.3389/fnhum.2013.00173
[12]
Shinichi Furuya, Tatsushi Goda, Haruhiro Katayose, Hiroyoshi Miwa, and Noriko Nagata. 2011. Distinct inter-joint coordination during fast alternate keystrokes in pianists with superior skill. Frontiers in human neuroscience 5 (2011), 50. https://doi.org/10.3389/fnhum.2011.00050
[13]
Shinichi Furuya and Sayuri Yokota. 2018. Temporal exploration in sequential movements shapes efficient neuromuscular control. Journal of Neurophysiology 120, 1 (2018), 196–210. https://doi.org/10.1152/jn.00922.2017
[14]
Victor Gonzalez-Sanchez, Sofia Dahl, Johannes Lunde Hatfield, and Rolf Inge Godøy. 2019. Characterizing movement fluency in musical performance: Toward a generic measure for technology enhanced learning. Frontiers in psychology 10 (2019), 84. https://doi.org/10.3389/fpsyg.2019.00084
[15]
Yasuhisa Hasegawa, Yasuyuki Mikami, Kosuke Watanabe, and Yoshiyuki Sankai. 2008. Five-fingered assistive hand with mechanical compliance of human finger. In 2008 IEEE international conference on robotics and automation. IEEE, 718–724. https://doi.org/10.1109/ROBOT.2008.4543290
[16]
Mahmoud Hassan, Florian Daiber, Frederik Wiehr, Felix Kosmalla, and Antonio Krüger. 2017. Footstriker: an EMS-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18. https://doi.org/10.1145/3053332
[17]
Yuri P Ivanenko, Richard E Poppele, and Francesco Lacquaniti. 2004. Five basic muscle activation patterns account for muscle activity during human locomotion. The Journal of physiology 556, 1 (2004), 267–282. https://doi.org/10.1113/jphysiol.2003.057174
[18]
Yuri P Ivanenko, Richard E Poppele, and Francesco Lacquaniti. 2006. Motor control programs and walking. The Neuroscientist 12, 4 (2006), 339–348. https://doi.org/10.1177/1073858406287987
[19]
Shunichi Kasahara, Jun Nishida, and Pedro Lopes. 2019. Preemptive action: accelerating human reaction using electrical muscle stimulation without compromising agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3290605.3300873
[20]
Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving agency during electrical muscle stimulation training speeds up reaction time directly after removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–9. https://doi.org/10.1145/3411764.3445147
[21]
Francesco Lacquaniti, Yuri P Ivanenko, and Myrka Zago. 2012. Patterned control of human locomotion. The Journal of physiology 590, 10 (2012), 2189–2199. https://doi.org/10.1113/jphysiol.2011.215137
[22]
Daniel D Lee and H Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 6755 (1999), 788–791. https://doi.org/10.1038/44565
[23]
Arinobu Niijima and Yuki Kubo. 2021. Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. 11–13. https://doi.org/10.1145/3474349.3480214
[24]
Arinobu Niijima, Toki Takeda, Ryosuke Aoki, and Yukio Koike. 2021. Reducing muscle activity when playing tremolo by using electrical muscle stimulation. In Augmented Humans Conference 2021. 289–291. https://doi.org/10.1145/3458709.3458977
[25]
Romain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, and Pedro Lopes. 2021. DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes. In The 34th Annual ACM Symposium on User Interface Software and Technology. 414–430. https://doi.org/10.1145/3472749.3474759
[26]
Yasunori Ozaki, Ryosuke Aoki, Toshitaka Kimura, Youichi Takashima, and Tomohiro Yamada. 2016. Characterizing muscular activities using non-negative matrix factorization from EMG channels for driver swings in golf. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 892–895. https://doi.org/10.1109/EMBC.2016.7590844
[27]
Dietrich Parlitz, Thomas Peschel, and Eckart Altenmüller. 1998. Assessment of dynamic finger forces in pianists: effects of training and expertise. Journal of biomechanics 31, 11 (1998), 1063–1067. https://doi.org/10.1016/S0021-9290(98)00113-4
[28]
Chad G Rose and Marcia K O’Malley. 2018. Hybrid rigid-soft hand exoskeleton to assist functional dexterity. IEEE Robotics and Automation Letters 4, 1 (2018), 73–80. https://doi.org/10.1109/LRA.2018.2878931
[29]
Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation’s dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3411764.3445761
[30]
Nobuhiro Takahashi, Shinichi Furuya, and Hideki Koike. 2020. Soft exoskeleton glove with human anatomical architecture: production of dexterous finger movements and skillful piano performance. IEEE Transactions on Haptics(2020). https://doi.org/10.1109/TOH.2020.2993445
[31]
Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 543–552. https://doi.org/10.1145/1978942.1979018
[32]
Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Supportive training system for sports skill acquisition based on electrical stimulation. In 2017 IEEE World Haptics Conference (WHC). IEEE, 466–471. https://doi.org/10.1109/WHC.2017.7989946
[33]
Gelsy Torres-Oviedo, Jane M Macpherson, and Lena H Ting. 2006. Muscle synergy organization is robust across a variety of postural perturbations. Journal of neurophysiology 96, 3 (2006), 1530–1546. https://doi.org/10.1152/jn.00810.2005
[34]
Matthew C Tresch, Vincent CK Cheung, and Andrea d’Avella. 2006. Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. Journal of neurophysiology 95, 4 (2006), 2199–2212. https://doi.org/10.1152/jn.00222.2005

Cited By

View all
  • (2024)Growth Record of Kanagawa Prefectural Yokosuka Senior High School Students Becoming Sports Analysts--Introducing NTT Human Informatics Laboratories' Contribution Activities to the Local CommunityNTT Technical Review10.53829/ntr202401sc122:1(90-96)Online publication date: Jan-2024
  • (2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
  • (2024)SplitBody: Reducing Mental Workload while Multitasking via Muscle StimulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642629(1-11)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
    October 2022
    1363 pages
    ISBN:9781450393201
    DOI:10.1145/3526113
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. electrical muscle stimulation
    2. muscle synergies
    3. piano
    4. scale
    5. thumb-under method

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    UIST '22

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)125
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 23 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Growth Record of Kanagawa Prefectural Yokosuka Senior High School Students Becoming Sports Analysts--Introducing NTT Human Informatics Laboratories' Contribution Activities to the Local CommunityNTT Technical Review10.53829/ntr202401sc122:1(90-96)Online publication date: Jan-2024
    • (2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
    • (2024)SplitBody: Reducing Mental Workload while Multitasking via Muscle StimulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642629(1-11)Online publication date: 11-May-2024
    • (2024)Modeling the Intent to Interact With VR Using Physiological FeaturesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330878730:8(5893-5900)Online publication date: Aug-2024
    • (2024)Muscle Synergy Analysis under the Constraint of Connectivity between Brain and Muscle Activity2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10651288(1-8)Online publication date: 30-Jun-2024
    • (2023)Learning Effects and Retention of Electrical Muscle Stimulation in Piano PlayingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611373(104-108)Online publication date: 8-Oct-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media