Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

It’s All in the Timing: Principles of Transient Distraction Illustrated with Vibrotactile Tasks

Published: 31 May 2020 Publication History

Abstract

Vibration is an efficient way of conveying information from a device to its user, and it is increasingly used for wrist or finger-worn devices such as smart rings. Unexpected vibrations or sounds from the environment may disrupt the perception of such information. Although disruptive effects have been systematically explored in vision and audition, they have been less thoroughly examined in the haptic domain. Here we briefly review the relevant literature from HCI and psychology, distilling principles of when distraction is likely. We then investigate these principles through four experiments, examining how the timing and modality of relatively rare or unexpected stimuli (surprise distractors) affect the detection and recognition of vibrotactile target patterns. At short distractor-target delays (<350 ms), both auditory and vibrotactile surprise distractors impaired performance. At a longer delay (1,050 ms), performance was not affected overall, even being improved with repeated exposure to the vibrotactile distractors. We discuss the importance of our findings in the context of HCI and cognitive psychology, and we provide design guidelines for mitigating the effects of distraction on haptic devices.

References

[1]
Jessalyn Alvina, Shengdong Zhao, Simon T. Perrault, Maryam Azh, Thijs Roumen, and Morten Fjeld. 2015. OmniVib: Towards cross-body spatiotemporal vibrotactile notifications for mobile phones. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, New York, NY, 2487--2496.
[2]
Christopher L. Asplund, Daryl Fougnie, Samir Zughni, Justin W. Martin, and René Marois. 2014. The attentional blink reveals the probabilistic nature of discrete conscious perception. Psychological Science 25, 3 (March 2014), 824--831.
[3]
Christopher L. Asplund, J. Jay Todd, A. P. Snyder, Christopher M. Gilbert, and René Marois. 2010. Surprise-induced blindness: A stimulus-driven attentional limit to conscious perception.Journal of Experimental Psychology: Human Perception and Performance 36, 6 (2010), 1372--1381.
[4]
Christopher L. Asplund, J. Jay Todd, Andy P. Snyder, and René Marois. 2010. A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention. Nature Neuroscience 13, 4 (April 2010), 507--512.
[5]
Carryl L. Baldwin, Charles Spence, James P. Bliss, J. Christopher Brill, Michael S. Wogalter, Christopher B. Mayhorn, and Thomas K. Ferris. 2012. Multimodal cueing: The relative benefits of the auditory, visual, and tactile channels in complex environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (2012), 1431--1435.
[6]
Sandra Bardot, Marcos Serrano, Simon Perrault, Shengdong Zhao, and Christophe Jouffrais. 2019. Investigating feedback for two-handed exploration of digital maps without vision. In Human-Computer Interaction -- INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 305--324.
[7]
Dale J. Barr, Roger Levy, Christoph Scheepers, and Harry J. Tily. 2013. Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language 68, 3 (April 2013), 255--278.
[8]
Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67, 1 (2015), 1--48.
[9]
Yoav Benjamini and Yosef Hochberg. 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological) 57, 1 (1995), 289--300.
[10]
Anne-Marie Brouwer and Jan Van Erp. 2010. A tactile P300 brain-computer interface. Frontiers in Neuroscience 4 (2010), 19.
[11]
Marisa Carrasco, Sam Ling, and Sarah Read. 2004. Attention alters appearance. Nature Neuroscience 7, 3 (March 2004), 308--313.
[12]
J. Y. C. Chen and P. I. Terrence. 2008. Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment. Ergonomics 51, 8 (2008), 1137--1152.
[13]
Qin Chen, Simon T. Perrault, Quentin Roy, and Lonce Wyse. 2018. Effect of temporality, physical activity and cognitive load on spatiotemporal vibrotactile pattern recognition. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (AVI’18). ACM, New York, NY, Article 25, 9 pages.
[14]
Roger W. Cholewiak and James C. Craig. 1984. Vibrotactile pattern recognition and discrimination at several body sites. Perception 8 psychophysics 35, 6 (1984), 503--514.
[15]
Marvin M. Chun and René Marois. 2002. The dark side of visual attention. Current Opinion in Neurobiology 12, 2 (April 2002), 184--189.
[16]
James C. Craig. 1982. Vibrotactile masking: A comparison of energy and pattern maskers. Perception 8 Psychophysics 31, 6 (Nov. 1982), 523--529.
[17]
James C. Craig and Paul M. Evans. 1995. Tactile selective attention and temporal masking. Attention, Perception, 8 Psychophysics 57, 4 (1995), 511--518. Retrieved from http://www.springerlink.com/index/272215101PX7Q387.pdf.
[18]
Sarah D’Amour and Laurence R. Harris. 2014. Contralateral tactile masking between forearms. Experimental Brain Research 232, 3 (March 2014), 821--826.
[19]
R. Dell’Acqua, P. Jolicœur, P. Sessa, and M. Turatto. 2006. Attentional blink and selection in the tactile domain. European Journal of Cognitive Psychology 18, 4 (July 2006), 537--559.
[20]
E. Donchin, K. M. Spencer, and R. Wijesinghe. 2000. The mental prosthesis: Assessing the speed of a P300-based brain-computer interface. IEEE Transactions on Rehabilitation Engineering 8, 2 (June 2000), 174--179.
[21]
P. E. Dux and R. Marois. 2009. The attentional blink: A review of data and theory. Attention, Perception 8 Psychophysics 71, 8 (Nov. 2009), 1683--1700.
[22]
Howard E. Egeth and Steven Yantis. 1997. Visual attention: Control, representation, and time course. Annual Review of Psychology 48, 1 (1997), 269--297.
[23]
Mario Enriquez and Karon E. MacLean. 2008. Backward and common-onset masking of vibrotactile stimuli. Brain Research Bulletin 75, 6 (April 2008), 761--769.
[24]
X. Serra, F. Font, and G. Roma. 2013. Freesound technical demo. In Proceedings of the 21st ACM International Conference on Multimedia. 411--412.
[25]
Charles L. Folk, Andrew B. Leber, and Howard E. Egeth. 2002. Made you blink! contingent attentional capture produces a spatial blink. Perception 8 Psychophysics 64, 5 (2002), 741--753. Retrieved from http://link.springer.com/article/10.3758/BF03194741.
[26]
C. L. Folk, R. W. Remington, and J. C. Johnston. 1992. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology. Human Perception and Performance 18, 4 (Nov. 1992), 1030--1044.
[27]
J. Fox and S. Weisberg. 2011. An R Companion to Applied Regression. SAGE, Thousand Oaks, Calif. Retrieved from http://socserv.socsci.mcmaster.ca/jfox/Books/Companion.
[28]
A. Gallace, H. Z. Tan, and C. Spence. 2006. The failure to detect tactile change: A tactile analogue of visual change blindness. Psychonomic Bulletin 8 Review 13, 2 (2006), 300--303.
[29]
Alan Gevins and Michael E. Smith. 2003. Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomics Science 4, 1--2 (2003), 113--131.
[30]
Gregory O. Gibson and James C. Craig. 2005. Tactile spatial sensitivity and anisotropy. Perception 8 Psychophysics 67, 6 (2005), 1061--1079.
[31]
Anne P. Hillstrom, Kimron L. Shapiro, and Charles Spence. 2002. Attentional limitations in processing sequentially presented vibrotactile targets. Attention, Perception, 8 Psychophysics 64, 7 (2002), 1068--1082. Retrieved from http://www.springerlink.com/index/K1115663228P602Q.pdf.
[32]
Eve Hoggan and Stephen Brewster. 2007. Designing audio and tactile crossmodal icons for mobile devices. In Proceedings of the 9th International Conference on Multimodal Interfaces. ACM, 162--169.
[33]
Eve Hoggan, Topi Kaaresoja, Pauli Laitinen, and Stephen Brewster. 2008. Crossmodal congruence: The look, feel and sound of touchscreen widgets. In Proceedings of the 10th International Conference on Multimodal Interfaces. ACM, 157--164.
[34]
Gernot Horstmann. 2015. The surprise-attention link: A review: The surprise-attention link. Annals of the New York Academy of Sciences 1339, 1 (March 2015), 106--115.
[35]
Seungwoo Je, Minkyeong Lee, Yoonji Kim, Liwei Chan, Xing-Dong Yang, and Andrea Bianchi. 2018. PokeRing: Notifications by poking around the finger. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI’18). ACM, New York, NY, Article Paper 542, 10 pages.
[36]
Seungwoo Je, Brendan Rooney, Liwei Chan, and Andrea Bianchi. 2017. tactoRing: A skin-drag discrete display. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3106--3114.
[37]
T. Kaaresoja and J. Linjama. 2005. Perception of short tactile pulses generated by a vibration motor in a mobile phone. In Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, Pisa, Italy, 471--472.
[38]
J. Katayama and J. Polich. 1998. Stimulus context determines P3a and P3b. Psychophysiology 35, 1 (1998), 23--33.
[39]
H. H. King, R. Donlin, and B. Hannaford. 2010. Perceptual thresholds for single vs. multi-finger haptic interaction. In Proceedings of the 2010 IEEE Haptics Symposium. 95--99.
[40]
Dev S. Kochhar, Jr. Walter J. Talamonti, and Louis Tijerina. 2012. Driver response to unexpected automatic braking/haptic warning while backing. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (2012), 2211--2215.
[41]
Kishor Lakshminarayanan, Abigail W. Lauer, Viswanathan Ramakrishnan, John G. Webster, and Na Jin Seo. 2015. Application of vibration to wrist and hand skin affects fingertip tactile sensation. Physiological Reports 3, 7 (July 2015), e12465.
[42]
Seungyon “Claire” Lee and Thad Starner. 2010. BuzzWear: Alert perception in wearable tactile displays on the wrist. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10). ACM, New York, NY, 433--442.
[43]
Jessica K. Ljungberg and Fabrice B. R. Parmentier. 2012. Cross-modal distraction by deviance: Functional similarities between the auditory and tactile modalities. Experimental Psychology 59, 6 (Jan. 2012), 355--363.
[44]
Shayne Loft, Penelope Sanderson, Andrew Neal, and Martijn Mooij. 2007. Modeling and predicting mental workload in en route air traffic control: critical review and broader implications. Human Factors 49, 3 (2007), 376--399.
[45]
R. B. Mars, S. Debener, T. E. Gladwin, L. M. Harrison, P. Haggard, J. C. Rothwell, and S. Bestmann. 2008. Trial-by-trial fluctuations in the event-related electroencephalogram reflect dynamic changes in the degree of surprise. Journal of Neuroscience 28, 47 (Nov. 2008), 12539--12545.
[46]
Angela C. Marsalia, Thomas K. Ferris, Mark E. Benden, and Qi Zheng. 2016. Evaluation of vibrotactile warning systems for supporting hazard awareness and safety of distracted pedestrians. IIE Transactions on Occupational Ergonomics and Human Factors 4, 4 (Oct. 2016), 222--235.
[47]
Maranda McBride, Phuong Tran, and Tomasz Letowski. 2017. Bone conduction communication: Research progress and directions. Technical Report, 148.
[48]
James Merlo and Peter Hancock. 2011. Quantification of tactile cueing for enhanced target search capacity. Military Psychology 23, 2 (2011), 137--153.
[49]
Sandra Murphy and Polly Dalton. 2016. Out of touch? Visual load induces inattentional numbness.Journal of Experimental Psychology: Human Perception and Performance 42, 6 (June 2016), 761--765.
[50]
Sandra Murphy and Polly Dalton. 2018. Inattentional numbness and the influence of task difficulty. Cognition 178 (Sept. 2018), 1--6.
[51]
T. Obana, S. W. H. Lim, and C. L. Asplund. 2020. Surprise-induced deafness: Unexpected auditory stimuli capture attention to the detriment of subsequent detection. Psyarxiv (2020). https://doi.org/10.31234/osf.io/evfxa
[52]
Fabrice B. R. Parmentier, Jessica K. Ljungberg, Jane V. Elsley, and Markus Lindkvist. 2011. A behavioral study of distraction by vibrotactile novelty.Journal of Experimental Psychology: Human Perception and Performance 37, 4 (2011), 1134--1139.
[53]
Jonathan W. Peirce. 2007. PsychoPy—psychophysics software in Python. Journal of Neuroscience Methods 162, 1 (2007), 8--13.
[54]
Huimin Qian, Ravi Kuber, Andrew Sears, and Elizabeth Stanwyck. 2014. Determining the efficacy of multi-parameter tactons in the presence of real-world and simulated audio distractors. Interacting with Computers 26, 6 (2014), 572--594.
[55]
Thijs Roumen, Simon T. Perrault, and Shengdong Zhao. 2015. NotiRing: A comparative study of notification channels for wearable interactive rings. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, New York, NY, 2497--2500.
[56]
Bahador Saket, Chrisnawan Prasojo, Yongfeng Huang, and Shengdong Zhao. 2013. Designing an effective vibration-based notification interface for mobile phones. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW’13). ACM, New York, NY, 149--1504.
[57]
K. Sathian and A. Zangaladze. 1996. Tactile spatial acuity at the human fingertip and lip. Neurology 46, 5 (1996), 1464--1464.
[58]
Claire Sergent and Stanislas Dehaene. 2004. Is consciousness a gradual phenomenon? Evidence for an all-or-none bifurcation during the attentional blink. Psychological Science 15, 11 (2004), 720--728. Retrieved from http://pss.sagepub.com/content/15/11/720.short.
[59]
D. Shen and T. A. Mondor. 2006. Effect of distractor sounds on the auditory attentional blink. Perception 8 Psychophysics 68, 2 (2006), 228--243.
[60]
Salvador Soto-Faraco, Charles Spence, Katherine Fairbank, Alan Kingstone, Anne P. Hillstrom, and Kimron Shapiro. 2002. A crossmodal attentional blink between vision and touch. Psychonomic Bulletin 8 Review 9, 4 (Dec. 2002), 731--738.
[61]
Nancy K. Squires, Kenneth C. Squires, and Steven A. Hillyard. 1975. Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. Electroencephalography and Clinical Neurophysiology 38, 4 (April 1975), 387--401.
[62]
Laura M. Stanley. 2006. Haptic and auditory cues for lane departure warnings. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 22 (2006), 2405--2408.
[63]
François Vachon, Katherine Labonté, and John E. Marsh. 2017. Attentional capture by deviant sounds: A noncontingent form of auditory distraction? Journal of Experimental Psychology: Learning, Memory, and Cognition 43, 4 (2017), 622--634.
[64]
Francisco Vega-Bermudez and Kenneth O. Johnson. 2001. Differences in spatial acuity between digits. Neurology 56, 10 (May 2001), 1389.
[65]
S. Weinstein. 1962. Tactile sensitivity of the phalanges. Perceptual and Motor Skills 14, 3 (1962), 351--354.
[66]
Janet M. Weisenberger and James C. Craig. 1982. A tactile metacontrast effect. Perception 8 Psychophysics 31, 6 (Nov. 1982), 530--536.
[67]
Shuhei Yamaguchi and Robert T. Knight. 1991. P300 generation by novel somatosensory stimuli. Electroencephalography and Clinical Neurophysiology 78, 1 (Jan. 1991), 50--55.
[68]
Koji Yatani, Darren Gergle, and Khai Truong. 2012. Investigating effects of visual and tactile feedback on spatial coordination in collaborative handheld systems. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work. ACM, 661--670.
[69]
Koji Yatani and Khai Nhut Truong. 2009. SemFeel: A user interface with semantic tactile feedback for mobile touch-screen devices. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. ACM, 111--120.
[70]
Ying Zheng, E. Su, and J. B. Morrell. 2013. Design and evaluation of pactors for managing attention capture. In Proceedings of the 2013 World Haptics Conference (WHC’13). IEEE, Daejeon, 497--502.

Cited By

View all
  • (2024)Effect of system interface elements’ design features and vibration levels on task load and body discomfort in vehicle simulated vibration environmentsWORK: A Journal of Prevention, Assessment & Rehabilitation10.1177/10519815241290427Online publication date: 4-Dec-2024
  • (2024)EEG correlates to perceived urgency elicited by vibration stimulation of the upper bodyScientific Reports10.1038/s41598-024-65289-614:1Online publication date: 20-Jun-2024
  • (2024)The Effects of Simulated Driving on Perceived Urgency Elicited by Vibration StimulationHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70061-3_28(346-357)Online publication date: 30-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction
ACM Transactions on Computer-Human Interaction  Volume 27, Issue 3
June 2020
262 pages
ISSN:1073-0516
EISSN:1557-7325
DOI:10.1145/3403634
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2020
Online AM: 07 May 2020
Accepted: 01 March 2020
Revised: 01 January 2020
Received: 01 June 2019
Published in TOCHI Volume 27, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Wearable computing
  2. audio
  3. auditory
  4. distraction
  5. haptic feedback
  6. perception
  7. ring
  8. vibration
  9. vibrotactile pattern

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)10
Reflects downloads up to 17 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Effect of system interface elements’ design features and vibration levels on task load and body discomfort in vehicle simulated vibration environmentsWORK: A Journal of Prevention, Assessment & Rehabilitation10.1177/10519815241290427Online publication date: 4-Dec-2024
  • (2024)EEG correlates to perceived urgency elicited by vibration stimulation of the upper bodyScientific Reports10.1038/s41598-024-65289-614:1Online publication date: 20-Jun-2024
  • (2024)The Effects of Simulated Driving on Perceived Urgency Elicited by Vibration StimulationHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70061-3_28(346-357)Online publication date: 30-Jun-2024
  • (2023)Stimulus awareness is associated with secondary somatosensory cortex activation in an inattentional numbness paradigmScientific Reports10.1038/s41598-023-49857-w13:1Online publication date: 19-Dec-2023

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media