Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleNovember 2017
An investigation of dynamic crossmodal instantiation in TUIs
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionPages 82–90https://doi.org/10.1145/3136755.3136782There is a growing research interest in combining crossmodal research with tangible interaction design. However, most behavioural research on crossmodal perception and on multimodal tangible interaction evaluation are based on static and non-...
- research-articleMay 2017
AVUI: Designing a Toolkit for Audiovisual Interfaces
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsPages 1093–1104https://doi.org/10.1145/3025453.3026042The combined use of sound and image has a rich history, from audiovisual artworks to research exploring the potential of data visualization and sonification. However, we lack standard tools or guidelines for audiovisual (AV) interaction design, ...
- research-articleJune 2013
Beyond the vision paradigm: design strategies for crossmodal interaction with dynamic digital displays
PerDis '13: Proceedings of the 2nd ACM International Symposium on Pervasive DisplaysPages 91–96https://doi.org/10.1145/2491568.2491588The purpose of our research is to develop new interaction paradigms for dynamic digital displays (DDDs) in public space. Our lab is currently developing an ontological framework that comprises seven different interaction paradigms for DDDs. Still in its ...
- ArticleJune 2012
Vibrotactile stimulation can affect auditory loudness: a pilot study
EuroHaptics'12: Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part IIPages 103–108https://doi.org/10.1007/978-3-642-31404-9_18Very few cases have been reported where tactile stimulation affects auditory perception. In this pilot study, we asked volunteers to compare the loudness of combinations of vibrotactile and auditory stimuli. A 50-300 Hz band-limited pink noise signal ...
- research-articleApril 2010
Crosstrainer: testing the use of multimodal interfaces in situ
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPages 333–342https://doi.org/10.1145/1753326.1753378We report the results of an exploratory 8-day field study of CrossTrainer: a mobile game with crossmodal audio and tactile feedback. Our research focuses on the longitudinal effects on performance with audio and tactile feedback, the impact of context ...
- short-paperApril 2009
Audio or tactile feedback: which modality when?
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPages 2253–2256https://doi.org/10.1145/1518701.1519045When designing interfaces for mobile devices it is import-ant to take into account the variety of contexts of use. We present a study that examines how changing noise and dis-turbance in the environment affects user performance in a touchscreen typing ...
- research-articleOctober 2008
Crossmodal congruence: the look, feel and sound of touchscreen widgets
ICMI '08: Proceedings of the 10th international conference on Multimodal interfacesPages 157–164https://doi.org/10.1145/1452392.1452423Our research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, ...
- research-articleSeptember 2008
Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions
The last few years have seen the release of an increasing number of new IT-related devices into the marketplace that have started to utilize tactile feedback. These include those devices incorporating a touch screen that make multimodal feedback ...
- research-articleNovember 2007
Designing audio and tactile crossmodal icons for mobile devices
ICMI '07: Proceedings of the 9th international conference on Multimodal interfacesPages 162–169https://doi.org/10.1145/1322192.1322222This paper reports an experiment into the design of crossmodal icons which can provide an alternative form of output for mobile devices using audio and tactile modalities to communicate information. A complete set of crossmodal icons was created by ...
- ArticleApril 2006
Crossmodal icons for information display
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing SystemsPages 857–862https://doi.org/10.1145/1125451.1125619This paper describes a novel form of display using crossmodal output. A crossmodal icon is an abstract icon that can be instantiated in one of two equivalent forms (auditory or tactile). These can be used in interfaces as a means of non-visual output. ...