Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- Work in ProgressMay 2024
Investigating Lemurs Sensory Modality in Technologies: How do Lemurs Engage with Single and Multimodal Stimuli in Zoos?
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing SystemsArticle No.: 204, Pages 1–7https://doi.org/10.1145/3613905.3651056Current computer-based enrichment in zoos is often limited to providing a single-sensory experience, disregarding that animals perceive the world through multiple senses. To address this, we developed and deployed a multi-sensory device for six red ...
- research-articleApril 2023
Becoming an Online Wine Taster: An Ethnographic Study on the Digital Mediation of Taste
Proceedings of the ACM on Human-Computer Interaction (PACMHCI), Volume 7, Issue CSCW1Article No.: 26, Pages 1–26https://doi.org/10.1145/3579459There has been a growing interest in taste research in the HCI and CSCW communities. However, the focus is more on stimulating the senses, while the socio-cultural aspects have received less attention. However, individual taste perception is mediated ...
- short-paperOctober 2018
Cross-Modal Approach for Conversational Well-being Monitoring with Multi-Sensory Earables
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersPages 706–709https://doi.org/10.1145/3267305.3267695We propose a cross-modal approach for conversational well-being monitoring with a multi-sensory earable. It consists of motion, audio, and BLE models on earables. Using the IMU sensor, the microphone, and BLE scanning, the models detect speaking ...
- research-articleOctober 2018
Conveying language through haptics: a multi-sensory approach
- Nathan Dunkelberger,
- Jenny Sullivan,
- Joshua Bradley,
- Nickolas P Walling,
- Indu Manickam,
- Gautam Dasarathy,
- Ali Israr,
- Frances W. Y. Lau,
- Keith Klumb,
- Brian Knott,
- Freddy Abnousi,
- Richard Baraniuk,
- Marcia K O'Malley
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable ComputersPages 25–32https://doi.org/10.1145/3267242.3267244In our daily lives, we rely heavily on our visual and auditory channels to receive information from others. In the case of impairment, or when large amounts of information are already transmitted visually or aurally, alternative methods of communication ...
- abstractNovember 2017
Integrating performer into a real-time augmented reality performance spatially by using a multi-sensory prop
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyArticle No.: 66, Pages 1–2https://doi.org/10.1145/3139131.3141212The authors developed a system for augmenting live performances where the performer can drive the rendered background image via an infrared LED transmitter prop. A multi-sensory prop was designed to aid the position tracking of performer on large scale ...
-
- Work in ProgressJune 2017
Piecing Together the Past: Constructing Stories with Jigsaw Puzzles in Museums
DIS '17 Companion: Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive SystemsPages 79–83https://doi.org/10.1145/3064857.3079123In this paper we present PuzzleBeo, an interactive installation that comprises of a computer mediated jigsaw puzzle and multimodal display to engage children with museum exhibits in a fun and playful manner. PuzzleBeo is designed to allow children to ...
- research-articleMarch 2017
Maintaining and Constraining Performer Touch in the Design of Digital Musical Instruments
TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied InteractionPages 717–720https://doi.org/10.1145/3024969.3025042Expression in musical practice is inextricably tied to the touch of the performer. In digital musical instruments (DMIs) the relationship of touch to sound is indirect: the nuances and fine detail of performer control can be flattened and limited during ...
- research-articleNovember 2016
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food InteractionArticle No.: 1, Pages 1–6https://doi.org/10.1145/3007577.3007587In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...
- otherJuly 2016
Inner activity
SIGGRAPH '16: ACM SIGGRAPH 2016 VR VillageArticle No.: 8, Pages 1–2https://doi.org/10.1145/2929490.2932421Inner Activity is a multi-sensory virtual reality experience presented as a physical art installation. It combines interaction design and game technologies, sound healing and vibro-acoustic therapy techniques, physical set design, and concepts from ...
- research-articleJuly 2016
The musicians of memory: compositional silence and the audio-visuality of sound
EVA '16: Proceedings of the conference on Electronic Visualisation and the ArtsPages 49–52https://doi.org/10.14236/ewic/EVA2016.10As a multi-sensory composer I am concerned with the inter-relationship between the human voice and abstract sound and the use of rhythm, intonation, accent and tone as an original source for compositional exploration. In practice, this represents the ...
- abstractMay 2016
Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI
- Marianna Obrist,
- Carlos Velasco,
- Chi Thanh Vi,
- Nimesha Ranasinghe,
- Ali Israr,
- Adrian D. Cheok,
- Charles Spence,
- Ponnampalam Gopalakrishnakone
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsPages 3285–3292https://doi.org/10.1145/2851581.2856462The senses we call upon when interacting with technology are very restricted. We mostly rely on vision and audition, increasingly harnessing touch, whilst taste and smell remain largely underexploited. In spite of our current knowledge about sensory ...
- research-articleJuly 2015
LIVeMotion: a multi-sensory system to encourage the awareness of mindfulness
EVA '15: Proceedings of the Conference on Electronic Visualisation and the ArtsPages 24–31https://doi.org/10.14236/ewic/eva2015.2For stress management and well-being, there are many approaches that require heightened awareness of different bodily motions. Based on psychological studies of physiological response to music, LIVeMotion integrates a range of multimedia technologies, ...
- research-articleNovember 2014
Sensory Fiction: A Design Fiction of Emotional Computation
ImmersiveMe '14: Proceedings of the 2nd ACM International Workshop on Immersive Media ExperiencesPages 35–40https://doi.org/10.1145/2660579.2660585This paper is situated in the emergent field of "Design Fiction" and describes how this approach can be applied to explorations in the field of immersive media experiences. We present Sensory Fiction -- an exploration in augmenting the emotions of a ...
- research-articleOctober 2014
Breathing with timbre of the tones
PDC '14: Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium papers, and Keynote abstracts - Volume 2Pages 187–188https://doi.org/10.1145/2662155.2662230Timbre of the tones is an interactive sound installation inspired by the Namibian landscape. This handcrafted sound installation will mainly be built with metal, as well containing sand of different colors, found in the host country Namibia. Through the ...
- demonstrationSeptember 2014
Wearable haptic gaming using vibrotactile arrays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesPages 435–438https://doi.org/10.1145/2628363.2633574In this paper we explore the design, layout and configuration of wrist-wearable, haptic gaming interfaces, which involve visual and vibrotactile spatial and temporal patterns. Our goal is to determine overall layouts and spatial and temporal resolutions ...
- ArticleJuly 2013
Designing accessible visualizations: the case of designing a weather map for blind users
UAHCI'13: Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: design methods, tools, and interaction techniques for eInclusion - Volume Part IPages 436–445https://doi.org/10.1007/978-3-642-39188-0_47Major strides have been made to improve the accessibility of text-based documents for blind users, however, visualizations still remain largely inaccessible. The AISP framework represents an attempt to streamline the design process by aligning the ...
- demonstrationJune 2013
Blockuits: innovating building blocks
IDC '13: Proceedings of the 12th International Conference on Interaction Design and ChildrenPages 519–522https://doi.org/10.1145/2485760.2485855Blockuits is an exploration in the design of construction sets for children, resulting in three prototypes. All prototypes have simple interfaces, interactions and electronic outputs. These interactive toys foster creativity and artistic expression ...
- ArticleJune 2013
Formidable bracelet, beautiful lantern: studying multi-sensory user experience from a semiotic perspective
DESRIST'13: Proceedings of the 8th international conference on Design Science at the Intersection of Physical and Virtual DesignPages 181–196https://doi.org/10.1007/978-3-642-38827-9_13We live in an experience economy. The more saturated the global market becomes with products offering the same functions, services and quality, the more companies are wanting to appeal to the intangible needs and desires of consumers. To achieve this, ...
- ArticleNovember 2012
Chop chop: a sound augmented kitchen prototype
ACE'12: Proceedings of the 9th international conference on Advances in Computer EntertainmentPages 494–497https://doi.org/10.1007/978-3-642-34292-9_43In our fast evolving, highly technological world, sometimes we don't spend quality time cooking or eating together because our attention is split. How can we find a way to bring fun back into the kitchen, re-engaging people with cooking?
The aim of this ...
- ArticleAugust 2012
An interactive and multi-sensory learning environment for nano education
HAID'12: Proceedings of the 7th international conference on Haptic and Audio Interaction DesignPages 81–90https://doi.org/10.1007/978-3-642-32796-4_9Swift scientific advances in the area of nanoscience suggest that nanotechnology will play an increasingly important role in our everyday lives. Thus, knowledge of the principles underlying such technologies will inevitably be required to ensure a ...