Abstract
It has long been known that our sense of smell is a powerful one that affects emotions and behaviors. Recently, interest in the sense of smell has been growing exponentially in HCI. However, the potential of smell to inspire design is still underexplored. In this paper, we first investigated crossmodal correspondences between scents and selected features relevant for design (clustered in sensory, bodily, and qualitative features). Then, we created a set of cards (EssCards) to visually summarize the key findings to inspire designers. We carried out two preliminary design exploration sessions using the EssCards. Based on our findings, we discuss how to inspire and challenge design opportunities around the sense of smell and reflect upon applications for smell as inspirational material for designing future interactions and experiences.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amores, J., Hernandez, J., Dementyev, A., Wang, X., Maes, P.: Bioessence: a wearable olfactory display that monitors cardio-respiratory information to support mental wellbeing. In: 2018 Conference in Medicine and Biology Society (EMBC), pp. 5131–5134. IEEE (2018)
Amores, J., Maes, P.: Essence: olfactory interfaces for unconscious influence of mood and cognitive performance. In: CHI Conference on Human Factors in Computing Systems, pp. 28–34 (2017)
Barrett and H: https://www.hollandandbarrett.com/
Barwich, A.-S.: Smellosophy: What the Nose tells the Mind. Harvard Press (2020)
Belkin, K., Martin, R., Kemp, S.E., Gilbert, A.N.: Auditory pitch as a perceptual analogue to odor quality. Psychol. Sci. (1997). https://doi.org/10.1111/j.1467-9280.1997.tb00450.x
Bensafi, M., Rouby, C., Farget, V., Bertrand, B., Vigouroux, M., Holley, A.: Autonomic nervous system responses to odours: the role of pleasantness and arousal. Chem. Senses 27(8), 703–709 (2002). https://doi.org/10.1093/chemse/27.8.703
Bonanni, L., Vaucelle, C., Lieberman, J., Zuckerman, O.: TapTap: a haptic wearable for asynchronous distributed touch therapy. CHI’06 Extended Abstracts. pp. 580–585 (2006)
Bornoe, N., Bruun, A., Stage, J.: Facilitating redesign with design cards: experiences with novice designers. In: Australian Conference on Computer-Human Interaction (2016)
Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994). https://doi.org/10.1016/0005-7916(94)90063-9
Brianza, G., Tajadura-Jiménez, A., Maggioni, E., Pittera, D., Bianchi-Berthouze, N., Obrist, M.: As light as your scent: effects of smell and sound on body image perception. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 179–202. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_10
Caon, M., Angelini, L., Abou Khaled, O., Mugellini, E., Matassa, A.: Towards multisensory storming. ACM Conference Companion Publication on Designing Interactive Systems (2018)
Crisinel, A.-S., Spence, C.: A fruity note: crossmodal associations between odors and musical notes. Chem. Senses (2012). https://doi.org/10.1093/chemse/bjr085
Darzentas, D., et al.: Card mapper: enabling data-driven reflections on ideation cards. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2019)
De Groot, J.H., Semin, G.R., Smeets, M.A.: I can see, hear, and smell your fear: comparing olfactory and audiovisual media in fear communication. J. Exp. Psychol. Gen. (2014). https://doi.org/10.1037/a0033731
Delplanque, S., Grandjean, D., Chrea, C., Aymard, L., Cayeux, I., Le Calve, B., et al.: Emotional processing of odors: evidence for a nonlinear relation between pleasantness and familiarity evaluations. Chem. Senses (2008). https://doi.org/10.1093/chemse/bjn014
Dematte, M.L., Sanabria, D., Sugarman, R., Spence, C.: Cross-modal interactions between olfaction and touch. Chem. Senses (2006). https://doi.org/10.1093/chemse/bjj031
Deng, Y., Antle, A.N., Neustaedter, C.: Tango cards: a card-based design tool for informing the design of tangible learning games. In: Proceedings of the 2014 conference on Designing interactive systems, pp. 695–704 (2014)
Distel, H., Ayabe-Kanamura, S., Martínez-Gómez, M., Schicker, I., Kobayakawa, T., Saito, S., et al.: Perception of everyday odors—correlation between intensity, familiarity and strength of hedonic judgement. Chem. Senses (1999). https://doi.org/10.1093/chemse/24.2.191
Dmitrenko, D., Maggioni, E., Brianza, G., Holthausen, B.E., Walker, B.N., Obrist, M.: Caroma therapy: pleasant scents promote safer driving, better mood, and improved well-being in angry drivers. In: CHI Conference on Human Factors in Computing Systems (2020)
Ehrlichman, H., Bastone, L.: Olfaction and emotion. In: Serby, M.J., Chobor, K.L. (eds.) Science of olfaction, pp. 410–438. Springer New York, New York, NY (1992). https://doi.org/10.1007/978-1-4612-2836-3_15
Engen, T., Ross, B.M.: Long-term memory of odors with and without verbal descriptions. J. Exp. Psychol. (1973). https://doi.org/10.1037/h0035492
Ferrara, M.: Smart Experience in Fashion Design: A Speculative Analysis of Smart Material Systems Applications. Multidisciplinary Digital Publishing Institute, Arts (2019)
Halskov, K., Dalsgård, P.: Inspiration card workshops. Conference on Designing Interactive Systems (2006)
Hanson-Vaux, G., Crisinel, A.-S., Spence, C.: Smelling shapes: crossmodal correspondences between odors and shapes. Chem. Senses (2013). https://doi.org/10.1093/chemse/bjs087
Herz, R.S., Cupchik, G.C.: The emotional distinctiveness of odor-evoked memories. Chem. Senses (1995). https://doi.org/10.1093/chemse/20.5.517
Hornecker, E.: Creative idea exploration within the structure of a guiding framework: the card brainstorming game. In: Conference on Tangible, embedded, and embodied interaction, pp. 101–8 (2010)
Jezler, O., Gatti, E., Gilardi, M., Obrist, M.: Scented material: changing features of physical creations based on odors. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1677–1683 (2016)
Kaeppler, K.: Crossmodal associations between olfaction and vision: color and shape visualizations of odors. Chemosens. Percept. 11(2), 95–111 (2018). https://doi.org/10.1007/s12078-018-9245-y
Keller, A.: Attention and olfactory consciousness. Front. Psychol. (2011). https://doi.org/10.3389/fpsyg.2011.00380
Kilteni, K., Normand, J.-M., Sanchez-Vives, M.V., Slater, M.: Extending body space in immersive virtual reality: a very long arm illusion. PLoS ONE (2012). https://doi.org/10.1371/journal.pone.0040867
Kortum P. HCI beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces. Elsevier (2008)
Krishna, A., Elder, R.S., Caldara, C.: Feminine to smell but masculine to touch? Multisensory congruence and its effect on the aesthetic experience. J. Consum. Psychol. (2010). https://doi.org/10.1016/j.jcps.2010.06.010
Lee, J.: Design for all 5 senses. TED Talk (2013)
Lucero, A., Arrasvuori, J.: PLEX Cards: a source of inspiration when designing for playfulness. In: International Conference on Fun and Games, pp. 28–37 (2010)
Maggioni, E., Cobden, R., Dmitrenko, D., Hornbæk, K., Obrist, M.: SMELL SPACE: mapping out the olfactory design space for novel interactions. ACM Trans. Comput.-Hum. Interact. (2020). https://doi.org/10.1145/3402449
Metatla, O., Maggioni, E., Cullen, C., Obrist, M.: “Like Popcorn" crossmodal correspondences between scents, 3D shapes and emotions in children. In: CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2019)
Motomura, N., Sakurai, A., Yotsuya, Y.: Reduction of mental stress with lavender odorant. Percept. Mot. Skills (2001). https://doi.org/10.2466/pms.2001.93.3.713
Mueller, F., Gibbs, M.R., Vetere, F., Edge, D.: Supporting the creative game design process with exertion cards. In: Conference on Human Factors in Computing Systems, pp. 2211–2220 (2014)
Nordin, S., Brämerson, A., Murphy, C., Bende, M.: A Scandinavian adaptation of the Multi-Clinic Smell and Taste Questionnaire: evaluation of questions about olfaction. Acta Otolaryngol. (2003). https://doi.org/10.1080/00016480310001411
Obrist, M., Ranasinghe, N., Spence, C.: Multisensory human–computer interaction. Int. J. Hum Comput Stud. (2017). https://doi.org/10.1016/j.ijhcs.2017.06.002
Obrist, M., Tuch, A.N., Hornbaek, K.: Opportunities for odor: experiences with smell and implications for technology. In: Conference on Human Factors in Computing Systems, pp. 2843–2852 (2014)
Porter, J., Craven, B., Khan, R.M., Chang, S.-J., Kang, I., Judkewitz, B., et al.: Mechanisms of scent-tracking in humans. Nat. Neurosci. (2007). https://doi.org/10.1038/nn1819
Rinaldi, L., Maggioni, E., Olivero, N., Maravita, A., Girelli, L.: Smelling the space around us: odor pleasantness shifts visuospatial attention in humans. Emotion (2018). https://doi.org/10.1037/emo0000335
Root, E., Heuten, W., Boll, S.: Maker Cards: Evaluating design cards for teaching physical computing to middle-school girls. Proc. Mensch Comput. 2019, 493–497 (2019)
Royet, J.-P., Koenig, O., Gregoire, M.-C., Cinotti, L., Lavenne, F., Bars, D.L., et al.: Functional anatomy of perceptual and semantic processing for odors. J. Cogn. Neurosci. (1999). https://doi.org/10.1162/089892999563166
Schifferstein, H.N.: Multi sensory design. In: Procedings of the Second Conference on Creativity and Innovation in Design, pp. 361–362 (2011)
Schifferstein, H.N.: The perceived importance of sensory modalities in product usage: a study of self-reports. Acta Physiol. (Oxf) (2006). https://doi.org/10.1016/j.actpsy.2005.06.004
Shepherd, G.M.: The human sense of smell: are we better than we think? PLoS Biol. (2004). https://doi.org/10.1371/journal.pbio.0020146
Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures. CRC Press (2000)
Shukla, A.: The Kiki-Bouba paradigm: where senses meet and greet. Indian J. Mental Health (2016). https://doi.org/10.30877/IJMH.3.3.2016.240-252.
Spence, C., Parise, C.V.: The cognitive neuroscience of crossmodal correspondences. i-Perception (2012). https://doi.org/10.1068/i0540ic.
Stevenson, R.J., Rich, A., Russell, A.: The nature and origin of cross-modal associations to odours. Perception (2012). https://doi.org/10.1068/p7223
Sulmont, C., Issanchou, S., Köster, E.: Selection of odorants for memory tests on the basis of familiarity, perceived complexity, pleasantness, similarity and identification. Chem. Senses 27(4), 307–317 (2002). https://doi.org/10.1093/chemse/27.4.307
Trimmer, C., Mainland, J.: The Olfactory System. Conn's Translational Neuroscience. Elsevier (2017)
Van Doorn, G., Woods, A., Levitan, C.A., Wan, X., Velasco, C., Bernal-Torres, C., et al.: Does the shape of a cup influence coffee taste expectations? a cross-cultural, online study. Food Qual. Prefer. (2017). https://doi.org/10.1016/j.foodqual.2016.10.013
Von Hornbostel, E.M.: The unity of the senses. Psyche (1927)
von Radziewsky, L., Krüger, A., Löchtefeld, M.: Scarfy: augmenting human fashion behaviour with self-actuated clothes. Conference on Tangible, Embedded, and Embodied Interaction, pp. 313–316 (2015)
Wang, Y., Amores, J., Maes, P.: On-face olfactory interfaces. In: CHI Conference on Human Factors in Computing System, pp. 1–9 (2020)
Warrenburg, S.: Effects of fragrance on emotions: moods and physiology. Chem. Senses (2005). https://doi.org/10.1093/chemse/bjh208
Windlin, C., Ståhl, A., Sanches, P., Tsaknaki, V., Karpashevich, P., Balaam, M., et al. Soma bits-mediating technology to orchestrate bodily experiences. In: RTD 2019-Research through Design Conference 2019, the Science Centre, Delft, on 19th to 22nd March 2019 (2019)
Wnuk, E., De Valk, J.M., Huisman, J.L., Majid, A.: Hot and cold smells: odor-temperature associations across cultures. Front. Psychol. (2017). https://doi.org/10.3389/fpsyg.2017.01373
Wölfel, C., Merritt, T.: Method card design dimensions: a survey of card-based design tools. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8117, pp. 479–486. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40483-2_34
Wright, P., Wallace, J., McCarthy, J.: Aesthetics and experience-centered design. ACM Trans. Comput.-Hum. Interact. (2008). https://doi.org/10.1145/1460355.1460360
Acknowledgments
This work was supported by the European Research Council - ERC (grant number 638605). We would like to thank the participants and designers who took part in our research. Special thanks go to Dr Emeline Brule and Jesse Jesse Benjamin for providing valuable feedback on early drafts of our paper, and Rhiannon Armitage for the voice-over on our video.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary file2 (MP4 126134 kb)
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Brianza, G., Cornelio, P., Maggioni, E., Obrist, M. (2021). Sniff Before You Act: Exploration of Scent-Feature Associations for Designing Future Interactions. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12933. Springer, Cham. https://doi.org/10.1007/978-3-030-85616-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-85616-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85615-1
Online ISBN: 978-3-030-85616-8
eBook Packages: Computer ScienceComputer Science (R0)