Abstract
Humans are dependent on their sensory perception being built upon their classical senses. Accordingly, researchers have been envisioning for decades to augment and enhance the existing spectrum of human senses by technological means. In this chapter, we will give an overview of scientific work that has been occupied with augmenting human senses to facilitate or enhance our capabilities. Further, we will present three exemplary applications extending the powers of the visual, auditory, and tactile senses following a threefold evaluation concept.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Even if sometimes the five classical senses are called Aristotelian senses, Aristotle defined in De Sensu et Sensibilibus only four senses, describing the taste as a form of touch. However, by the eleventh century, multiple sources started counting the senses as five (Anderson 2003).
- 2.
References
Abdelrahman Y, Wozniak P, Knierim P, Henze N, Schmidt A (2018) Exploration of alternative vision modes using depth and thermal cameras. In: Proceedings of the 17th international conference on mobile and ubiquitous multimedia, MUM 2018. ACM, New York, NY, USA, pp 245–252. ISBN 978-1-4503-6594-9. https://doi.org/10.1145/3282894.3282920
Anderson ER (2003)
Bächlin M, Förster K, Tröster G (2009) Swimmaster: a wearable assistant for swimmer. In: Proceedings of the 11th international conference on ubiquitous computing, UbiComp’09. ACM, New York, NY, USA, pp 215–224. ISBN 978-1-60558-431-7. https://doi.org/10.1145/1620545.1620578
Bangor A, Kortum PT, Miller JT (2008) 24(6):574–594. doi: 10.1080/10447310802205776
Bawden D, Robinson L (2009) J Inf Sci 35(2):180–191. ISSN 0165-5515. https://doi.org/10.1177/0165551508095781
Bray DA (2008) Information pollution, knowledge overload, limited attention spans, and our responsibilities as is professionals. In: Global Information Technology Management Association (GITMA) World Conference-June
Burke JL, Prewett MS, Gray AA, Yang L, Stilson FRB, Coovert MD, Elliot LR, Redden E (2006) Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In: Proceedings of the 8th international conference on multimodal interfaces, ICMI’06. ACM, New York, NY, USA, pp 108–117. ISBN 1-59593-541-X. https://doi.org/10.1145/1180995.1181017
Chiras DD (2013) Human biology. Jones and Bartlett Publishers
Conway AR, Cowan N, Bunting MF (2001) Psychon Bull Rev 8(2), 331–335
Ekuni S, Murata K, Asakura Y, Uehara A (2016). Bionic scope: wearable system for visual extension triggered by bioelectrical signal. In: ACM SIGGRAPH 2016 Posters, SIGGRAPH’16. ACM, New York, NY, USA, pp 41:1–41:1. ISBN 978-1-4503-4371-8. https://doi.org/10.1145/2945078.2945119
Fan K, Seigneur J-M, Nanayakkara S, Inami M (2016) Electrosmog visualization through augmented blurry vision. In: Proceedings of the 7th augmented human international conference 2016, AH’16. ACM, New York, NY, USA, pp 35:1–35:2. ISBN 978-1-4503-3680-2. https://doi.org/10.1145/2875194.2875203
Firouzian A, Kashimoto Y, Asghar Z, Keranen N, Yamamoto G, Pulli P (2017). Twinkle megane: Near-eye led indicators on glasses for simple and smart navigation in daily life. In: Giokas K, Bokor L, Hopfgartner F, (eds) eHealth 360. Springer International Publishing, pp 17–22. ISBN 978-3-319-49655-9
Förster K, Bächlin M, Tröster G (2009) Non-interrupting user interfaces for electronic body-worn swim devices. In: Proceedings of the 2nd international conference on pervasive technologies related to assistive environments, PETRA’09. ACM, New York, NY, USA, pp 38:1–38:4. ISBN 978-1-60558-409-6. https://doi.org/10.1145/1579114.1579152
Goldstein EB (2010) Sensation and perception, 8th edn. Thomson Wadsworth. ISBN 978-0-495-60149-4
Grönvall E, Fritsch J, Vallgårda A (2016) Feltradio: sensing and making sense of wireless traffic. In: Proceedings of the 2016 ACM conference on designing interactive systems, DIS’16. ACM, New York, NY, USA, pp 829–840. ISBN 978-1-4503-4031-1. https://doi.org/10.1145/2901790.2901818
Heller MA (2013) The psychology of touch. Psychology Press
Jeffress LA (1948) 41(1):35
Kasahara S, Ando M, Suganuma K, Rekimoto J (2016) Parallel eyes: exploring human capability and behaviors with paralleled first person view sharing. In: Proceedings of the 2016 CHI conference on human factors in computing systems, CHI’16. ACM, New York, NY, USA, pp 1561–1572. ISBN 978-1-4503-3362-7. https://doi.org/10.1145/2858036.2858495
Kaufman L (1974) Sight and mind: an introduction to visual perception. Oxford University Press
Knaving K, Wozniak P, Fjeld M, Björk S (2015) Flow is not enough: understanding the needs of advanced amateur runners to design motivation technology. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, CHI’15. ACM, New York, NY, USA, pp 1561–1562. ISBN 978-1-4503-3145-6. https://doi.org/10.1145/2702123.2702542
Lee W, Lim Y-K (2010) Thermo-message: exploring the potential of heat as a modality of peripheral expression. In: CHI’10 extended abstracts on human factors in computing systems, CHI EA’10. ACM, New York, NY, USA, pp 4231–4236. ISBN 978-1-60558-930-5. https://doi.org/10.1145/1753846.1754131
Li J, Wang Y, Liu L, Xu S, Liu Y, Leng J, Cai S (2019) 0(0):1903762. https://doi.org/10.1002/adfm.201903762
Moray N (1959) Q J Exp Psychol 11(1), 56–60
Niforatos E, Fedosov A, Elhart I, Langheinrich M (2017) Augmenting skiers’ peripheral perception. In: Proceedings of the 2017 ACM international symposium on wearable computers, ISWC’17. ACM, New York, NY, USA, pp 114–121. ISBN 978-1-4503-5188-1. https://doi.org/10.1145/3123021.3123052
Novak J (1983) pp 345–349
Pavlov IP, Gantt WH (1941) Conditioned reflexes and psychiatry, vol 2. International Publishers, New York
Poguntke R, Kiss F, Kaplan A, Schmidt A, Schneegass S (2018) Rainsense: exploring the concept of a sense for weather awareness. In: Proceedings of the 20th international conference on human-computer interaction with mobile devices and services adjunct, MobileHCI’18. ACM, New York, NY, USA, pp 9–15. ISBN 978-1-4503-5941-2. https://doi.org/10.1145/3236112.3236114.
Poppinga B, Henze N, Fortmann J, Heuten W, Boll S (2012)
Psychountaki M, Zervas Y (2000) 91(1):87–94. https://doi.org/10.2466/pms.2000.91.1.87 PMID:11011876
Russell MJ (1976) 260(5551):520
Schaal B (1988) 13(2):145–190
Schmidt A (2017) 16(01):6–10. ISSN 1536-1268. https://doi.org/10.1109/MPRV.2017.8
Schmidt A, Schneegass S, Kunze K, Rekimoto J, Woo W (2017) Workshop on amplification and augmentation of human perception. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, CHI EA’17. ACM, New York, NY, USA, pp 668–673. ISBN 978-1-4503-4656-6. https://doi.org/10.1145/3027063.3027088
Schoop E, Smith J, Hartmann B (2018) Hindsight: enhancing spatial awareness by sonifying detected objects in real-time 360-degree video. In: Proceedings of the 2018 CHI conference on human factors in computing systems, CHI’18. ACM, New York, NY, USA, pp 143:1–143:12. ISBN 978-1-4503-5620-6. https://doi.org/10.1145/3173574.3173717
Sines G, Sakellarakis YA (1987) 91(2):191–196. ISSN 00029114, 1939828X. http://www.jstor.org/stable/505216
Tholander J, Nylander S (2015) Snot, sweat, pain, mud, and snow: performance and experience in the use of sports watches. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 2913–2922
Tseng H-Y, Liang R-H, Chan L, Chen B-Y (2015a) Lead: utilizing light movement as peripheral visual guidance for scooter navigation. In: Proceedings of the 17th international conference on human-computer interaction with mobile devices and services, MobileHCI’15. ACM, New York, NY, USA, pp 323–326. ISBN 978-1-4503-3652-9. https://doi.org/10.1145/2785830.2785831
Tseng H-Y, Liang R-H, Chan L, Chen B-Y (2015b) Using point-light movement as peripheral visual guidance for scooter navigation. In Proceedings of the 6th augmented human international conference, AH’15. ACM, New York, NY, USA, pp 177–178. ISBN 978-1-4503-3349-8. https://doi.org/10.1145/2735711.2735800
Tsukada K, Yasumura M (2004) Activebelt: Belt-type wearable tactile display for directional navigation. In: International conference on ubiquitous computing. Springer, pp 384–399
van Veen T, Karjanto J, Terken J (2017) Situation awareness in automated vehicles through proximal peripheral light signals. In: Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications, AutomotiveUI’17. ACM, New York, NY, USA, pp 287–292. ISBN 978-1-4503-5150-8. https://doi.org/10.1145/3122986.3122993.
Vavoula GN, Sharples M (2007) 2(4):393–419. ISSN 1556-1615. https://doi.org/10.1007/s11412-007-9026-0
Verbeek C, van Campen C (2013) 8(2):133–148
Whitton JT, Everall J (1973) British J Dermatol 89(5), 467–476
Wilson G, Halvey M, Brewster SA, Hughes SA (2011) Some like it hot: thermal feedback for mobile devices. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI’11. ACM, New York, NY, USA, pp 2555–2564. ISBN 978-1-4503-0228-9. https://doi.org/10.1145/1978942.1979316
Wilson G, Davidson G, Brewster SA (2015) In the heat of the moment: subjective interpretations of thermal feedback during interaction. In Proceedings of the 33rd annual ACM conference on human factors in computing systems, CHI’15. ACM, New York, NY, USA, pp 2063–2072. ISBN 978-1-4503-3145-6. https://doi.org/10.1145/2702123.2702219
Wilson G, Dobrev D, Brewster SA (2016) Hot under the collar: mapping thermal feedback to dimensional models of emotion. In: Proceedings of the 2016 CHI conference on human factors in computing systems, CHI’16. ACM, New York, NY, USA, pp 4838–4849. ISBN 978-1-4503-3362-7. https://doi.org/10.1145/2858036.2858205.
Wood N, Cowan N (1995) J Exp Psychol Learn Mem Cogn 21(1):255
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kiss, F., Poguntke, R. (2021). Augmented Senses: Evaluating Sensory Enhancement Applications. In: Dingler, T., Niforatos, E. (eds) Technology-Augmented Perception and Cognition. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-30457-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-30457-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30456-0
Online ISBN: 978-3-030-30457-7
eBook Packages: Computer ScienceComputer Science (R0)