Abstract
Hyper- and multispectral imaging allows to collect data from specific wavelength ranges or across the electromagnetic spectrum, including frequencies that are imperceivable for humans. As non-invasive imaging techniques, it has been used in the field of art conservation and art history extensively in the past. In these areas application of hyperspectral imaging include for example conservation monitoring or pigment identification. In the context of museum exhibits, hyperspectral data of artworks offers a unique opportunity to enhance visitor experiences by providing new ways of engaging with artefacts, artworks, and cultural heritage. This paper presents design concepts for creating immersive and meaningful experiences using hyperspectral data. We used an expert led design workshop to explore the possibilities of museum experiences with such data, including considerations such as suited technologies, visitor types and visitor experience.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aslaksby, T.: Edvard munch’s painting the scream (1893): notes on technique, materials and condition. In: Public Paintings by Edvard Munch and His Contemporaries: Change and Conservation Challenges, pp. 52–71 (2015)
Balas, C., Papadakis, V., Papadakis, N., Papadakis, A., Vazgiouraki, E., Themelis, G.: A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value. J. Cult. Heritage 4, 330–337 (2003)
Bekele, M.K., Pierdicca, R., Frontoni, E., Malinverni, E.S., Gain, J.: A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Herit. (JOCCH) 11(2), 1–36 (2018)
Asperen de Boer, J.V.: Reflectography of paintings using an infrared vidicon television system. Stud. Conserv. 14(3), 96–118 (1969)
Chen, A., Jesus, R., Vilarigues, M.: Hyperspectral image reconstruction of heritage artwork using RGB images and deep neural networks. In: CBMI 2022, New York, NY, USA, pp. 97–102. Association for Computing Machinery (2022). https://doi.org/10.1145/3549555.3549583
Deborah, H., George, S., Hardeberg, J.Y.: Pigment mapping of the scream (1893) based on hyperspectral imaging. In: Image and Signal Processing: 6th International Conference, ICISP 2014, Cherbourg, France, June 30-July 2, 2014. Proceedings 6. pp. 247–256. Springer (2014)
Deborah, H., George, S., Hardeberg, J.Y.: Spectral-divergence based pigment discrimination and mapping: A case study on the scream (1893) by Edvard munch. J. Am. Inst. Conserv. 58(1–2), 90–107 (2019)
Deborah, H., Richard, N., Hardeberg, J.Y.: Hyperspectral crack detection in paintings. In: 2015 Colour and Visual Computing Symposium (CVCS), pp. 1–6. IEEE (2015)
Falk, J.H.: Identity and the Museum Visitor Experience. Routledge, London (2016)
Garside, D., Curran, K., Korenberg, C., MacDonald, L., Teunissen, K., Robson, S.: How is museum lighting selected? An insight into current practice in UK museums. J. Inst. Conserv. 40(1), 3–14 (2017)
Goel, M., et al.: Hypercam: hyperspectral imaging for ubiquitous computing applications. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. UbiComp 2015, New York, NY, USA, pp. 145–156. Association for Computing Machinery (2015). https://doi.org/10.1145/2750858.2804282
Hardeberg, J., George, S., Deger, F., Baarstad, I., Palacios, J.: Spectral scream: hyperspectral image acquisition and analysis of a masterpiece. In: Frøysaker, T., Streeton, N., Kutzke, H., Hanssen-Bauer, F., Topalova-Casadiego, B. (eds.) Public Paintings by Edvard Munch and His Contemporaries: Change and Conservation Challenges (2015)
Hu, H., Huang, Q., Zhang, Q.: Babynutri: a cost-effective baby food macronutrients analyzer based on spectral reconstruction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7(1) (2023). https://doi.org/10.1145/3580858
Huang, S.Y., Mukundan, A., Tsao, Y.M., Kim, Y., Lin, F.C., Wang, H.C.: Recent advances in counterfeit art, document, photo, hologram, and currency detection using hyperspectral imaging. Sensors 22(19), 7308 (2022)
Jiang, W., et al.: Probing sucrose contents in everyday drinks using miniaturized near-infrared spectroscopy scanners. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3(4) (2020). https://doi.org/10.1145/3369834
Jiang, W., , Kostakos, V.: User trust in assisted decision-making using miniaturized near-infrared spectroscopy. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. CHI 2021, Association for Computing Machinery (2021). https://doi.org/10.1145/3411764.3445710
Khan, M.J., Khan, H.S., Yousaf, A., Khurshid, K., Abbas, A.: Modern trends in hyperspectral image analysis: a review. IEEE Access 6, 14118–14129 (2018)
Land, E.H., McCann, J.J.: Lightness and retinex theory. JOSA 61(1), 1–11 (1971)
Liang, H.: Advances in multispectral and hyperspectral imaging for archaeology and art conservation. Appl. Phys. A 106, 309–323 (2012)
Magnusson, M., Sigurdsson, J., Armansson, S.E., Ulfarsson, M.O., Deborah, H., Sveinsson, J.R.: Creating RGB images from hyperspectral images using a color matching function. In: IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, pp. 2045–2048. IEEE (2020)
Picollo, M., Cucci, C., Casini, A., Stefani, L.: Hyper-spectral imaging technique in the cultural heritage field: new possible scenarios. Sensors 20(10), 2843 (2020)
Sharma, A., Misra, A., Subramaniam, V., Lee, Y.: SmrtFridge: IoT-based, user interaction-driven food item & quantity sensing. In: Proceedings of the 17th Conference on Embedded Networked Sensor Systems, pp. 245–257 (2019)
Yeo, H.S., Lee, J., Bianchi, A., Harris-Birtill, D., Quigley, A.: Specam: sensing surface color and material with the front-facing camera of a mobile device. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. MobileHCI 2017, New York, NY, USA. Association for Computing Machinery (2017). https://doi.org/10.1145/3098279.3098541
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Löchtefeld, M., Papachristos, E., Deborah, H. (2023). Museum Visitor Experiences Based on Hyperspectral Image Data. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14143. Springer, Cham. https://doi.org/10.1007/978-3-031-42283-6_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-42283-6_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42282-9
Online ISBN: 978-3-031-42283-6
eBook Packages: Computer ScienceComputer Science (R0)