A new pixel-wise data processing method for reflectance transformation imaging
Authors: 
Yuly Castro, Gaëtan Le Goïc, Hermine Chatoux, Livio De Luca, Alamin MansouriAuthors Info & Claims
Abstract
Reflectance transformation imaging (RTI) is one of the most widely used techniques in order to digitize and analyze material appearance of a surface, finding a great level of utility and applicability in the field of cultural heritage as well as in industrial applications. To date, most of the methods used to process (model and relight) RTI data assume only one light direction for all pixels as well as a single light source-surface distance for the entire image, following the model of a very distant (far) light source. This assumption does not hold in practice. Indeed, the light sources commonly used in RTI acquisitions (spotlight/photo flash) induce to a non-uniform illumination of the surface. This is caused by the variation of incidence angles and per-point distances which directly affect the amount of light received by the surface. We propose a novel pixel-wise methodology for improving lighting based on illumination laws that allows one to correct both loss of energy due to the distance variation as well as the elevation angle. We show the efficiency of the proposed method on RTI acquisitions performed on cultural heritage objects and a manufactured surface. We show that our method corrects the effects of non-uniform illumination and leads to improve the relighting commonly associated with RTI.
References
[1]
Dulecha TG, Fanni FA, Ponchio F, Pellacini F, and Giachetti A Neural reflectance transformation imaging Vis. Comput. 2020 36 10 2161-2174
[2]
Pintus, R., Dulecha, T.G., Ciortan, I., Gobbetti, E., Giachetti, A.: State-of-the-art in multi-light image collections for surface visualization and analysis. In: Computer Graphics Forum 2019. The Eurographics Association and John, Department of Computer Science, University of Verona, Italy; Norwegian University of Science and Technology, Department of Computer Science, Norway, p. 3 (2019)
[3]
Woodham RJ Photometric method for determining surface orientation from multiple images Opt. Eng. 1980 19 1 139-144
[4]
Einarsson, P., Hawkins, T., Debevec, P.: Photometric stereo for archeological inscriptions. In: ACM SIGGRAPH Sketches, p. 81 (2004)
[5]
Ikeuchi K Determining surface orientation of specular surfaces by using the photometric stereo method IEEE Trans. Pattern Anal. Mach. Intell. 1981
[6]
Rabascall, I.: Uncalibrated photometric stereo for 3 d surface texture recovery (2003)
[7]
Malzbender, T., Gelb, D., Wolters, H.: Polynomial texture maps. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 519–528 (2001)
[8]
Earl, G., Basford, P., Bischoff, A., Bowman, A., Crowther, C., Dahl, J., Hodgson, M., Isaksen, L., Kotoula, E., Martinez, K., et al.: Reflectance transformation imaging systems for ancient documentary artefacts. In: Electronic Visualisation and the Arts (EVA), pp. 147–154 (2011)
[9]
MacDonald, L.: Visual realism in digital heritage. In: Heritage Preservation (2018)
[10]
Mudge, M., Malzbender, T., Schroer, C., Lum, M.: New reflection transformation imaging methods for rock art and multiple-viewpoint display. In: Ioannides, M., Arnold, D., Niccolucci, F., Mania, K. (eds.) The 7th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, Vast. pp. 195–202 (2006)
[11]
Nurit M, Le Goïc G, Lewis D, Castro Y, Zendagui A, Chatoux H, Favrelière H, Maniglier S, Jochum P, and Mansouri A HD-RTI: an adaptive multi-light imaging approach for the quality assessment of manufactured surfaces Comput. Ind. 2021 132 103500
[12]
Pitard G, Le Goic G, Mansouri A, Favreliere H, Désage SF, Samper S, and Pillet M Discrete modal decomposition: a new approach for the reflectance modeling and rendering of real surfaces Mach. Vis. Appl. 2017 28 607-621
[13]
Kurt M survey of BSDF measurements and representations J. Sci. Eng. 2018 20 58 87-102
[14]
Kurt M and Edwards D A survey of BRDF models for computer graphics ACM SIGGRAPH Comput. Graph. 2009 43 2 1-7
[15]
Tongbuasirilai T, Unger J, Kronander J, and Kurt M Compact and intuitive data-driven BRDF models Vis. Comput. 2020 36 855-872
[16]
Gautron, P., Krivanek, J., Pattanaik, S.N., Bouatouch, K.: A novel hemispherical basis for accurate and efficient rendering. In: Rendering Techniques, pp 321–330 (2004)
[17]
Lam PM, Leung CS, and Wong TT Noise-resistant hemispherical basis for image-based relighting IET Image Process. 2012 6 72-86
[18]
Tunwattanapong B, Fyffe G, Graham P, Busch J, Yu X, Ghosh A, and Debevec P Acquiring reflectance and shape from continuous spherical harmonic illumination ACM Trans. Graph. (TOG) 2013 32 1-12
[19]
Ponchio, F., Corsini, M., Scopigno, R.: A compact representation of relightable images for the web. In: Proceedings of the 23rd International ACM Conference on 3D Web Technology, pp. 1–10 (2022)
[20]
Pamart A, Ponchio F, Abergel V, M’Darhri A, Corsini M, Dellepiane M, Morlet F, Scopigno R, and Luca L A complete framework operating spatially-oriented RTI in a 3D/2D cultural heritage documentation and analysis tool ISPRS Int Arch Photogram Remote Sens Spat Inf Sci 2019 XLII-2/W9 573-580
[21]
Masselus, V., Dutré, P., Anrys, F.: The free-form light stage. In: ACM SIGGRAPH 2002 Conference Abstracts and Applications, pp. 262–262 (2022)
[22]
Luxman R, Castro YE, Chatoux H, Nurit M, Siatou A, LeGoïc G, Brambilla L, Degrigny C, Marzani F, and Mansouri A LightBot: a multi-light position robotic acquisition system for adaptive capturing of cultural heritage surfaces J. Imaging 2022 8 134
[23]
Kratky V, Petracek P, Spurny V, and Saska M Autonomous reflectance transformation imaging by a team of unmanned aerial vehicles IEEE Robot. Autom. Lett. 2020 5 2 2302-2309
[24]
Iwahori, Y., Sugie, H., Ishii, N. : Reconstructing shape from shading images under point light source illumination. In: Proceedings. 10th International Conference on Pattern Recognition, vol. 1, pp. 83–87. IEEE (1990)
[25]
Quéau Y, Durix B, Wu T, Cremers D, Lauze F, and Durou JD Led-based photometric stereo: modeling, calibration and numerical solution J. Math. Imaging Vis. 2018 60 3 313-340
[26]
Santo, H., Waechter, M., Matsushita, Y.: Deep near-light photometric stereo for spatially varying reflectances. In: European Conference on Computer Vision. Springer, Cham, pp. 137–152 (2018)
[27]
Winnemoeller H, Mohan A, and Tumblin J Light waving: estimating light positions from photographs alone Comput. Graph. Forum 2005 24 433-438
[28]
Walton, M., Cossairt, O., Huang, X., Bearman, G.: Near light correction for image relighting and 3d shape recovery. (2015)
[29]
Giachetti A, Ciortan IM, Daffara C, Marchioro G, Pintus R, and Gobbetti E A novel framework for highlight reflectance transformation imaging Comput. Vis. Image Underst. 2018 168 118-131
[30]
McGuigan, M., Christmas J.: Automating RTI: Automatic light direction detection and correcting non-uniform lighting for more accurate surface normal. In: Computer Vision and Image Understanding, University of Exeter, Exeter, EX4 4QF, UK. p. 102880 (2020)
[31]
Castro Y, Nurit M, Pitard G, Zendagui A, Le Goïc G, Brost V, Boucher A, Mansouri A, Pamart A, and De Luca L Calibration of spatial distribution of light sources in reflectance transformation imaging based on adaptive local density estimation J. Electron. Imaging 2020 29 4 041004-041004
[32]
Pitard, G., Le Goïc, G., Mansouri, A., Favrelière, H., Pillet, M., George, S., Hardeberg, J.Y.: Reflectance-based surface saliency. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 445–449. IEEE (2017)
[33]
Nurit, M., Le Goïc, G., Maniglier, S., Jochum, P., Chatoux, H., Mansouri, A.: Improved visual saliency estimation on manufactured surfaces using high-dynamic reflectance transformation imaging. In: Fifteenth International Conference on Quality Control by Artificial Vision, vol. 11794, pp. 111–121. SPIE (2021)
Index Terms
- A new pixel-wise data processing method for reflectance transformation imaging
Index terms have been assigned to the content through auto-classification.
Recommendations
Neural reflectance transformation imaging
AbstractReflectance transformation imaging (RTI) is a computational photography technique widely used in the cultural heritage and material science domains to characterize relieved surfaces. It basically consists of capturing multiple images from a fixed ...
On-the-Go Reflectance Transformation Imaging with Ordinary Smartphones
Computer Vision – ECCV 2022 WorkshopsAbstractReflectance Transformation Imaging (RTI) is a popular technique that allows the recovery of per-pixel reflectance information by capturing an object under different light conditions. This can be later used to reveal surface details and ...
Reflectance transformation imaging and ImageJ: comparing imaging methodologies for cultural heritage artefacts
EVA '17: Proceedings of the conference on Electronic Visualisation and the ArtsThe imaging of cultural heritage sites and artefacts is now a highly technical process with many tools and methodological approaches available to archaeologists, architects, museum curators and artefact conservators. Imaging studies at the Australian ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 13 October 2023
Accepted: 25 August 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in