Abstract
Image-based 3D model reconstruction method can use the same multi-view image sequence of the object for the generation of both the geometry model and texture map. Texture is very critical for virtual exhibition of 3D model and should be of high quality comparable to the geometry data. One problem is that the object surface may exhibit specular reflection of illuminated light. The texture extracted directly from the images can be unnatural. We propose a method for the removal of specular reflection component in each image. Each camera view is calibrated and a 3D mesh model of the object is generated. For each triangle patch, the projected colors on all visible views are found. The specular chromaticity is replaced by the corresponding diffuse chromaticity. We test the method on image sequences of synthetic and real objects. The diffuse image sequence can be used to generate the texture map.
Chapter PDF
Similar content being viewed by others
References
Pavlidis, G., Koutsoudis, A., Arnaoutoglou, F., Tsioukas, V., Chamzas, C.: Methods for 3D digitization of cultural heritage. Journal of Cultural Heritage 8, 93–98 (2007)
Blais, F., Beraldin, J.-A.: Recent developments in 3D multi-modal laser imaging applied to cultural heritage. Machine Vision and Applications 17, 395–409 (2006)
Klinker, G.J., Shafer, S.A., Kanade, T.: The measurement of highlights in color images. International Journal of Computer Vision 2(1), 7–32 (1990)
Shafer, S.: Using color to separate reflection components. Color Research and Applications 10, 210–218 (1985)
Tan, P., Lin, S., Quan, L., Shum, H.-Y.: Highlight removal by illuminant-constrained inpainting. In: Proceedings of IEEE International Conference on Computer Vision, pp. 164–169 (2003)
Tan, P., Lin, S., Quan, L.: Separation of highlight reflections on textured surfaces. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1855–1860 (2006)
Tan, R.T., Ikeuchi, K.: Separating reflection components of textured surfaces using a single image. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(2), 178–193 (2005)
Lin, S., Shum, H.-Y.: Separation of diffuse and specular reflection in color images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 341–346 (2001)
Lin, S., Li, Y., Kang, S.B., Tong, X., Shum, H.-Y.: Diffuse-specular separation and depth recovery from image sequences. In: Proceedings of European Conference on Computer Vision, pp. 210–224 (2002)
Mallick, S.P., Zickler, T., Belhumeur, P.N., Kriegman, D.J.: Specularity removal in images and videos: a pde approach. In: Proceedings of European Conference on Computer Vision, Part I, pp. 550–563 (2006)
Yu, T., Xu, N., Ahuja, N.: Shape and view independent reflectance map from multiple views. International Journal of Computer Vision 73(2), 123–138 (2007)
Criminisi, A., Kang, S.B., Swaminathan, R., Szeliski, R., Anandan, P.: Extracting layers and analyzing their specular properties using epipolar-plane-image analysis. Computer Vision and Image Understanding 97, 51–85 (2005)
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. Journal of Robotics and Automation RA-3(4), 323–344 (1987)
Matsumoto, Y., Fujimura, K., Kitamura, T.: Shape-from-silhouette/stereo and its application to 3-D digitizer. In: Proceedings of Discrete Geometry for Computing Imagery, pp. 177–188 (1999)
Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. Computer Graphics 21(4), 163–169 (1987)
Tan, R.T., Nishino, K., Ikeuchi, K.: Color constancy through inverse-intensity chromaticity space. Journal of Optical Society of America A 21(3), 321–334 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chow, SK., Chan, KL. (2009). Removal of Specular Reflection Component Using Multi-view Images and 3D Object Model. In: Wada, T., Huang, F., Lin, S. (eds) Advances in Image and Video Technology. PSIVT 2009. Lecture Notes in Computer Science, vol 5414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92957-4_87
Download citation
DOI: https://doi.org/10.1007/978-3-540-92957-4_87
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92956-7
Online ISBN: 978-3-540-92957-4
eBook Packages: Computer ScienceComputer Science (R0)