Robust Single-Shot Fringe Projection Profilometry Based on Morphological Component Analysis
Pages 5393 - 5405
Abstract
In a fringe projection profilometry (FPP) process, the captured fringe images can be modeled as the superimposition of the projected fringe patterns on the texture of the objects. Extracting the fringe patterns from the captured fringe images is an essential procedure in FPP, but traditional single-shot FPP methods often fail to perform if the objects have a highly textured surface. In this paper, a new single-shot FPP algorithm which allows the object texture and fringe pattern to be estimated simultaneously, is proposed. The heart of the proposed algorithm is an enhanced morphological component analysis (MCA) tailored for FPP problems. Conventional MCA methods which use a uniform threshold in an iterative optimization process are inefficient to separate fringe-like patterns from image texture. We extend the conventional MCA by taking advantage of the low-rank structure of the fringe’s sparse representation to enable an adaptive thresholding process. It ends up with a robust single-shot FPP algorithm that can extract the fringe pattern even if the object has a highly textured surface. The proposed approach has a side benefit that the object texture can be simultaneously obtained in the fringe pattern estimation process, which is useful in many FPP applications. Experimental results have demonstrated the improved performance of the proposed algorithm over the conventional single-shot FPP approaches.
References
[1]
W. W.-L. Ng and D. P.-K. Lun, “ Effective bias removal for fringe projection profilometry using the dual-tree complex wavelet transform,” Appl. Opt., vol. Volume 51, no. Issue 24, pp. 5909–5916, 2012.
[2]
Z. Song, R. Chung, and X.-T. Zhang, “ An accurate and robust strip-edge-based structured light means for shiny surface micromeasurement in 3-D,” IEEE Trans. Ind. Electron., vol. Volume 60, no. Issue 3, pp. 1023–1032, 2013.
[3]
G. Sansoni, S. Corini, S. Lazzari, R. Rodella, and F. Docchio, “ Three-dimensional imaging based on Gray-code light projection: Characterization of the measuring algorithm and development of a measuring system for industrial applications,” Appl. Opt., vol. Volume 36, no. Issue 19, pp. 4463–4472, 1997.
[4]
A. G. Albertazzi, A. C. Hofmann, A. V. Fantin, and J. M. C. Santos, “ Photogrammetric endoscope for measurement of inner cylindrical surfaces using fringe projection,” Appl. Opt., vol. Volume 47, no. Issue 21, pp. 3868–3876, 2008.
[5]
T.-W. Hui and G. K.-H. Pang, “ 3-D measurement of solder paste using two-step phase shift profilometry,” IEEE Trans. Electron. Packag. Manuf., vol. Volume 31, no. Issue 4, pp. 306–315, 2008.
[6]
R. R. Garcia and A. Zakhor, “ Consistent stereo-assisted absolute phase unwrapping methods for structured light systems,” IEEE J. Sel. Topics Signal Process., vol. Volume 6, no. Issue 5, pp. 411–424, 2012.
[7]
F. Sadlo, T. Weyrich, R. Peikert, and M. Gross, “ A practical structured light acquisition system for point-based geometry and texture,” presented at the <conf-name>Eurographics/IEEE VGTC Symp. Point-Based Graphics</conf-name>, 2005.
[8]
Y. Zhang, Z. Xiong, Z. Yang, and F. Wu, “ Real-time scalable depth sensing with hybrid structured light illumination,” IEEE Trans. Image Process., vol. Volume 23, no. Issue 1, pp. 97–109, 2014.
[9]
Y. Wang, K. Liu, Q. Hao, D. L. Lau, and L. G. Hassebrook, “ Period coded phase shifting strategy for real–time 3-D structured light illumination,” IEEE Trans. Image Process., vol. Volume 20, no. Issue 11, pp. 3001–3013, 2011.
[10]
P. Cong, Z. Xiong, Y. Zhang, S. Zhao, and F. Wu, “ Accurate dynamic 3D sensing with Fourier-assisted phase shifting,” IEEE J. Sel. Topics Signal Process., vol. Volume 9, no. Issue 3, pp. 396–408, 2015.
[11]
Y. Wang, K. Liu, Q. Hao, X. Wang, D. L. Lau, and L. G. Hassebrook, “ Robust active stereo vision using Kullback–Leibler divergence,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 34, no. Issue 3, pp. 548–563, 2012.
[12]
S. Zhang and S.-T. Yau, “ High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method,” Opt. Express, vol. Volume 14, no. Issue 7, pp. 2644–2649, 2006.
[13]
T. Petković, T. Pribanić, and M. Đonlić, “ Single-shot dense 3D reconstruction using self-equalizing De Bruijn sequence,” IEEE Trans. Image Process., vol. Volume 25, no. Issue 11, pp. 5131–5144, 2016.
[14]
M. Elad, J.-L. Starck, P. Querre, and D. L. Donoho, “ Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA),” Appl. Comput. Harmon. Anal., vol. Volume 19, no. Issue 3, pp. 340–358, 2005.
[15]
<given-names/>Budianto and D. P. K. Lun, “ Robust fringe projection profilometry via sparse representation,” IEEE Trans. Image Process., vol. Volume 25, no. Issue 4, pp. 1726–1739, 2016.
[16]
W. Lohry and S. Zhang, “ High-speed absolute three-dimensional shape measurement using three binary dithered patterns,” Opt. Express, vol. Volume 22, no. Issue 22, pp. 26752–26762, 2014.
[17]
M. Takeda and K. Mutoh, “ Fourier transform profilometry for the automatic measurement of 3-D object shapes,” Appl. Opt., vol. Volume 22, no. Issue 24, pp. 3977–3982, 1983.
[18]
T.-C. Hsung, D. P.-K. Lun, and W. W. L. Ng, “ Efficient fringe image enhancement based on dual-tree complex wavelet transform,” Appl. Opt., vol. Volume 50, no. Issue 21, pp. 3973–3986, 2011.
[19]
<given-names/>Budianto, D. P. K. Lun, and T.-C. Hsung, “ Marker encoded fringe projection profilometry for efficient 3D model acquisition,” Appl. Opt., vol. Volume 53, no. Issue 31, pp. 7442–7453, 2014.
[20]
W.-H. Su, “ Color-encoded fringe projection for 3D shape measurements,” Opt. Express, vol. Volume 15, no. Issue 20, pp. 13167–13181, 2007.
[21]
<given-names/>Budianto and D. P.-K. Lun, “ Inpainting for fringe projection profilometry based on geometrically guided iterative regularization,” IEEE Trans. Image Process., vol. Volume 24, no. Issue 12, pp. 5531–5542, 2015.
[22]
B. Shi, B. Zhang, F. Liu, J. Luo, and J. Bai, “ 360° Fourier transform profilometry in surface reconstruction for fluorescence molecular tomography,” IEEE J. Biomed. Health Inform., vol. Volume 17, no. Issue 3, pp. 681–689, 2013.
[23]
H. Ha, J. Park, and I. S. Kweon, “ Dense depth and albedo from a single-shot structured light,” in Proc. Int. Conf. 3D Vis. (3DV), Oct. 2015, pp. 127–134.
[24]
H. Guo, “ 3-D shape measurement based on Fourier transform and phase shifting method,” Ph.D. dissertation, <institution content-type=department>Dept. Mech. Eng</institution>., <institution content-type=institution>Stony Brook Univ</institution>., Stony Brook, NY, USA, 2009.
[25]
H. Guo and P. S. Huang, “ 3-D shape measurement by use of a modified Fourier transform method,” Proc. SPIE, vol. Volume 7066, p. pp.70660E, Aug. 2008.
[26]
Q. Kemao, H. Wang, and W. Gao, “ Windowed Fourier transform for fringe pattern analysis: Theoretical analyses,” Appl. Opt., vol. Volume 47, no. Issue 29, pp. 5408–5419, 2008.
[27]
W. Gao, N. T. T. Huyen, H. S. Loi, and Q. Kemao, “ Real-time 2D parallel windowed Fourier transform for fringe pattern analysis using graphics processing unit,” Opt. Express, vol. Volume 17, no. Issue 25, pp. 23147–23152, 2009.
[28]
Z. Zhang and J. Zhong, “ Applicability analysis of wavelet-transform profilometry,” Opt. Express, vol. Volume 21, no. Issue 16, pp. 18777–18796, 2013.
[29]
J. L. Flores, J. A. Ferrari, G. G. Torales, R. Legarda-Saenz, and A. Silva, “ Color-fringe pattern profilometry using a generalized phase-shifting algorithm,” Appl. Opt., vol. Volume 54, no. Issue 30, pp. 8827–8834, 2015.
[30]
S. Ma, R. Zhu, C. Quan, B. Li, C. J. Tay, and L. Chen, “ Blind phase error suppression for color-encoded digital fringe projection profilometry,” Opt. Commun., vol. Volume 285, no. Issue 7, pp. 1662–1668, 2012.
[31]
M. Padilla, M. Servin, and G. Garnica, “ Fourier analysis of RGB fringe-projection profilometry and robust phase-demodulation methods against crosstalk distortion,” Opt. Express, vol. Volume 24, no. Issue 14, pp. 15417–15428, 2016.
[32]
C. Je, S. W. Lee, and R.-H. Park, “ Color-phase analysis for sinusoidal structured light in rapid range imaging,” in Proc. 6th Asian Conf. Comput. Vis. (ACCV), vol. Volume 1, 2004, pp. 270–275.
[33]
J. Bobin, J.-L. Starck, J. M. Fadili, Y. Moudden, and D. L. Donoho, “ Morphological component analysis: An adaptive thresholding strategy,” IEEE Trans. Image Process., vol. Volume 16, no. Issue 11, pp. 2675–2681, 2007.
[34]
J.-L. Starck, M. Elad, and D. L. Donoho, “ Image decomposition via the combination of sparse representations and a variational approach,” IEEE Trans. Image Process., vol. Volume 14, no. Issue 10, pp. 1570–1582, 2005.
[35]
J. Bobin, Y. Moudden, J. L. Starck, and M. Elad, “ Morphological diversity and source separation,” IEEE Signal Process. Lett., vol. Volume 13, no. Issue 7, pp. 409–412, 2006.
[36]
J. Bobin, J.-L. Starck, J. Fadili, and Y. Moudden, “ Sparsity and morphological diversity in blind source separation,” IEEE Trans. Image Process., vol. Volume 16, no. Issue 11, pp. 2662–2674, 2007.
[37]
Z. Zhang, C. E. Towers, and D. P. Towers, “ Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency selection,” Opt. Express, vol. Volume 14, no. Issue 14, pp. 6444–6455, 2006.
[38]
P. S. Huang, Q. Hu, F. Jin, and F.-P. Chiang, “ Color-encoded digital fringe projection technique for high-speed three-dimensional surface contouring,” Opt. Eng., vol. Volume 38, no. Issue 6, pp. 1065–1071, 1999.
[39]
I. W. Selesnick, “ Wavelet transform with tunable Q-factor,” IEEE Trans. Signal Process., vol. Volume 59, no. Issue 8, pp. 3560–3575, 2011.
[40]
C. Eckart and G. Young, “ The approximation of one matrix by another of lower rank,” Psychometrika, vol. Volume 1, no. Issue 3, pp. 211–218, 1936.
[41]
P. J. Huber, Robust Statistics . Hoboken, NJ, USA: Wiley, 1981.
[42]
S. G. Chang, B. Yu, and M. Vetterli, “ Spatially adaptive wavelet thresholding with context modeling for image denoising,” IEEE Trans. Image Process., vol. Volume 9, no. Issue 9, pp. 1522–1531, 2000.
[43]
S. G. Chang, B. Yu, and M. Vetterli, “ Adaptive wavelet thresholding for image denoising and compression,” IEEE Trans. Image Process., vol. Volume 9, no. Issue 9, pp. 1532–1546, 2000.
[44]
M. N. Do and M. Vetterli, “ Wavelet-based texture retrieval using generalized Gaussian density and Kullback–Leibler distance,” IEEE Trans. Image Process., vol. Volume 11, no. Issue 2, pp. 146–158, 2002.
- Robust Single-Shot Fringe Projection Profilometry Based on Morphological Component Analysis
Recommendations
Inpainting for Fringe Projection Profilometry Based on Geometrically Guided Iterative Regularization
Conventional fringe projection profilometry methods often have difficulty in reconstructing the 3D model of objects when the fringe images have the so-called highlight regions due to strong illumination from nearby light sources. Within a highlight region,...
Simple gamma correction for fringe projection profilometry system
SIGGRAPH '10: ACM SIGGRAPH 2010 PostersFringe projection profilometry (FPP) is one of the most commonly used non-contact methods for retrieving the three-dimensional (3D) shape information of objects. In reality, the nonlinearity mostly caused by the gamma effect of digital otpic system, ...
Single-shot dense depth sensing with frequency-division multiplexing fringe projection
Frequency-division multiplexing based single-shot pattern for dense and high accuracy depth sensing.Coprime dual frequency fringe patterns modulation.Wrapped phase extraction by Gabor filter.Coprime theorem based phase unwrapping.Better performance than ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2018.
Publisher
IEEE Press
Publication History
Published: 01 November 2018
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in