Abstract
In this paper we present a 3D human face reconstruction framework based on stereo sensor coupled with a structured lighting source. Starting from two calibrated images, the active part (video projector) which project controlled lights, allows the operator to locate two sets of structured features with sub-pixel accuracy in both left and right images. Then, exploiting epipolar geometry improves the matching process by reducing its complexity from a bidirectional to a unidirectional search problem. Finally, we perform an adapted dynamic programming algorithm to obtain corresponding features in each conjugated scanline separately. Final three dimensional face models are achieved by a pipeline of four steps: (a) stereo triangulation, (b) data interpolation based on cubic spline models, (c) Delaunay triangulation-based meshing, and (d) texture mapping process.
Chapter PDF
Similar content being viewed by others
Keywords
- Voronoi Diagram
- Delaunay Triangulation
- Dynamic Programming Algorithm
- Epipolar Line
- Structure From Motion
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Tsishkou, D., Chen, L., Bovbel, E.: Semi-Automatic Face Segmentation for Face Detection in Video. In: Proc. of MEDIANET 2004, Tozeur, Tunisia, pp. 107–118 (2004)
Peng, K., Chen, L., Ruan, S.: Face Image Encryption and Reconstruction for Smart Cards Using Fourrier-Mellin Transform. In: Proc. of MEDIANET 2004, Tunisia, pp. 311–317 (2004)
Home page, http://www.cyberware.com
Home page, http://www.minolta-3d.com
Trucco, E., Verri, A.: Introductory Techniques for 3D Computer Vision. Prentice-Hall, Englewood Cliffs (1998) ISBN 0-13-261108-2
D’Apuzzo, N.: Modeling human faces with multi-image photogrammetry. In: Corner, B.D., Pargas, R., Nurre, J.H. (eds.) Proc. of SPIE, Three-Dimensional Image Capture and Applications V, San Jose, USA, vol. 4661, pp. 191–197 (2002)
Lao, S., Kawade, M., Sumi, Y., Tomita, F.: Building 3D Facial Models and Detecting Face Pose in 3D Space. 3DIM, 390–404 (1999)
Chowdhury, A.R., Chellappa, R., Krishnamurthy, S., Vu, T.: 3D Face Reconstruction from Video Using a Generic Model. In: International Conference on Multimedia, Switzerland, vol. I, pp. 449–452 (2002)
Garcia, E., Dugelay, J.-L., Delingette, H.: Low Cost 3D Face Acquisition and Modeling. In: ITCC, Las Vegas, Nevada (April 2001)
Zhang, L., Curless, B., Seitz, S.M.: Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: Int. Symposium on 3D Data Processing Visualization and Transmission, Padova, Italy (June 2002)
Liu, Y., Chen, G., Max, N., Hofsetz, C., McGuinness, P.: Visual Hull Rendering with Multi-view Stereo. Journal of WSCG (February 2004)
Chen, C.-Y., Klette, R., Chen, C.-F.: 3D Reconstruction Using Shape from Photometric Stereo and Contours (October 2003)
Horace, H.S.I., Yin, L.J.: Constructing a 3D Head Model from Two Orthogonal Views. The Visual Computer 12(5), 254–266 (1996)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)
de Boor, C.: A Practical Guide to Splines. Springer, Heidelberg (1978)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Amor, B.B., Ardabilian, M., Chen, L. (2005). 3D Face Modeling Based on Structured-Light Assisted Stereo Sensor. In: Roli, F., Vitulano, S. (eds) Image Analysis and Processing – ICIAP 2005. ICIAP 2005. Lecture Notes in Computer Science, vol 3617. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11553595_103
Download citation
DOI: https://doi.org/10.1007/11553595_103
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28869-5
Online ISBN: 978-3-540-31866-8
eBook Packages: Computer ScienceComputer Science (R0)