A Model for the Omnidirectional Acquisition and Rendering of Stereoscopic Images for Human Viewing
Article No.: 69, Pages 1 - 20
Abstract
Interactive visual media enable the visualization and navigation of remote-world locations in all gaze directions. A large segment of such media is created using pictures from the remote sites thanks to the advance in panoramic cameras. A desirable enhancement is to facilitate the stereoscopic visualization of remote scenes in all gaze directions. In this context, a model for the signal to be acquired by an omnistereoscopic sensor is needed in order to design better acquisition strategies. This omnistereoscopic viewing model must take into account the geometric constraints imposed by our binocular vision system since we want to produce stereoscopic imagery capable to induce stereopsis consistently in any gaze direction; in this paper, we present such model. In addition, we discuss different approaches to sample or to approximate this function and we propose a general acquisition model for sampling the omnistereoscopic light signal. From this model, we propose that by acquiring and mosaicking sparse sets of partially overlapped stereoscopic snapshots, a satisfactory illusion of depth can be evoked. Finally, we show an example of the rendering pipeline to create the omnistereoscopic imagery.
References
[1]
Oculus VR (2015) Oculus VR, LLC. https://www.oculus.com/. Accessed 28 Jun 2015.
[2]
Google, Inc. (2015) Google Jump: camera rig. http://www.google.com/get/cardboard/jump/. Accessed 28 Jun 2015.
[3]
Think Tank Team (2015) Project Beyond. http://thinktankteam.info/beyond/. Accessed 28 Jun 2015.
[4]
Gurrieri, L. E., & Dubois, E. (2013). Acquisition of omnidirectional stereoscopic images and videos of dynamic scenes: A review. SPIE Journal of Electronic Imaging, 22(3), 030902030902.
[5]
Gurrieri, L. E., & Dubois, E. (2014). Depth consistency and vertical disparities in stereoscopic panoramas. Journal of Electronic Imaging, 23(1), 011004.
[6]
Gurrieri, L. E. (2013) The acquisition of omnidirectional stereoscopic images and videos of dynamic scenes: A review. http://luisgurrier.net/pub/background/. Accessed 28 July 2015.
[7]
Gurrieri, L. E. (2014) A model for the omnidirectional acquisition and rendering of stereoscopic images: creating stereoscopic 3D content for immersive telepresence applications. http://luisgurrieri.net/pub/model/. Accessed 28 July 2015.
[8]
Adelson, E., & Wang, J. (1992). Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 99---106.
[9]
Peleg, S., & Ben-Ezra, M. (1999). Stereo panorama with a single camera. In Proceedings of IEEE ConferenceComputer Vision Pattern Recognition, (vol. 1, pp. 395---401).
[10]
Huang, H. C., & Hung, Y. P. (1998). Panoramic stereo imaging system with automatic disparity warping and seaming. Graphical Models and Image Processing, 60(3), 196---208.
[11]
Huang, F., & Klette, R. (2010). Stereo panorama acquisition and automatic image disparity adjustment for stereoscopic visualization. Multimedia Tools and Applications, 47, 353---377.
[12]
Gurrieri, L. E., & Dubois, E. (2012) Efficient panoramic sampling of real-world environments for image-based stereoscopic telepresence. In Proceedings of SPIE 8288, Stereoscopic Displays and Applications XXIII 82882D.
[13]
Baker, H.H., & Constantin, P. (2010) Panoramic stereoscopic camera. Publication number: US 2012/0105574 A1 U.S. Classification 348/36. http://www.google.com/patents/US20120105574. Accessed 28 July 2015.
[14]
Couture, V., & Roy, S. (2013) The omnipolar camera: A new approach to stereo immersive capture. In Proceedings of IEEE International Conference on Computational Photography, (vol. 1, pp. 1---9).
[15]
Scheer, O., Kauff, P., Weissig, C., & Rosenthal, J.C. (2012) Geometrical design concept for panoramic 3D video acquisition. In Proceedings of 20th European Signal Processing Conference (vol. 1, pp. 2757---2761).
[16]
Gurrieri, L.E., & Dubois, E. (2013) Stereoscopic cameras for the real-time acquisition of panoramic 3D images and videos. In Proceedings of SPIE 8648, Stereoscopic Displays and Applications XXIV 86481W.
[17]
Adelson, E. H., & Bergen, J. R. (1991). The plenoptic function and the elements of early vision. Computational Models of Visual Processing, 1, 3---20.
[18]
Nayar, S., (1997) Catadioptric omnidirectional camera, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition pp. 482---488.
[19]
McMillan, L., & Bishop, G. (1995) Plenoptic modeling: An image-based rendering system. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (vol. 1, pp. 39---46).
[20]
Wetzstein, G., Ihrke, I., & Heidrich, W. (2013). On plenoptic multiplexing and reconstruction. International Journal of Computer Vision, 1, 1---17.
[21]
Huang, F., Wei, S., & Klette, R. (2001) Geometrical fundamentals of polycentric panoramas. In Proceedings of 8th IEEE International Conference on Computer Vision, (vol. 1, pp. 560---565).
[22]
Wei, S., Huang, F., & Klette, R. (2001). Determination of geometric parameters for stereoscopic panorama cameras. Machine Graphics & Vision, 10(3), 399---427.
[23]
Huang, F., Klette, R., & Scheibe, K. (2008). Panoramic Imaging: Sensor-Line Cameras and Laser Range-Finders. Hoboken, NJ: John Wiley & Sons Inc.
[24]
Reynolds, R. O. (1995). Design of a stereo multispectral CCD camera for Mars Pathfinder. Proceedings of SPIE, 2542, 197---206.
[25]
Couture, V., Langer, M. S., & Roy, S. (2010). Analysis of disparity distortions in omnistereoscopic displays. Proceedings of ACM Transactions on Applied Perception (TAP), 7(25), 1---13.
[26]
Bourke, P. (2010) Capturing omni-directional stereoscopic spherical projections with a single camera. In Proceedings of 16th International Conference on Virtual Systems and Multimedia (VSMM), (vol. 1, pp. 179---183).
[27]
Wetzstein, G., Ihrke, I., Lanman, D., & Heidrich, W. (2011). Computational plenoptic imaging. Computer Graphics Forum, 30(8), 2397---2426.
[28]
Dubois, E. (2009). The structure and properties of color spaces and the representation of color images., Synthesis lectures on image, video, and multimedia processing, Morgan & Claypool.
[29]
Southwell, D., Basu, A., Fiala, M., & Reyda, J. (1996). Panoramic stereo. Proceedings of IEEE International Conference of Pattern Recognition, (vol. 1, pp. 378---382).
[30]
Spacek, L. (2004). Coaxial omnidirectional stereopsis. Proceedings of Computer Vision--ECCV, 2004(3024), 354---365.
[31]
Adobe Systems Incorporated (2013) Photoshop Lightroom. http://www.adobe.com/ca/products/photoshop-lightroom.html. Accessed 3 Jun 2015.
[32]
The GIMP Development Team, Kimball, S., Mattis, P. (2013) GIMP: The GNU image manipulation program. http://www.gimp.org/. Accessed May 2014.
[33]
The MathWorks, Inc. (2013) Matlab. http://www.mathworks.com/. Accessed May 2014.
[34]
Sutu, M., Sykes, D. (2013) StereoPhotoMaker: stereo photography authoring tool. http://stereo.jpn.org/eng/stphmkr/. Accessed May 2014.
[35]
X-Rite, Inc. (2013) Color Checker Passport. http://xritephoto.com/ph_product_overview.aspx?id=1257&catid=28&action=overview. Accessed May 2014.
[36]
The MathWorks, Inc. (2012) Matlab: Stereo Image Rectification. http://www.mathworks.com/help/vision/examples/stereo-image-rectification.html. Accessed May 2014
[37]
Bay, H., Tuytelaars, T., & Van Gool, L. (2006). SURF: speeded up robust features. Proceedings of Computer Vision ECCV 2006. Lecture Notes in Computer Science, (vol. 3951, pp. 404---410).
[38]
The MathWorks, Inc. (2012) Computer Vision Toolbox: Matlab's implementation of SURF detectSURFFeatures. http://www.mathworks.com/help/vision/ref/detectsurffeatures.html. Accessed May 2014.
[39]
Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381---395.
[40]
The MathWorks, Inc. (2012) Computer Vision Toolbox: Estimate fundamental matrix from corresponding points in stereo images estimateFundamentalMatrix. http://www.mathworks.com/help/vision/ref/estimatefundamentalmatrix.html. Accessed May 201
[41]
Xiong, Y., & Pulli, K. (2009) Color correction for mobile panorama imaging. In Proceedings of the 1st International Confernce on Internet Multimedia Computing and Service (vol. 1, pp. 219---226).
[42]
Shum, HY., & Szeliski, R. (2001) Construction of panoramic image mosaics with global and local alignment. In Panoramic Vision (pp. 227---268).
[43]
Szeliski, R. (2011). Computer vision algorithms and applications. New York: Springer.
[44]
Szeliski, R. (2006). Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision, 2(1), 1---10.
[45]
Ha, S. J., Koo, H., Lee, S. H., Cho, N. I., & Kim, S. K. (2007). Panorama mosaic optimization for mobile camera systems. Proceedings of IEEE Transactions on Consumer Electronics, 53(4), 1217---1225.
[46]
Díaz Hernández, R. (2011) Rendering stereoscopic 3D images in cylindrical spaces. Dissertation, Universidad Politécnica de Valencia.
[47]
Burt, P., & Adelson, E. (1983). The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31(4), 532---540.
Index Terms
- A Model for the Omnidirectional Acquisition and Rendering of Stereoscopic Images for Human Viewing
Index terms have been assigned to the content through auto-classification.
Recommendations
A unified rectification method for single viewpoint multi-camera system
AVSS '11: Proceedings of the 2011 8th IEEE International Conference on Advanced Video and Signal Based SurveillanceStereo matching and 3D reconstruction has been studied for decades as a fundamental problem in the field of computer vision. Recent years, stereo matching and 3D reconstruction with a large field of view, especially using omnidirectional vision and ...
Panoramic stereo representation for immersive projection display system
VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in IndustryIn this paper, the panoramic stereo images are produced from the real environment using a digital camera and a panoramic tripod head. And they are applied to the CAVE system as panoramic stereo background to increase user's immersion. The images for ...
A View-Dependent Stereoscopic System Using Tiled Projection
ISCID '13: Proceedings of the 2013 Sixth International Symposium on Computational Intelligence and Design - Volume 02In this paper, we present a novel system which allows its users to see a stereoscopic virtual object. Unlike most existing stereoscopic systems that display the same imagery when watched from different directions, the user's head is tracked in real-time ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © Copyright © 2015 3D Research Center, Kwangwoon University and Springer-Verlag Berlin Heidelberg.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 December 2015
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Sep 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in