Abstract
We present a system to easily capture building interiors and automatically generate floor plans scaled to their metric dimensions. The proposed approach is able to manage scenes not necessarily limited to the Manhattan World assumption, exploiting the redundancy of the instruments commonly available on commodity smartphones, such as accelerometer, magnetometer and camera. Without specialized training or equipment, our system can produce a 2D floor plan and a representative 3D model of the scene accurate enough to be used for simulations and interactive applications.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Arikan, M., Schwärzler, M., Flöry, S., Wimmer, M., Maierhofer, S.: O-snap: Optimization-based snapping for modeling architecture. ACM Trans. Graph. 32(1), 6:1–6:15 (2013). doi:10.1145/2421636.2421642
Buades, A., Coll, B., Morel, J.M.: Non-Local Means Denoising. Image Processing On Line 1 (2011)
Canny, J.: A computational approach to edge detection. Pattern Analysis and Machine Intelligence. IEEE Trans. PAMI 8(6), 679–698 (1986). doi:10.1109/TPAMI.1986.4767851
Capel, D.: An effective bail-out test for ransac consensus scoring. In: Proc. BMVC, pp. 629–638 (2005)
Cornelis, N., Leibe, B., Cornelis, K., Gool, L.V.: 3d urban scene modeling integrating recognition and reconstruction. Int. J. Comput. Vision 78(2–3), 121–141 (2008)
Coughlan, J.M., Yuille, A.L.: Manhattan world: compass direction from a single image by Bayesian inference. Proc. ICCV 2, 941–947 (1999)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. SIGGRAPH ’96, pp. 11–20. ACM, New York (1996)
Di Benedetto, M., Ganovelli, F., Balsa Rodriguez, M., Jaspe Villanueva, A., Scopigno, R., Gobbetti, E.: Exploremaps: efficient construction and ubiquitous exploration of panoramic view graphs of complex 3d environments. Computer Graphics Forum 33(2), Proc. Eurographics 2014 (2014)
El-Hakim, S.F., Boulanger, P., Blais, F., Beraldin, J.A.: System for indoor 3D mapping and virtual environments. In: El-Hakim, S.F. (ed.) Videometrics V, Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 3174, pp. 21–35 (1997)
Frueh, C., Jain, S., Zakhor, A.: Data processing algorithms for generating textured 3d building facade meshes from laser scans and camera images. Int J Comput Vision 61(2), 159–184 (2005)
Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Reconstructing building interiors from images. In: Proc. ICCV (2009)
Guru, D., Dinesh, R.: Non-parametric adaptive region of support useful for corner detection: a novel approach. Pattern Recognit. 37(1), 165–168 (2004). doi:10.1016/S0031-3203(03)00234-6
inc., G.: Google project tango (2014). http://www.google.com/atap/projecttango/
Kim, Y.M., Dolson, J., Sokolsky, M., Koltun, V., Thrun, S.: Interactive acquisition of residential floor plans. In: Proc. IEEE ICRA, pp. 3055–3062 (2012)
Matas, J., Galambos, C., Kittler, J.: Robust detection of lines using the progressive probabilistic hough transform. Comput. Vision Image Understand. 78(1), 119–137 (2000). doi:10.1006/cviu.1999.0831
Müller, P., Wonka, P., Haegler, S., Ulmer, A., Van Gool, L.: Procedural modeling of buildings. ACM SIGGRAPH 2006 Papers. SIGGRAPH ’06, pp. 614–623. ACM, New York (2006)
Mura, C., Jaspe Villanueva, A., Mattausch, O., Gobbetti, E., Pajarola, R.: Reconstructing complex indoor environments with arbitrary wall orientations. In: Proc. Eurographics Posters. Eurographics Association (2014)
Mura, C., Mattausch, O., Jaspe Villanueva, A., Gobbetti, E., Pajarola, R.: Robust reconstruction of interior building structures with multiple rooms under clutter and occlusions. In: Proc. 13th International Conference on Computer-Aided Design and Computer Graphics (2013)
Pollefeys, M., et al.: Detailed real-time urban 3d reconstruction from video. Int. J. Comput. Vision 78(2–3), 143–167 (2008)
Sankar, A., Seitz, S.: Capturing indoor scenes with smartphones. In: Proc. ACM UIST, pp. 403–412 (2012)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. Proc. CVPR 1, 519–528 (2006)
Sensopia: Magicplan (2011). http://www.sensopia.com
Shi, J., Tomasi, C.: Good features to track. In: 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1994. Proceedings CVPR ’94, pp. 593–600 (1994). doi:10.1109/CVPR.1994.323794
Shin, H., Chon, Y., Cha, H.: Unsupervised construction of an indoor floor plan using a smartphone. IEEE Trans. Syst. Man Cybern. 42(6), 889–898 (2012)
Sinha, S.N., Steedly, D., Szeliski, R., Agrawala, M., Pollefeys, M.: Interactive 3d architectural modeling from unordered photo collections. In: ACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia ’08, pp. 159:1–159:10. ACM, New York (2008)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. ACM TOG 25(3), 835–84 (2006)
Stamos, I., Yu, G., Wolberg, G., Zokai, S.: 3d modeling using planar segments and mesh elements. In: Third International Symposium on 3D Data Processing, Visualization, and Transmission, pp. 599–606 (2006). doi:10.1109/3DPVT.2006.5
Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based facade modeling. In: ACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia ’08, pp. 161:1–161:10. ACM, New York (2008)
Zebedin, L., Bauer, J., Karner, K., Bischof, H.: Fusion of feature- and area-based information for urban buildings modeling from aerial imagery. In: Proc. ECCV, pp. 873–886 (2008)
Acknowledgments
This research is partially supported by EU FP7 grant 607737 (VASCO). We also acknowledge the contribution of Sardinian Regional Authorities.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pintore, G., Gobbetti, E. Effective mobile mapping of multi-room indoor structures. Vis Comput 30, 707–716 (2014). https://doi.org/10.1007/s00371-014-0947-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-014-0947-0