research-article

Finding paths through the world's photos

Authors:

Steven M. Seitz,

Richard SzeliskiAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 27, Issue 3

Pages 1 - 11

https://doi.org/10.1145/1360612.1360614

Published: 01 August 2008 Publication History

Abstract

When a scene is photographed many times by different people, the viewpoints often cluster along certain paths. These paths are largely specific to the scene being photographed, and follow interesting regions and viewpoints. We seek to discover a range of such paths and turn them into controls for image-based rendering. Our approach takes as input a large set of community or personal photos, reconstructs camera viewpoints, and automatically computes orbits, panoramas, canonical views, and optimal paths between views. The scene can then be interactively browsed in 3D using these controls or with six degree-of-freedom free-viewpoint control. As the user browses the scene, nearby views are continuously selected and transformed, using control-adaptive reprojection techniques.

Supplementary Material

FLV File (12.flv)

Download
105.20 MB

MOV File (a15-snavely.mov)

Download
56.63 MB

References

[1]

Aliaga, D. G., and Carlbom, I. 2001. Plenoptic stitching: A scalable method for reconstructing 3D interactive walkthroughs. In SIGGRAPH Conf. Proc., 443--450.

Digital Library

[2]

Bookstein, F. L. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Trans. on Pattern Analysis and Machine Intelligence 11, 6, 567--585.

Digital Library

[3]

Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH Conf. Proc., 425--432.

Digital Library

[4]

Chen, S., and Williams, L. 1993. View interpolation for image synthesis. In SIGGRAPH Conf. Proc., 279--288.

Digital Library

[5]

Chen, S. E. 1995. QuickTime VR - an image-based approach to virtual environment navigation. In SIGGRAPH Conf. Proc., 29--38.

Digital Library

[6]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In SIGGRAPH Conf. Proc., 11--20.

Digital Library

[7]

Drucker, S. M., and Zeltzer, D. 1994. Intelligent camera control in a virtual environment. In Proc. of Graphics Interface, 190--199.

[8]

Epshtien, B., Ofek, E., Wexler, Y., and Zhang, P. 2007. Hierarchical photo organization using geometric relevance. In ACM Int. Symp. on Advances in Geographic Information Systems.

Digital Library

[9]

Fischler, M., and Bolles, R. 1987. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Readings in computer vision: issues, problems, principles, and paradigms, 726--740.

Digital Library

[10]

Galyean, T. A. 1995. Guided navigation of virtual environments. In SI3D '95: Proc. Symposium on Interactive 3D Graphics, 103--104.

Digital Library

[11]

Goesele, M., Snavely, N., Seitz, S. M., Curless, B., and Hoppe, H. 2007. Multi-view stereo for community photo collections. In Proc. Int. Conf. on Computer Vision.

[12]

Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In SIGGRAPH Conf. Proc., 43--54.

Digital Library

[13]

Kanade, T., 2001. Carnegie Mellon goes to the Superbowl. http://www.ri.cmu.edu/events/sb35/tksuperbowl.html.

[14]

Kang, S. B., Sloan, P.-P., and Seitz, S. M. 2000. Visual tunnel analysis for visibility prediction and camera planning. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 2195--2202.

[15]

Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH Conf. Proc., 31--42.

Digital Library

[16]

Lippman, A. 1980. Movie maps: An application of the optical videodisc to computer graphics. In SIGGRAPH Conf. Proc., 32--43.

Digital Library

[17]

Lowe, D. 2004. Distinctive image features from scale-invariant keypoints. Int. J. of Computer Vision 60, 2, 91--110.

Digital Library

[18]

McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. In SIGGRAPH Conf. Proc., 39--46.

Digital Library

[19]

Pollefeys, M., van Gool, L., Vergauwen, M., est, F. V., Cornelis, K., Tops, J., and Koch, R. 2004. Visual modeling with a hand-held camera. Int. J. of Computer Vision 59, 3, 207--232.

Digital Library

[20]

Seitz, S. M., and Dyer, C. M. 1996. View morphing. In SIGGRAPH Conf. Proc., 21--30.

Digital Library

[21]

Shum, H.-Y., and He, L.-W. 1999. Rendering with concentric mosaics. In SIGGRAPH Conf. Proc., 299--306.

Digital Library

[22]

Simon, I., Snavely, N., and Seitz, S. M. 2007. Scene summarization for online image collections. In Proc. Int. Conf. on Computer Vision.

[23]

Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3D. In SIGGRAPH Conf. Proc., 835--846.

Digital Library

[24]

Snavely, N., Seitz, S. M., and Szeliski, R. 2008. Skeletal sets for efficient structure from motion. In Proc. Computer Vision and Pattern Recognition (to appear).

[25]

Sutherland, I. E. 1968. A head-mounted three dimensional display. In Proc. Fall Joint Computer Conf., 757--764.

Digital Library

[26]

Tan, D. S., Robertson, G. G., and Czerwinski, M. 2001. Exploring 3d navigation: combining speed-coupled flying with orbiting. In Proc. Conf. on Human Factors in Computing Systems, ACM Press, 418--425.

Digital Library

[27]

Taylor, C. J. 2002. VideoPlus: a method for capturing the structure and appearance of immersive environments. IEEE Transactions on Visualization and Computer Graphics 8, 2 (April-June), 171--182.

Digital Library

[28]

Uyttendaele, M., Criminisi, A., Kang, S. B., Winder, S., Szeliski, R., and Hartley, R. 2004. Image-based interactive exploration of real-world environments. IEEE Computer Graphics and Applications 24, 3, 52--63.

Digital Library

[29]

Ware, C., and Osborne, S. 1990. Exploration and virtual camera control in virtual three dimensional environments. In Proc. Symposium on Interactive 3D Graphics, ACM Press, 175--183.

Digital Library

Cited By

Wu HFlynn CHall CChe-Castaldo CSamaras DSchwaller MLynch H(2024)Penguin colony georegistration using camera pose estimation and phototourismPLOS ONE10.1371/journal.pone.031103819:10(e0311038)Online publication date: 30-Oct-2024
https://doi.org/10.1371/journal.pone.0311038
Dudai CAlper MBezalel HHanocka RLang IAverbuch‐Elor H(2024)HaLo‐NeRF: Learning Geometry‐Guided Semantics for Exploring Unconstrained Photo CollectionsComputer Graphics Forum10.1111/cgf.1500643:2Online publication date: 15-Apr-2024
https://doi.org/10.1111/cgf.15006
Yan RSun JDeng LDavis A(2022)ReCapture: AR-Guided Time-lapse PhotographyProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545641(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545641
Show More Cited By

Index Terms

Finding paths through the world's photos
1. Computing methodologies

Recommendations

Finding non-dominated bicriteria shortest pairs of disjoint simple paths

In this paper we introduce a method to compute non-dominated bicriteria shortest pairs, each including two disjoint simple paths. The method is based on an algorithm for ranking pairs of disjoint simple paths by non-decreasing order of cost, that is an ...
Finding next-to-shortest paths in a graph

We study the problem of finding the next-to-shortest paths in a graph. A next-to-shortest (u,v)-path is a shortest (u,v)-path amongst (u,v)-paths with length strictly greater than the length of the shortest (u,v)-path. In contrast to the situation in ...
Improved algorithm for finding next-to-shortest paths

We study the problem of finding the next-to-shortest paths in a weighted undirected graph. A next-to-shortest (u, v)-path is a shortest (u, v)-path amongst (u, v)-paths with length strictly greater than the length of the shortest (u, v)-path. The first ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 27, Issue 3

August 2008

844 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1360612

Issue’s Table of Contents

Copyright © 2008 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Published in TOG Volume 27, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

101
Total Citations
View Citations
2,212
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu HFlynn CHall CChe-Castaldo CSamaras DSchwaller MLynch H(2024)Penguin colony georegistration using camera pose estimation and phototourismPLOS ONE10.1371/journal.pone.031103819:10(e0311038)Online publication date: 30-Oct-2024
https://doi.org/10.1371/journal.pone.0311038
Dudai CAlper MBezalel HHanocka RLang IAverbuch‐Elor H(2024)HaLo‐NeRF: Learning Geometry‐Guided Semantics for Exploring Unconstrained Photo CollectionsComputer Graphics Forum10.1111/cgf.1500643:2Online publication date: 15-Apr-2024
https://doi.org/10.1111/cgf.15006
Yan RSun JDeng LDavis A(2022)ReCapture: AR-Guided Time-lapse PhotographyProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545641(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545641
Zhu CZhang HChen WTan MLiu Q(2021)An Occlusion Compensation Learning Framework for Improving the Rendering Quality of Light FieldIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2020.302746832:12(5738-5752)Online publication date: Dec-2021
https://doi.org/10.1109/TNNLS.2020.3027468
Mo ZShi BYeung SMatsushita Y(2020)Ambiguity-Free Radiometric Calibration for Internet Photo CollectionsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2019.290145842:7(1670-1684)Online publication date: 1-Jul-2020
https://doi.org/10.1109/TPAMI.2019.2901458
Yan TMao YWang JLiu WQian XLau R(2020)Generating Stereoscopic Images With Convergence Control Ability From a Light Field Image PairIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2019.290355630:5(1435-1450)Online publication date: May-2020
https://doi.org/10.1109/TCSVT.2019.2903556
Rau AGarcia-Hernando GStoyanov DBrostow GTurmukhambetov D(2020)Predicting Visual Overlap of Images Through Interpretable Non-metric Box EmbeddingsComputer Vision – ECCV 202010.1007/978-3-030-58558-7_37(629-646)Online publication date: 23-Aug-2020
https://dl.acm.org/doi/10.1007/978-3-030-58558-7_37
He JWang LZhou WZhang HCui XGuo Y(2019)Viewpoint Assessment and Recommendation for Photographing ArchitecturesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.285375125:8(2636-2649)Online publication date: 1-Aug-2019
https://doi.org/10.1109/TVCG.2018.2853751
Nuernberger BHöllerer TTurk MMorishima SItoh YShiratori TYue YLindeman R(2018)Hybrid orbiting-to-photos in 3D reconstructed visual realityProceedings of the 24th ACM Symposium on Virtual Reality Software and Technology10.1145/3281505.3281528(1-10)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3281505.3281528
Brejcha JLukác MChen ZDiVerdi SCadík MBaudisch PSchmidt AWilson A(2018)Immersive Trip ReportsProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242653(389-401)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242653
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents