Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2630099.2630105acmconferencesArticle/Chapter ViewAbstractPublication PagesnparConference Proceedingsconference-collections
research-article

Computational rim illumination with aerial robots

Published: 08 August 2014 Publication History

Abstract

Lighting plays a major role in photography. Professional photographers use elaborate installations to light their subjects and achieve sophisticated styles. However, lighting moving subjects performing dynamic tasks presents significant challenges and requires expensive manual intervention. A skilled additional assistant might be needed to reposition lights as the subject changes pose or moves, and the extra logistics significantly raises costs and time.
We present a new approach to lighting dynamic subjects where an aerial robot equipped with a portable light source lights the subject to automatically achieve a desired lighting effect. We focus on rim lighting, a particularly challenging effect to achieve with dynamic subjects, and allow the photographer to specify a required rim width. Our algorithm processes the images from the photographer's camera and provides necessary motion commands to the aerial robot to achieve the desired rim width in the resulting photographs. We demonstrate a control approach that localizes the aerial robot with reference to the subject and tracks the subject to achieve the necessary motion. Our proof-of-concept results demonstrate the utility of robots in computational lighting.

References

[1]
Akers, D., Losasso, F., Klingner, J., Agrawala, M., Rick, J., and Hanrahan, P. 2003. Conveying shape and features with image-based relighting. In Proceedings of the 14th IEEE Visualization 2003 (VIS'03), IEEE Computer Society, 46.
[2]
Anrys, F., Dutré, P., and Willems, Y. 2004. Image based lighting design. In 4th IASTED International Conference on Visualization, Imaging, and Image Processing.
[3]
Bouabdallah, S., and Siegwart, R. 2007. Full control of a quadrotor. In Intelligent robots and systems, 2007. IROS 2007. IEEE/RSJ international conference on, IEEE, 153--158.
[4]
Bousseau, A., Chapoulie, E., Ramamoorthi, R., and Agrawala, M. 2011. Optimizing environment maps for material depiction. In Computer Graphics Forum, vol. 30, Wiley Online Library, 1171--1180.
[5]
Boyadzhiev, I., Paris, S., and Bala, K. 2013. User-assisted image compositing for photographic lighting. ACM Trans. Graph. 32, 4 (July), 36:1--36:12.
[6]
Bristeau, P., Callou, F., Vissière, D., Petit, N., et al. 2011. The navigation and control technology inside the ar. drone micro uav. In World Congress, vol. 18, 1477--1484.
[7]
Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., and Hawkins, T. 2002. A lighting reproduction approach to live-action compositing, vol. 21. ACM.
[8]
Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. In ACM Transactions on Graphics (TOG), vol. 23, ACM, 673--678.
[9]
Lozano, R., Castillo, P., and Dzul, A., 2005. Modeling and control of mini-flying machines.
[10]
Mohan, A., Tumblin, J., Bodenheimer, B., Grimm, C., and Bailey, R. 2005. Table-top computed lighting for practical digital photography. In Rendering Techniques 2005: 16th Eurographics Workshop on Rendering, 165--172.
[11]
Parrot, 2010. AR Drone Quadrotor. http://en.wikipedia.org/wiki/Parrot_AR.Drone. {Online;}.
[12]
Pellacini, F., Battaglia, F., Morley, R., and Finkelstein, A. 2007. Lighting with paint. ACM Transactions on Graphics (TOG) 26, 2, 9.
[13]
Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M. F., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. Graph 23, 3, 664--672.
[14]
Poulin, P., and Fournier, A. 1992. Lights from highlights and shadows. In Proceedings of the 1992 symposium on Interactive 3D graphics, ACM, 31--38.
[15]
Raskar, R., Tan, K., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. In ACM Transactions on Graphics (TOG), vol. 23, ACM, 679--688.
[16]
Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In Proceedings of the 20th annual conference on Computer graphics and interactive techniques, ACM, 143--146.
[17]
Wang, O., Fuchs, M., Fuchs, C., Davis, J., Seidel, H.-P., and Lensch, H. 2010. A context-aware light source. In IEEE International Conference on Computational Photography, IEEE.

Cited By

View all
  • (2024)Projection Mapping with a Brightly Lit Surrounding Using a Mixed Light Field ApproachIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337213230:5(2217-2227)Online publication date: 6-Mar-2024
  • (2022)Photographic Lighting Design with Photographer-in-the-Loop Bayesian OptimizationProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545690(1-11)Online publication date: 29-Oct-2022
  • (2019)Optimizing Portrait Lighting at Capture-Time Using a 360 Camera as a Light ProbeProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347893(221-232)Online publication date: 17-Oct-2019
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CAe '14: Proceedings of the Workshop on Computational Aesthetics
August 2014
100 pages
ISBN:9781450330190
DOI:10.1145/2630099
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 August 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational photography
  2. lighting
  3. localization

Qualifiers

  • Research-article

Conference

Expressive '14
Sponsor:

Acceptance Rates

Overall Acceptance Rate 11 of 25 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Projection Mapping with a Brightly Lit Surrounding Using a Mixed Light Field ApproachIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337213230:5(2217-2227)Online publication date: 6-Mar-2024
  • (2022)Photographic Lighting Design with Photographer-in-the-Loop Bayesian OptimizationProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545690(1-11)Online publication date: 29-Oct-2022
  • (2019)Optimizing Portrait Lighting at Capture-Time Using a 360 Camera as a Light ProbeProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347893(221-232)Online publication date: 17-Oct-2019
  • (2017)Tethered flight control of a small quadrotor robot for stippling2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2017.8205983(1713-1718)Online publication date: Sep-2017
  • (2016)Automated cinematography with unmanned aerial vehiclesProceedings of the Eurographics Workshop on Intelligent Cinematography and Editing10.5555/3056983.3056987(23-30)Online publication date: 9-May-2016
  • (2016)Stippling with aerial robotsProceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.5555/2981324.2981342(125-134)Online publication date: 7-May-2016
  • (2016)Computational bounce flash for indoor portraitsACM Transactions on Graphics10.1145/2980179.298021935:6(1-9)Online publication date: 5-Dec-2016
  • (2015)An interactive tool for designing quadrotor camera shotsACM Transactions on Graphics10.1145/2816795.281810634:6(1-11)Online publication date: 2-Nov-2015
  • (2015)L'evolvedProceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/2750858.2805850(487-491)Online publication date: 7-Sep-2015
  • (2015)Computational rim illumination of dynamic subjects using aerial robotsComputers and Graphics10.1016/j.cag.2015.03.00752:C(142-154)Online publication date: 1-Nov-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media