Article

High dynamic range video

Authors:

Sing Bing Kang,

Matthew Uyttendaele,

Richard SzeliskiAuthors Info & Claims

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

Pages 319 - 325

https://doi.org/10.1145/1201775.882270

Published: 01 July 2003 Publication History

Abstract

Typical video footage captured using an off-the-shelf camcorder suffers from limited dynamic range. This paper describes our approach to generate high dynamic range (HDR) video from an image sequence of a dynamic scene captured while rapidly varying the exposure of each frame. Our approach consists of three parts: automatic exposure control during capture, HDR stitching across neighboring frames, and tonemapping for viewing. HDR stitching requires accurately registering neighboring frames and choosing appropriate pixels for computing the radiance map. We show examples for a variety of dynamic scenes. We also show how we can compensate for scene and camera movement when creating an HDR still from a series of bracketed still photographs.

Supplementary Material

MP4 File (kang_uyttendaele_high.mp4)

Download
32.92 MB

References

[1]

Bergen, J. R., Anandan, P., Hanna, K. J., and Hingorani, R. 1992. Hierarchical model-based motion estimation. In Second European Conference on Computer Vision (ECCV'92), 237--252.

Digital Library

[2]

Bogoni, L. 2000. Extending dynamic range of monochrome and color images through fusion. In International Conference on Pattern Recognition, vol. 3, 7--12.

Digital Library

[3]

Debevec, P., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. Proceedings of SIGGRAPH97 (August), 369--378.

Digital Library

[4]

Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics (TOG) 21, 3, 257--266.

Digital Library

[5]

Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics (TOG) 21, 3, 249--256.

Digital Library

[6]

Lucas, B. D., and Kanade, T. 1981. An iterative image registration technique with an application in stereo vision. In Seventh International Joint Conference on Artificial Intelligence (IJCAI-81), 674--679.

[7]

Mann, S., and Picard R. W. 1995. On being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In IS&T's 48th Annual Conference, Society for Imaging Science and Technology, Washington, D. C., 422--428.

[8]

Mann, S., Manders, C., and Fung, J. 2002. Painting with looks: Photographic images from video using quantimetric processing. In ACM Multimedia, 117--126.

Digital Library

[9]

Mitsunaga, T., and Nayar, S. K. 1999. Radiometric self calibration. In IEEE Computer Society Conference on Computer Esion and Pattern Recognition (CVPR'99), vol. 1, 374--380.

[10]

Mitsunaga, T., and Nayar, S. K. 2000. High dynamic range imaging: Spatially varying pixel exposures. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'2000), vol. 1, 472--479.

[11]

Pattanaik, S. N., Tumblin, J. E., Yee, H., and Greenberg, D. P. 2000. Time-dependent visual adaptation for realistic image display. Proceedings of SIGGRAPH 2000 (July), 47--54.

Digital Library

[12]

Reinhard E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. ACM Transactions on Graphics (TOG) 21, 3, 267--276.

Digital Library

[13]

Tsin, Y., Ramesh, V., and Kanade, T. 2001. Statistical calibration of CCD imaging process. In Eighth International Conference on Computer Vision (ICCV 2001), vol. I, 480--487.

[14]

Tsin, Y., Kang, S. B., and Szeliski, R. 2003. Stereo matching with reflections and translucency. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2003) (to appear).

Digital Library

[15]

Uyttendaele, M., Eden, A., and Szeliski, R. 2001. Eliminating ghosting and exposure artifacts in image mosaics. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), vol. II, 509--516.

Cited By

Liang YHuang HHe YHu CYang SChen H(2024)Pixel-wise exposure control for single-shot HDR imaging: A joint optimization approachAPL Photonics10.1063/5.02073639:6Online publication date: 18-Jun-2024
https://doi.org/10.1063/5.0207363
Zhang PZhou WFan L(2024)Channel and spatial attention-guided network for deep high dynamic range imaging with large motionsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02871-540:3(1583-1599)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s00371-023-02871-5
Chung HCho N(2022)High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV51458.2022.00014(61-71)Online publication date: Jan-2022
https://doi.org/10.1109/WACV51458.2022.00014
Show More Cited By

Index Terms

High dynamic range video
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

High dynamic range video

Typical video footage captured using an off-the-shelf camcorder suffers from limited dynamic range. This paper describes our approach to generate high dynamic range (HDR) video from an image sequence of a dynamic scene captured while rapidly varying the ...
High Dynamic Range Video: Concepts, Technologies and Applications
High dynamic range images for enhancing low dynamic range content
SA '11: SIGGRAPH Asia 2011 Posters

This poster presents a practical system for enhancing the quality of Low Dynamic Range (LDR) videos using High Dynamic Range (HDR) background images. Our technique relies on the assumption that the HDR information is static in the video footage. This ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

July 2003

683 pages

ISBN:1581137095

DOI:10.1145/1201775

Conference Chair:
Alyn P. Rockwood
Colorado School of Mines

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH03

Sponsor:

SIGGRAPH

SIGGRAPH03: Special Interest Group on Computer Graphics and Interactive Techniques

July 27 - 31, 2003

California, San Diego

Acceptance Rates

SIGGRAPH '03 Paper Acceptance Rate 81 of 424 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

56
Total Citations
View Citations
3,967
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liang YHuang HHe YHu CYang SChen H(2024)Pixel-wise exposure control for single-shot HDR imaging: A joint optimization approachAPL Photonics10.1063/5.02073639:6Online publication date: 18-Jun-2024
https://doi.org/10.1063/5.0207363
Zhang PZhou WFan L(2024)Channel and spatial attention-guided network for deep high dynamic range imaging with large motionsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02871-540:3(1583-1599)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s00371-023-02871-5
Chung HCho N(2022)High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV51458.2022.00014(61-71)Online publication date: Jan-2022
https://doi.org/10.1109/WACV51458.2022.00014
Khan ZShettiwar PKhanna MRaman S(2022)DeepHS-HDRVideo: Deep High Speed High Dynamic Range Video Reconstruction2022 26th International Conference on Pattern Recognition (ICPR)10.1109/ICPR56361.2022.9956659(1959-1966)Online publication date: 21-Aug-2022
https://doi.org/10.1109/ICPR56361.2022.9956659
Prabhakar KSenthil GAgrawal SBabu RGorthi R(2021)Labeled from Unlabeled: Exploiting Unlabeled Data for Few-shot Deep HDR Deghosting2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.00484(4873-4883)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.00484
Santos MRen TKalantari N(2020)Single image HDR reconstruction using a CNN with masked features and perceptual lossACM Transactions on Graphics10.1145/3386569.339240339:4(80:1-80:10)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392403
Hu YZhen RSheikh H(2019)CNN-Based Deghosting in High Dynamic Range Imaging2019 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2019.8803532(4360-4364)Online publication date: Sep-2019
https://doi.org/10.1109/ICIP.2019.8803532
Prabhakar KArora RSwaminathan ASingh KBabu R(2019)A Fast, Scalable, and Reliable Deghosting Method for Extreme Exposure Fusion2019 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCPHOT.2019.8747329(1-8)Online publication date: May-2019
https://doi.org/10.1109/ICCPHOT.2019.8747329
Smith ASingh MMayer-Patel K(2017)A System Model For Frameless Asynchronous High Dynamic Range SensorsProceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video10.1145/3083165.3083178(85-90)Online publication date: 20-Jun-2017
https://dl.acm.org/doi/10.1145/3083165.3083178
Seshadrinathan KNestares O(2017)High dynamic range imaging using camera arrays2017 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2017.8296376(725-729)Online publication date: 17-Sep-2017
https://dl.acm.org/doi/10.1109/ICIP.2017.8296376
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents