research-article

Gamut Extension for Cinema

Authors:

Syed Waqas Zamir,

Javier Vazquez-Corral,

Marcelo BertalmioAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 26, Issue 4

Pages 1595 - 1606

https://doi.org/10.1109/TIP.2017.2661404

Published: 01 April 2017 Publication History

Abstract

Emerging display technologies are able to produce images with a much wider color gamut than those of conventional distribution gamuts for cinema and TV, creating an opportunity for the development of gamut extension algorithms (GEAs) that exploit the full color potential of these new systems. In this paper, we present a novel GEA, implemented as a PDE-based optimization procedure related to visual perception models, that performs gamut extension (GE) by taking into account the analysis of distortions in hue, chroma, and saturation. User studies performed using a digital cinema projector under cinematic (low ambient light, large screen) conditions show that the proposed algorithm outperforms the state of the art, producing gamut extended images that are perceptually more faithful to the wide-gamut ground truth, as well as free of color artifacts and hue shifts. We also show how currently available image quality metrics, when applied to the GE problem, provide results that do not correlate with users’ choices.

References

[1]

Accessed on 13, 2016. {Online}. Available: http://spectrum.ieee.org/consumer-electronics/audiovideo/lasers-coming-to-a-theaternear-you

[2]

Accessed on 13, 2016. {Online}. Available: http://www.barco.com/en/Products-Solutions/Projectors/Digital-cinema-projectors/2K-Digitalcinema-projector-for-screens-up-to-12m-40ft.aspx

[3]

SMPTE Recommended Practice-D-Cinema Quality—Reference Projector and Environment, <std-organization>IEEE</std-organization> Standard RP 431-2:2011, 2011.

[4]

A. Alsam and I. Farup, “Spatial colour gamut mapping by orthogonal projection of gradients onto constant hue lines,” in Proc. 8th Int. Symp. Vis. Comput., 2012, pp. 556–565.

[5]

H. Anderson, E. Garcia, and M. Gupta, “Gamut expansion for video and image sets,” in Proc. 14th Int. Conf. Image Anal. Process.-Workshops, 2007, pp. 188–191.

Digital Library

[6]

Z. Barańczuk, P. Zolliker, and J. Giesen, “Image quality measures for evaluating gamut mapping,” in Proc. Color Imag. Conf., 2009, pp. 21–26.

[7]

R. S. Berns, “The mathematical development of CIE TC 1-29 proposed colour difference equation: CIELCH,” in Proc. 7th Congr. Int. Colour Assoc., 1993, pp. 19.1–19.4.

[8]

M. Bertalmío, Image Processing for Cinema, vol. Volume 4 . New York, NY, USA: Taylor & Francis, 2014.

[9]

M. Bertalmío, V. Caselles, E. Provenzi, and A. Rizzi, “Perceptual color correction through variational techniques,” IEEE Trans. Image Process., vol. Volume 16, no. Issue 4, pp. 1058–1072, 2007.

Digital Library

[10]

Parameter Values for Ultra-High Definition Television Systems for Production and International Programme Exchange, document ITU-R Rec. BT.2020, 2012.

[11]

Parameter Values for the HDTV Standards for Production and International Programme Exchange, document ITU-R Rec. BT.709-5, 2002.

[12]

S. E. Casella, R. L. Heckaman, and M. D. Fairchild, “Mapping standard image content to wide-gamut displays,” in Proc. Color Imag. Conf., 2008, pp. 106–111.

[13]

A. M. Eskicioglu and P. S. Fisher, “Image quality measures and their performance,” IEEE Trans. Commun., vol. Volume 43, no. Issue 12, pp. 2959–2965, 1995.

[14]

E. A. Fedorovskaya, H. de Ridder, and F. J. J. Blommaert, “Chroma variations and perceived quality of color images of natural scenes,” Color Res. Appl., vol. Volume 22, no. Issue 2, pp. 96–110, 1997.

[15]

E. François, C. Fogg, Y. He, X. Li, A. Luthra, and C. Segall, “High dynamic range and wide color gamut video coding in HEVC: Status and potential future enhancements,” IEEE Trans. Circuits Syst. Video Technol., vol. Volume 26, no. Issue 1, pp. 63–75, 2016.

[16]

J. Froehlich et al., “Encoding color difference signals for high dynamic range and wide gamut imagery,” in Proc. Color Imag. Conf., 2015, pp. 240–247.

[17]

J. Y. Hardeberg, E. Bando, and M. Pedersen, “Evaluating colour image difference metrics for gamut-mapped images,” Coloration Technol., vol. Volume 124, no. Issue 4, pp. 243–253, 2008.

[18]

R. L. Heckaman and J. Sullivan, “Rendering digital cinema and broadcast TV content to wide gamut display media,” in SID Symp. Dig. Tech. Papers, 2011. vol. Volume 42, no. Issue 1, pp. 225–228.

[19]

T. Hoshino, “A preferred color reproduction method for the HDTV digital still image system,” in Proc. IST Symp. Electron. Photogr., 1991, pp. 27–32.

[20]

T. Hoshino, “Color estimation method for expanding a color image for reproduction in a different color gamut,” <patent country=US>U.S. Patent 5 317 426</patent>, 31, 1994.

[21]

B. H. Kang, J. Morovič, M. R. Luo, and M. S. Cho, “Gamut compression and extension algorithms based on observer experimental data,” ETRI J., vol. Volume 25, no. Issue 3, pp. 156–170, 2003.

[22]

M. C. Kim, Y. C. Shin, Y. R. Song, S. J. Lee, and I. D. Kim, “Wide gamut multi-primary display for HDTV,” in Proc. 2nd Eur. Conf. Color Graph., Imag. Vis., 2004, pp. 248–253.

[23]

Y. Kusakabe, Y. Iwasaki, and Y. Nishida, “Wide-color-gamut super hi–vision projector,” in Proc. ITE Annu. Conv., Boston, MA, USA, 2013.

[24]

J. Laird, R. Muijs, and J. Kuang, “Development and evaluation of gamut extension algorithms,” Color Res. Appl., vol. Volume 34, no. Issue 6, pp. 443–451, 2009.

[25]

E. H. Land, “The retinex theory of color vision,” Sci. Amer., vol. Volume 237, no. Issue 6, pp. 108–128, 1977.

[26]

Y. Li, G. Song, and H. Li, “A multilevel gamut extension method for wide gamut displays,” in Proc. Int. Conf. Electr. Inf. Control Eng. (ICEICE), 2011, pp. 1035–1038.

[27]

I. Lissner, J. Preiss, P. Urban, M. S. Lichtenauer, and P. Zolliker, “Image-difference prediction: From grayscale to color,” IEEE Trans. Image Process., vol. Volume 22, no. Issue 2, pp. 435–446, 2013.

Digital Library

[28]

M. R. Luo, G. Cui, and B. Rigg, “The development of the CIE 2000 colour-difference formula: CIEDE2000,” Color Res. Appl., vol. Volume 26, no. Issue 5, pp. 340–350, 2001.

[29]

J. Morovič, “To develop a universal gamut mapping algorithm,” Ph.D. dissertation, <institution content-type=division>Color Imag. Inst</institution>., <institution content-type=institution>Univ. Derby</institution>, Buxton, U.K., 1998.

[30]

J. Morovič, Color Gamut Mapping, vol. Volume 10 . Hoboken, NJ, USA: Wiley, 2008.

Digital Library

[31]

R. Muijs, J. Laird, J. Kuang, and S. Swinkels, “Subjective evaluation of gamut extension methods for wide-gamut displays,” in Proc. 13th Int. Display Workshop, 2006, pp. 1429–1432.

[32]

S. Nakauchi, S. Hatanaka, and S. Usui, “Color gamut mapping based on a perceptual image difference measure,” Color Res. Appl., vol. Volume 24, no. Issue 4, pp. 280–291, 1999.

[33]

H. Pan and S. Daly, “A gamut-mapping algorithm with separate skin and non-skin color preference controls for wide-color-gamut TV,” in SID Symp. Dig. Tech. Papers, 2008, vol. Volume 39 . no. Issue 1, pp. 1363–1366.

[34]

M. R. Pointer, “The gamut of real surface colours,” Color Res. Appl., vol. Volume 5, no. Issue 3, pp. 145–155, 1980.

[35]

C. Poynton, J. Stessen, and R. Nijland, “Deploying wide color gamut and high dynamic range in HD and UHD,” SMPTE Motion Imag. J., vol. Volume 124, no. Issue 3, pp. 37–49, 2015.

[36]

J. Preiss, F. Fernandes, and P. Urban, “Color-image quality assessment: From prediction to optimization,” IEEE Trans. Image Process., vol. Volume 23, no. Issue 3, pp. 1366–1378, 2014.

Digital Library

[37]

G. Sharma, Digital Color Imaging Handbook . Boca Raton, FL, USA: CRC Press, 2002.

Digital Library

[38]

B. D. Silverstein, A. F. Kurtz, J. R. Bietry, and G. E. Nothhard, “A laser-based digital cinema projector,” in SID Symp. Dig. Tech. Papers, vol. Volume 42, no. Issue 1, pp. 326–329, 2011.

[39]

L. L. Thurstone, “A law of comparative judgment,” Psychol. Rev., vol. Volume 34, no. Issue 4, pp. 273–286, 1927.

[40]

A. Van Hurkman, Color Correction Handbook: Professional Techniques for Video and Cinema . Upper Saddle River, NJ, USA: Pearson Education, 2013.

Digital Library

[41]

S. W. Zamir, J. Vazquez-Corral, and M. Bertalmío, “Gamut mapping in cinematography through perceptually-based contrast modification,” IEEE J. Sel. Topics Signal Process., vol. Volume 8, no. Issue 3, pp. 490–503, 2014.

[42]

S. W. Zamir, J. Vazquez-Corral, and M. Bertalmío, “Gamut extension for cinema: Psychophysical evaluation of the state of the art, and a new algorithm,” Proc. IS&T/SPIE Electron. Imag., 2015, pp. 1–12.

Cited By

Yao MHe DLi XPan ZXiong Z(2023)Bidirectional Translation Between UHD-HDR and HD-SDR VideosIEEE Transactions on Multimedia10.1109/TMM.2023.323965625(8672-8686)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2023.3239656
Lee JVigier TLe Callet PLee J(2021)Wide Color Gamut Image Content Characterization: Method, Evaluation, and ApplicationsIEEE Transactions on Multimedia10.1109/TMM.2020.303202623(3817-3827)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1109/TMM.2020.3032026

Recommendations

Color Gamut Extension by Projector-Camera System
Advances in Visual Computing
Abstract
The color gamut of printing devices is generally smaller than that of imaging devices. Therefore, vivid color images cannot be reproduced on printed materials. This paper proposes a color gamut extension system for printed images by using a ...
Color gamut extension by projector-camera system
ISVC'10: Proceedings of the 6th international conference on Advances in visual computing - Volume Part I

The color gamut of printing devices is generally smaller than that of imaging devices. Therefore, vivid color images cannot be reproduced on printed materials. This paper proposes a color gamut extension system for printed images by using a projector-...
Psychophysical evaluation of gamut mapping techniques using simple rendered images and artificial gamut boundaries

Using a paired comparison paradigm, various gamut mapping algorithms were evaluated using simple rendered images and artificial gamut boundaries. The test images consisted of simple rendered spheres floating in front of a gray background. Using CIELAB ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 26, Issue 4

April 2017

526 pages

ISSN:1057-7149

Issue’s Table of Contents

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 01 April 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yao MHe DLi XPan ZXiong Z(2023)Bidirectional Translation Between UHD-HDR and HD-SDR VideosIEEE Transactions on Multimedia10.1109/TMM.2023.323965625(8672-8686)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2023.3239656
Lee JVigier TLe Callet PLee J(2021)Wide Color Gamut Image Content Characterization: Method, Evaluation, and ApplicationsIEEE Transactions on Multimedia10.1109/TMM.2020.303202623(3817-3827)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1109/TMM.2020.3032026

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents