research-article

Constrained palette-space exploration

Authors:

Nicolas Mellado,

David Vanderhaeghe,

Charlotte Hoarau,

Sidonie Christophe,

Mathieu Brédif,

Loic BartheAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 36, Issue 4

Article No.: 60, Pages 1 - 14

https://doi.org/10.1145/3072959.3073650

Published: 20 July 2017 Publication History

Abstract

Color palettes are widely used by artists to define colors of artworks and explore color designs. In general, artists select the colors of a palette by following a set of rules, e.g. contrast or relative luminance. Existing interactive palette exploration tools explore palette spaces following limited constraints defined as geometric configurations in color space e.g. harmony rules on the color wheel. Palette search algorithms sample palettes from color relations learned from an input dataset, however they cannot provide interactive user edits and palette refinement.

We introduce in this work a new versatile formulation enabling the creation of constraint-based interactive palette exploration systems. Our technical contribution is a graph-based palette representation, from which we define palette exploration as a minimization problem that can be solved efficiently and provide real-time feedback. Based on our formulation, we introduce two interactive palette exploration strategies: constrained palette exploration, and for the first time, constrained palette interpolation. We demonstrate the performances of our approach on various application cases and evaluate how it helps users finding trade-offs between concurrent constraints.

Supplementary Material

ZIP File (a60-mellado.zip)

Supplemental files.

Download
69.36 MB

MP4 File (papers-0304.mp4)

Download
452.05 MB

References

[1]

Adobe. 2015. Kuler. https://color.adobe.com/. (2015). accessed 25/08/2015.

[2]

Jacques Bertin. 1983. Semiology of Graphics: Diagrams, Networks, Maps. University of Wisconsin Press, Madison.

[3]

Cynthia A Brewer. 1994. Color use guidelines for mapping and visualization. Visualization in modern cartography 2 (1994), 123--148.

[4]

Cynthia A. Brewer. 2015. Color Brewer. http://www.ColorBrewer.org. (2015). accessed 25/08/2015.

[5]

Elodie Buard and Anne Ruas. 2009. Processes for improving the colours of topographic maps in the context of Map-on-Demand. In 24th International Cartographic Conference (ICC'09), Santiago de Chile, Chile.

[6]

Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein. 2015. Palette-based Photo Recoloring. ACM Trans. Graph. 34, 4, Article 139 (July 2015), 11 pages.

Digital Library

[7]

Haidong Chen, Ji Wang, Weifeng Chen, Huamin Qu, and Wei Chen. 2014. An image-space energy-saving visualization scheme for OLED displays. Computers & Graphics 38 (2014), 61 -- 68.

Digital Library

[8]

Sidonie Christophe. 2011. Creative colours specification based on knowledge. The Cartographic Journal 48, 2 (May 2011), 138--145.

[9]

Sidonie Christophe, Christine Zanin, and Hugo Roussaffa. 2011. Colours harmony in cartography. In 25th International Cartographic Conference (ICC'11), Paris, France.

[10]

Johnson Chuang, Daniel Weiskopf, and Torsten Möller. 2009. Energy Aware Color Sets. Computer Graphics Forum 28, 2 (2009), 203--211.

[11]

Daniel Cohen-Or, Olga Sorkine, Ran Gal, Tommer Leyvand, and Ying-Qing Xu. 2006. Color Harmonization. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH) 25, 3 (2006), 624--630.

Digital Library

[12]

David R. Flatla, Katharina Reinecke, Carl Gutwin, and Krzysztof Z. Gajos. 2013. SPRWeb: Preserving Subjective Responses to Website Colour Schemes Through Automatic Recolouring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2069--2078.

Digital Library

[13]

Gaël Guennebaud, Benoît Jacob, and others. 2010. Eigen v3. http://eigen.tuxfamily.org. (2010).

[14]

Charlotte Hoarau. 2011. Reaching a Compromise between Contextual Constraints and Cartographic Rules: Application to Sustainable Maps. Cartography and Geographic Information Society Journal 38, 2 (April 2011), 79--88.

[15]

Manabu Ichikawa, Kiyoshi Tanaka, Shoji Kondo, Koji Hiroshima, Kazuo Ichikawa, Shoko Tanabe, and Kiichiro Fukami. 2003. Web-page Color Modification for Barrier-free Color Vision with Genetic Algorithm. In Proceedings of the 2003 International Conference on Genetic and Evolutionary Computation: PartII (GECCO'03). Springer-Verlag, Berlin, Heidelberg, 2134--2146. http://dl.acm.org/citation.cfm?id=1756582.1756698

[16]

J. Itten. 1974. The Art of Color: The Subjective Experience and Objective Rationale of Color. Wiley. https://books.google.fr/books?id=D-skaDZAumIC

[17]

Mathieu Jacomy. 2015. I Want Hue. http://tools.medialab.sciences-po.fr/iwanthue/. (2015). accessed 25/08/2015.

[18]

Anil K. Jain. 1989. Fundamentals of Digital Image Processing. Prentice-Hall, Inc., Upper Saddle River, NJ, USA.

[19]

Ghita Jalal, Nolwenn Maudet, and Wendy E. Mackay. 2015. Color Portraits: From Color Picking to Interacting with Color. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, USA, 4207--4216.

Digital Library

[20]

Laurent Jégou. 2014. Color Gradient Explorer. http://www.geotests.net/couleurs/gradients_inflex_en.html. (2014). accessed 30/11/2015.

[21]

Sharon Lin, Daniel Ritchie, Matthew Fisher, and Pat Hanrahan. 2013. Probabilistic Color-by-numbers: Suggesting Pattern Colorizations Using Factor Graphs. ACM Trans. Graph. 32, 4, Article 37 (July 2013), 12 pages.

Digital Library

[22]

B.J. Meier, A.M. Spalter, and D.B. Karelitz. 2004. Interactive color palette tools. Computer Graphics and Applications, IEEE 24, 3 (May 2004), 64--72.

Digital Library

[23]

Aron Monszpart, Nicolas Mellado, Gabriel Brostow, and Niloy Mitra. 2015. RAPter: Rebuilding Man-made Scenes with Regular Arrangements of Planes. ACM SIGGRAPH 2015 (2015).

Digital Library

[24]

A.H. Munsell and F. Birren. 1973. A Grammar of Color: A Basic Treatise on the Color. Van Nostrand. https://books.google.fr/books?id=s1NSmgEACAAJ

[25]

Naila Murray, Sandra Skaff, Luca Marchesotti, and Florent Perronnin. 2012. Toward automatic and flexible concept transfer. Computers & Graphics 36, 6 (2012), 622 -- 634. 2011 Joint Symposium on Computational Aesthetics, Non-Photorealistic Animation and Rendering, and Sketch-Based Interfaces and Modeling.

Digital Library

[26]

Chuong H. Nguyen, Tobias Ritschel, and Hans-Peter Seidel. 2015. Data-Driven Color Manifolds. ACM Trans. Graph. 34, 2, Article 20 (2015), 9 pages.

Digital Library

[27]

Peter O'Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color Compatibility From Large Datasets. ACM Transactions on Graphics 30, 4 (2011).

Digital Library

[28]

Li-Chen Ou, M. Ronnier Luo, Andrée Woodcock, and Angela Wright. 2004. A study of colour emotion and colour preference. Part I: Colour emotions for single colours. Color Research & Application 29, 3 (2004), 232--240.

[29]

K. Rasche, R. Geist, and J. Westall. 2005. Detail preserving reproduction of color images for monochromats and dichromats. Computer Graphics and Applications, IEEE 25, 3 (May 2005), 22--30.

Digital Library

[30]

Daniel Ritchie, Sharon Lin, Noah D. Goodman, and Pat Hanrahan. 2015. Generating Design Suggestions Under Tight Constraints with Gradient-based Probabilistic Programming. Comput. Graph. Forum 34, 2 (May 2015), 515--526.

Digital Library

[31]

Gaurav Sharma. 2002. Digital Color Imaging Handbook. CRC Press, Inc., Boca Raton, FL, USA.

[32]

Petr Staníček. 2015. Paletton - The Color Scheme Designer. http://paletton.com/. (2015). accessed 25/08/2015.

[33]

Luigi Troiano, Cosimo Birtolo, and Maria Miranda. 2008. Adapting Palettes to Color Vision Deficiencies by Genetic Algorithm. In Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation. ACM, New York, USA, 1065--1072.

Digital Library

[34]

J.W. von Goethe. 1971. Goethe's color theory. Van Nostrand Reinhold. https://books.google.fr/books?id=Z3YpAQAAMAAJ

[35]

Takuto Yanagida, Katsunori Okajima, and Hidenori Mimura. 2015. Color scheme adjustment by fuzzy constraint satisfaction for color vision deficiencies. Color Research & Application 40, 5 (2015), 446--464.

[36]

Lina Zhou, V. Bensal, and Dongsong Zhang. 2014. Color adaptation for improving mobile web accessibility. In Computer and Information Science, IEEE 13th International Conference on. 291.

[37]

L. Zhou and C.D. Hansen. 2015. A Survey of Colormaps in Visualization. Visualization and Computer Graphics, IEEE Transactions on (2015).

Digital Library

Cited By

de la Houssaije WEchevarria JKosinka J(2024)Palette‐Based Recolouring of Gradient MeshesComputer Graphics Forum10.1111/cgf.1525843:7Online publication date: 7-Nov-2024
https://doi.org/10.1111/cgf.15258
Sato SSakurai KMizushima FDobashi Y(2023)An Optimization-based Recoloring System to Theme-Color最適化に基づくテーマカラーへの変換システムThe Journal of the Society for Art and Science10.3756/artsci.22.12_122:4(12_1-12_10)Online publication date: 2023
https://doi.org/10.3756/artsci.22.12_1
Hegemann LDayama NIyer AFarhadi EMarchenko EOulasvirta A(2023)CoColor: Interactive Exploration of Color DesignsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584089(106-127)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584089
Show More Cited By

Index Terms

Constrained palette-space exploration
1. Computing methodologies
  1. Computer graphics

Recommendations

Playful palette: an interactive parametric color mixer for artists

We present Playful Palette, a color picker interface for digital paint programs that derives intuition from oil paint and watercolor palettes, but extends them with digital features. A Playful Palette is a set of blobs of color that blend together to ...
ColorfulCurves: Palette-Aware Lightness Control and Color Editing via Sparse Optimization

Color editing in images often consists of two main tasks: changing hue and saturation, and editing lightness or tone curves. State-of-the-art palette-based recoloring approaches entangle these two tasks. A user's only lightness control is changing the ...
Color Space Selection for Color Image Enhancement Applications
ICSAP '09: Proceedings of the 2009 International Conference on Signal Acquisition and Processing

Device independent, quantitative description of color is a challenging problem. Another problem is that even under equal intensity, some colors are visually brighter than others. Different color representations try to overcome these problems, with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 36, Issue 4

August 2017

2155 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3072959

Issue’s Table of Contents

Copyright © 2017 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2017

Published in TOG Volume 36, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
802
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)4

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

de la Houssaije WEchevarria JKosinka J(2024)Palette‐Based Recolouring of Gradient MeshesComputer Graphics Forum10.1111/cgf.1525843:7Online publication date: 7-Nov-2024
https://doi.org/10.1111/cgf.15258
Sato SSakurai KMizushima FDobashi Y(2023)An Optimization-based Recoloring System to Theme-Color最適化に基づくテーマカラーへの変換システムThe Journal of the Society for Art and Science10.3756/artsci.22.12_122:4(12_1-12_10)Online publication date: 2023
https://doi.org/10.3756/artsci.22.12_1
Hegemann LDayama NIyer AFarhadi EMarchenko EOulasvirta A(2023)CoColor: Interactive Exploration of Color DesignsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584089(106-127)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584089
Niyazov AEns BSatriadi KMellado NBarthe LDwyer TSerrano M(2023)User-Driven Constraints for Layout Optimisation in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580873(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580873
Wu MCheng ZCheng W(2023)An Experimental Evaluation of Kernel Density Estimation to Choose Categorical Map ColoursThe Cartographic Journal10.1080/00087041.2023.2246713(1-17)Online publication date: 14-Nov-2023
https://doi.org/10.1080/00087041.2023.2246713
Karim RJeong THa HHo JLee KShin H(2023)Improving user experience of color palette extraction by using interactive visualization based on hierarchical color modelInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102924169:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102924
CHRISTOPHE SMericskay B(2023)Geovisualization and Cartographic CommunicationCartographic Communication10.1002/9781394265022.ch7(195-227)Online publication date: 22-Dec-2023
https://doi.org/10.1002/9781394265022.ch7
Tojo KUmetani N(2022)Recolorable Posterization of Volumetric Radiance Fields Using Visibility‐Weighted Palette ExtractionComputer Graphics Forum10.1111/cgf.1459441:4(149-160)Online publication date: 30-Jul-2022
https://doi.org/10.1111/cgf.14594
Niyazov AMellado NBarthe LSerrano M(2021)Dynamic DecalsProceedings of the ACM on Human-Computer Interaction10.1145/34885385:ISS(1-27)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488538
kim SChoi S(2021)Dynamic closest color warping to sort and compare palettesACM Transactions on Graphics10.1145/3450626.345977640:4(1-15)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459776
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents