research-article

Colorbo: Envisioned Mandala Coloringthrough Human-AI Collaboration

Authors:

Minsam KoAuthors Info & Claims

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

Pages 15 - 26

https://doi.org/10.1145/3490099.3511135

Published: 22 March 2022 Publication History

Abstract

Mandala coloring is popular among many people, from children to adults, and many studies have revealed its benefits in mental well-being. However, our preliminary study results reveal difficulties in mandala coloring tasks, such as selecting harmonious colors/areas and envisioning how each selection affects the final output. This paper presents Colorbo, an interactive system based on human-AI collaboration to envision mandala coloring. Colorbo and its user colorize a mandala individually by watching each other work. The user shows a colored mandala in progress, and Colorbo fills in the remaining areas by analyzing the patterns and color combinations of the user’s image. Colorbo then projects the complete mandala onto the paper the user is colorizing, and the user continues coloring by envisioning the outcome based on images from Colorbo. We conducted a within-subject study to investigate the effectiveness of Colorbo. Our quantitative and qualitative analysis results show the positive experiences of the participants, concerns regarding the coloring behavior with Colorbo, and their preferred projection method for envisioning a mandala. Finally, based on the findings, we discuss the design implications for human-AI collaboration in the area of art.

References

[1]

[n. d.]. Colorfy: Art Coloring Game on the App Store. https://apps.apple.com/us/app/colorfy-art-coloring-game/id1009442510. (Accessed on 10/07/2021).

[2]

[n. d.]. COLOURlovers: Color Trends + Palettes. https://www.colourlovers.com/palettes. (Accessed on 01/31/2022).

[3]

[n. d.]. Happy Color. https://happycolor.app/. (Accessed on 10/07/2021).

[4]

[n. d.]. Trending color palettes - coolors. https://coolors.co/palettes/trending. (Accessed on 10/07/2021).

[5]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–13.

Digital Library

[6]

Cheryl A Barrett and HSMI NC-BC. 2015. Adult coloring books: Patterns for stress relief. In Phi Kappa Phi Forum, Vol. 95. National Forum: Phi Kappa Phi Journal, 27.

[7]

Luca Benedetti, Holger Winnemöller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with Bob: assisted creativity for novices. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 419–428.

Digital Library

[8]

Marcel Berger. 2009. Geometry i. Springer Science & Business Media.

[9]

Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2017. Enriching Word Vectors with Subword Information. Transactions of the Association for Computational Linguistics 5 (2017), 135–146.

[10]

Yuri Y Boykov and M-P Jolly. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in ND images. In Proceedings eighth IEEE international conference on computer vision. ICCV 2001, Vol. 1. IEEE, 105–112.

[11]

Virginia Braun and Victoria Clarke. 2012. Thematic analysis.(2012).

[12]

Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua. 2010. Brief: Binary robust independent elementary features. In European conference on computer vision. Springer, 778–792.

[13]

Jungwoo Choi, Heeryon Cho, Jinjoo Song, and Sang Min Yoon. 2019. Sketchhelper: Real-time stroke guidance for freehand sketch retrieval. IEEE Transactions on Multimedia 21, 8 (2019), 2083–2092.

[14]

Nancy A Curry and Tim Kasser. 2005. Can coloring mandalas reduce anxiety?Art Therapy 22, 2 (2005), 81–85.

[15]

Claudia Dauden Roquet, Corina Sas, and Dominic Potts. 2021. Exploring Anima: A brain-computer interface for peripheral materialization of mindfulness states during mandala coloring. Human-Computer Interaction(2021).

[16]

Dominik Dellermann, Adrian Calma, Nikolaus Lipusch, Thorsten Weber, Sascha Weigel, and Philipp Ebel. 2021. The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems. arXiv preprint arXiv:2105.03354(2021).

[17]

Daniel Dixon, Manoj Prasad, and Tracy Hammond. 2010. icandraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 897–906.

Digital Library

[18]

Judy Eaton and Christine Tieber. 2017. The effects of coloring on anxiety, mood, and perseverance. Art Therapy 34, 1 (2017), 42–46.

[19]

Matthew Flagg and James M Rehg. 2006. Projector-guided painting. In Proceedings of the 19th annual ACM symposium on User interface software and technology. 235–244.

Digital Library

[20]

Jayde A M Flett, Celia Lie, Benjamin C Riordan, Laura M Thompson, Tamlin S Conner, and Harlene Hayne. 2017. Sharpen your pencils: Preliminary evidence that adult coloring reduces depressive symptoms and anxiety. Creativity research journal 29, 4 (2017), 409–416.

[21]

James D Foley, Foley Dan Van, Andries Van Dam, Steven K Feiner, John F Hughes, and J Hughes. 1996. Computer graphics: principles and practice. Vol. 12110. Addison-Wesley Professional.

[22]

Kaori Fujinami, Mami Kosaka, and Bipin Indurkhya. 2018. Painting an Apple with an Apple: A Tangible Tabletop Interface for Painting with Physical Objects. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1–22.

Digital Library

[23]

Melanie Hartmann. 2009. Challenges in Developing User-Adaptive Intelligent User Interfaces. In LWA. Citeseer, ABIS–6.

[24]

Ming-Kuei Hu. 1962. Visual pattern recognition by moment invariants. IRE transactions on information theory 8, 2 (1962), 179–187.

[25]

Anthony David Jameson. 2009. Understanding and dealing with usability side effects of intelligent processing. AI Magazine 30, 4 (2009), 23–23.

Digital Library

[26]

Carl Gustav Jung. 2014. Collected Works of CG Jung, Volume 4. Princeton University Press.

[27]

Pegah Karimi, Kazjon Grace, Mary Lou Maher, and Nicholas Davis. 2018. Evaluating creativity in computational co-creative systems. arXiv preprint arXiv:1807.09886(2018).

[28]

Pegah Karimi, Jeba Rezwana, Safat Siddiqui, Mary Lou Maher, and Nasrin Dehbozorgi. 2020. Creative sketching partner: an analysis of human-AI co-creativity. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 221–230.

Digital Library

[29]

Joan Kellogg, Margaret Mac Rae, Helen L Bonny, and Francesco Di Leo. 1977. The use of the mandala in psychological evaluation and treatment.American Journal of Art Therapy(1977).

[30]

Heejung S Kim and Deborah Ko. 2007. Culture and self-expression. The self (2007), 325–342.

[31]

Min Hun Lee, Daniel PP Siewiorek, Asim Smailagic, Alexandre Bernardino, and Sergi Bermúdez Bermúdez i Badia. 2021. A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[32]

Sau-Lai Lee. 2018. Why color mandalas? A study of anxiety-reducing mechanisms. Art Therapy 35, 1 (2018), 35–41.

[33]

Zhuying Li, Yan Wang, Wei Wang, Stefan Greuter, and Florian’Floyd’ Mueller. 2020. Empowering a Creative City: Engage Citizens in Creating Street Art through Human-AI Collaboration. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.

Digital Library

[34]

Stuart Lloyd. 1982. Least squares quantization in PCM. IEEE transactions on information theory 28, 2 (1982), 129–137.

Digital Library

[35]

Todd Lubart. 2005. How can computers be partners in the creative process: classification and commentary on the special issue. International Journal of Human-Computer Studies 63, 4-5 (2005), 365–369.

Digital Library

[36]

Fabrice Matulic. 2018. ColourAIze: AI-Driven Colourisation of Paper Drawings with Interactive Projection System. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. 273–278.

Digital Library

[37]

Jon McCormack, Toby Gifford, Patrick Hutchings, Maria Teresa Llano Rodriguez, Matthew Yee-King, and Mark d’Inverno. 2019. In a silent way: Communication between ai and improvising musicians beyond sound. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[38]

Jim Milliot. 2016. Print book sales up again in 2015. Publishers weekly (2016).

[39]

Frank Nielsen. 2016. Hierarchical clustering. In Introduction to HPC with MPI for Data Science. Springer, 195–211.

[40]

Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[41]

Li-Chen Ou and M Ronnier Luo. 2006. A colour harmony model for two-colour combinations. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur 31, 3 (2006), 191–204.

[42]

Amal Dev Parakkat, Sarang Anil Joshi, Uday Bondi Pundarikaksha, and Ramanathan Muthuganapathy. 2017. Sketch and shade: an interactive assistant for sketching and shading. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering. 1–2.

Digital Library

[43]

Claudia Dauden Roquet and Corina Sas. 2019. Digital Wellbeing: Evaluating Mandala Coloring Apps. In Conference on Human Factors in Computing Systems (CHI’19) Workshop: Designing for Digital Wellbeing: A research and practice agenda. ACM.

[44]

Edward Rosten and Tom Drummond. 2006. Machine learning for high-speed corner detection. In European conference on computer vision. Springer, 430–443.

Digital Library

[45]

Carsten Rother, Vladimir Kolmogorov, and Andrew Blake. 2004. ” GrabCut” interactive foreground extraction using iterated graph cuts. ACM transactions on graphics (TOG) 23, 3 (2004), 309–314.

Digital Library

[46]

Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In 2011 International conference on computer vision. Ieee, 2564–2571.

Digital Library

[47]

Alessandro Saffiotti, Peter Fogel, Peter Knudsen, Luis de Miranda, and Oscar Thörn. 2020. On human-AI collaboration in artistic performance. In First International Workshop on New Foundations for Human-Centered AI (NeHuAI) co-located with 24th European Conference on Artificial Intelligence (ECAI 2020), Santiago de Compostella, Spain, September 4, 2020. CEUR-WS, 38–43.

[48]

Karen B Schloss and Stephen E Palmer. 2011. Aesthetic response to color combinations: preference, harmony, and similarity. Attention, Perception, & Psychophysics 73, 2 (2011), 551–571.

[49]

Sally Yeates Sedelow. 1970. The computer in the humanities and fine arts. ACM Computing Surveys (CSUR) 2, 2 (1970), 89–110.

Digital Library

[50]

Ben Shneiderman. 2001. Supporting creativity with advanced information-abundant user interfaces. In Frontiers of human-centered computing, online communities and virtual environments. Springer, 469–480.

[51]

Ben Shneiderman and Pattie Maes. 1997. Direct manipulation vs. interface agents. interactions 4, 6 (1997), 42–61.

[52]

N Shrivastava, Alka Goel, and Sonu Rani. 2019. Adaptation of Mandala art for development of design suitable for textile articles. International journal of Home science 5, 3 (2019), 1–4.

[53]

Maralynn H Slegelis. 1987. A study of Jung’s mandala and its relationship to art psychotherapy.The Arts in Psychotherapy(1987).

[54]

Hirokatsu So, Ichiroh Kanaya, and Kosuke Sato. 2007. Hyperdraw: a new computer aided drawing system based on prediction of drawing action. In Proceedings of the international conference on Advances in computer entertainment technology. 234–235.

Digital Library

[55]

Ivan E. Sutherland. 1963. Sketchpad: A Man-Machine Graphical Communication System. In Proceedings of the May 21-23, 1963, Spring Joint Computer Conference (Detroit, Michigan) (AFIPS ’63 (Spring)). Association for Computing Machinery, New York, NY, USA, 329–346. https://doi.org/10.1145/1461551.1461591

Digital Library

[56]

Anna Trifonova, Salah U Ahmed, and Letizia Jaccheri. 2009. SArt: Towards Innovation at the intersection of Software engineering and art. Information systems development(2009), 809–827.

[57]

Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From human-human collaboration to human-ai collaboration: Designing ai systems that can work together with people. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–6.

Digital Library

[58]

Dakuo Wang, Justin D Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-ai collaboration in data science: Exploring data scientists’ perceptions of automated ai. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–24.

Digital Library

[59]

Daniel Karl I Weidele, Justin D Weisz, Erick Oduor, Michael Muller, Josh Andres, Alexander Gray, and Dakuo Wang. 2020. AutoAIViz: opening the blackbox of automated artificial intelligence with conditional parallel coordinates. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 308–312.

Digital Library

[60]

Miaomiao Wen, Nancy Baym, Omer Tamuz, Jaime Teevan, Susan T Dumais, and Adam Kalai. 2015. OMG UR Funny! Computer-Aided Humor with an Application to Chat. In ICCC. 86–93.

[61]

Kesheng Wu, Ekow Otoo, and Kenji Suzuki. 2009. Optimizing two-pass connected-component labeling algorithms. Pattern Analysis and Applications 12, 2 (2009), 117–135.

Digital Library

[62]

Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 chi conference on human factors in computing systems. 1–13.

Digital Library

[63]

Tom Young, Devamanyu Hazarika, Soujanya Poria, and Erik Cambria. 2018. Recent trends in deep learning based natural language processing. ieee Computational intelligenCe magazine 13, 3 (2018), 55–75.

Cited By

Serbanescu ANack F(2024)Towards an analytical framework for AI-powered creative support systems in interactive digital narrativesJournal of Entrepreneurial Researchers10.29073/jer.v2i1.202:1(097-115)Online publication date: 9-Jul-2024
https://doi.org/10.29073/jer.v2i1.20
Zhou ZLi JZhang ZYu JDuh H(2024)Examining How the Large Language Models Impact the Conceptual Design with Human Designers: A Comparative Case StudyInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2370635(1-17)Online publication date: Jul-2024
https://doi.org/10.1080/10447318.2024.2370635
Lu QPeng X(2024)Differences in Knowledge Adoption Among Task Types in Human-AI Collaboration Under the Chronic Disease Prevention ScenarioWisdom, Well-Being, Win-Win10.1007/978-3-031-57867-0_16(213-231)Online publication date: 10-Apr-2024
https://doi.org/10.1007/978-3-031-57867-0_16
Show More Cited By

Index Terms

Colorbo: Envisioned Mandala Coloringthrough Human-AI Collaboration
1. Computing methodologies
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Index terms have been assigned to the content through auto-classification.

Recommendations

From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Artificial Intelligent (AI) and Machine Learning (ML) algorithms are coming out of research labs into the real-world applications, and recent research has focused a lot on Human-AI Interaction (HAI) and Explainable AI (XAI). However, Interaction is not ...
Mandala Logbook: Internet Address & Password Organizer For Website Address, Login, Username - Anonymous Without An Obvious Title For Security
Internet Password Organizer - Mandala: 5" x 8" 122 pages, 312 spaces to keep track of internet passwords, addresses and usernames.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '22: Proceedings of the 27th International Conference on Intelligent User Interfaces

March 2022

888 pages

ISBN:9781450391443

DOI:10.1145/3490099

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IUI '22

Sponsor:

IUI '22: 27th International Conference on Intelligent User Interfaces

March 22 - 25, 2022

Helsinki, Finland

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
629
Total Downloads

Downloads (Last 12 months)204
Downloads (Last 6 weeks)22

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Serbanescu ANack F(2024)Towards an analytical framework for AI-powered creative support systems in interactive digital narrativesJournal of Entrepreneurial Researchers10.29073/jer.v2i1.202:1(097-115)Online publication date: 9-Jul-2024
https://doi.org/10.29073/jer.v2i1.20
Zhou ZLi JZhang ZYu JDuh H(2024)Examining How the Large Language Models Impact the Conceptual Design with Human Designers: A Comparative Case StudyInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2370635(1-17)Online publication date: Jul-2024
https://doi.org/10.1080/10447318.2024.2370635
Lu QPeng X(2024)Differences in Knowledge Adoption Among Task Types in Human-AI Collaboration Under the Chronic Disease Prevention ScenarioWisdom, Well-Being, Win-Win10.1007/978-3-031-57867-0_16(213-231)Online publication date: 10-Apr-2024
https://doi.org/10.1007/978-3-031-57867-0_16
Qiu QWang XOtani MIwazaki Y(2023)Color Recommendation for Vector Graphic Documents based on Multi-Palette Representation2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00361(3610-3618)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00361
Serbanescu A(2023)Human-AI System Co-creativity to Build Interactive Digital NarrativesMultidisciplinary Aspects of Design10.1007/978-3-031-49811-4_37(388-398)Online publication date: 31-Dec-2023
https://doi.org/10.1007/978-3-031-49811-4_37

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents