Working with Color: How Color Quantization Can Aid Researchers of Problematic Information
Pages 275 - 282
Abstract
Analyzing large sets of visual media remains a challenging task, particularly in mixed-method studies dealing with problematic information and human subjects. Using AI tools in such analyses risks reifying and exacerbating biases, as well as untenable computational and cost limitations. As such, we turn to adopting geometric computer graphics and vision methods towards analyzing a large set of images from a problematic information campaign, in conjunction with human-in-the-loop qualitative analysis. We illustrate an effective case of this approach with the implementation of color quantization towards analyzing online hate image at the US-Mexico border, along with a historicist trace of the history of color quantization and skin tone scales, to inform our usage and reclamation of these methodologies from their racist origins. To that end, we scaffold motivations and the need for more researchers to consider the advantages and risks of reclaiming such methodologies in their own work, situated in our case study.
References
[1]
[n. d.]. Hate Symbol Directory. https://globalextremism.org/global-extremistsymbols- database/
[2]
Rakhsith L. A, Anusha K. S, Karthik B. E, Arun Nithish D, and Kishore Kumar V. 2021. A Survey on Object Detection Methods in Deep Learning. In 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC). 1619--1626. https://doi.org/10.1109/ICESC51422.2021.9532809
[3]
Lasse F Wolff Anthony, Benjamin Kanding, and Raghavendra Selvan. 2020. Carbontracker: Tracking and predicting the carbon footprint of training deep learning models. arXiv preprint arXiv:2007.03051 (2020).
[4]
Andrew Beers, Joseph S. Schafer, Ian Kennedy, Morgan Wack, Emma S. Spiro, and Kate Starbird. 2023. Followback Clusters, Satellite Audiences, and Bridge Nodes: Coengagement Networks for the 2020 US Election. Proceedings of the International AAAI Conference on Web and Social Media 17 (June 2023), 59--71. https://doi.org/10.1609/icwsm.v17i1.22126
[5]
Kratika Bhagtani, Amit Kumar Singh Yadav, Emily R. Bartusiak, Ziyue Xiang, Ruiting Shao, Sriram Baireddy, and Edward J. Delp. 2022. An Overview of Recent Work in Media Forensics: Methods and Threats. https://doi.org/10.48550/arXiv. 2204.12067 arXiv:2204.12067 [cs].
[6]
Raj Bhopal. 2007. The beautiful skull and Blumenbachs errors: the birth of the scientific concept of race. BMJ : British Medical Journal 335, 7633 (Dec. 2007), 1308--1309. https://doi.org/10.1136/bmj.39413.463958.80
[7]
Nadya Bliss, Elizabeth Bradley, Joshua Garland, Filippo Menczer, ScottW. Ruston, Kate Starbird, and Chris Wiggins. 2020. An Agenda for Disinformation Research. https://doi.org/10.48550/arXiv.2012.08572 arXiv:2012.08572 [cs].
[8]
Prashant Bordia and Nicholas Difonzo. 2004. Problem Solving in Social Interactions on the Internet: Rumor As Social Cognition. Social Psychology Quarterly 67, 1 (March 2004), 33--49. https://doi.org/10.1177/019027250406700105 Publisher: SAGE Publications Inc.
[9]
G. Bradski. 2000. The OpenCV Library. Dr. Dobbs Journal of Software Tools (2000).
[10]
Amy Bruckman. 2024. Surviving the AI Summer. https://asbruckman.medium. com/surviving-the-ai-summer-64626e5547e3
[11]
Luc Brun and Alain Trémeau. 2017. Color quantization. In Digital color imaging handbook. CRC press, 589--637.
[12]
Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency. PMLR, 77--91. https: //proceedings.mlr.press/v81/buolamwini18a.html ISSN: 2640--3498.
[13]
Rainer Böhme, Felix C. Freiling, Thomas Gloe, and Matthias Kirchner. 2009. Multimedia Forensics Is Not Computer Forensics. In Computational Forensics (Lecture Notes in Computer Science), Zeno J. M. H. Geradts, Katrin Y. Franke, and Cor J. Veenman (Eds.). Springer, Berlin, Heidelberg, 90--103. https://doi.org/10. 1007/978--3--642-03521-0_9
[14]
Vladimir Chernov, Jarmo Alander, and Vladimir Bochko. 2015. Integer-based accurate conversion between RGB and HSV color spaces. Computers & Electrical Engineering 46 (2015), 328--337.
[15]
Matteo Cinelli, Andra Pelicon, Igor Mozeti, Walter Quattrociocchi, Petra Kralj Novak, and Fabiana Zollo. 2021. Dynamics of online hate and misinformation. Scientific Reports 11, 1 (Nov. 2021), 22083. https://doi.org/10.1038/s41598-021- 01487-w
[16]
United States Holocaust Memorial Museum Collection. [n. d.]. Tool used to classify skin color in racial studies conducted in Nazi Germany. https: //collections.ushmm.org/search/catalog/irn564926
[17]
Wikimedia Commons. 2020. File:RGBCube b.svg Wikimedia Commons, the free media repository. https://commons.wikimedia.org/w/index.php?title=File: RGBCube_b.svg&oldid=452251057 [Online; accessed 23-May-2024].
[18]
Dharma Dailey and Kate Starbird. 2015. "Its Raining Dispersants": Collective Sensemaking of Complex Information in Crisis Contexts. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing. ACM, Vancouver BC Canada, 155--158. https://doi.org/10. 1145/2685553.2698995
[19]
Priya Dhawka, Helen Ai He, and Wesley Willett. 2023. We are the Data: Challenges and Opportunities for Creating Demographically Diverse Anthropographics. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--14. https://doi.org/10.1145/3544548.3581086
[20]
Hany Farid. 2020. Image Forensics. In Computer Vision. Springer International Publishing, Cham, 1--10. https://doi.org/10.1007/978--3-030-03243--2_877--1
[21]
Sourojit Ghosh and Aylin Caliskan. 2023. Person == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusion. In Findings of the Association for Computational Linguistics: EMNLP 2023, Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 6971--6985. https://doi.org/10.18653/v1/2023.findingsemnlp. 465
[22]
P Goon, C Banfield, O Bello, and NJ Levell. 2021. Skin cancers in skin types IV--VI: does the Fitzpatrick scale give a false sense of security? Skin health and disease 1, 3 (2021), e40.
[23]
Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books.
[24]
Courtney M. Heldreth, Ellis P. Monk, Alan T. Clark, Candice Schumann, Xango Eyee, and Susanna Ricco. 2024. Which Skin Tone Measures Are the Most Inclusive? An Investigation of Skin Tone Measures for Artificial Intelligence. ACM Journal on Responsible Computing 1, 1 (March 2024), 7:1--7:21. https: //doi.org/10.1145/3632120
[25]
Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih. 1999. Spatial Color Indexing and Applications. International Journal of Computer Vision 35, 3 (Dec. 1999), 245--268. https://doi.org/10.1023/A:1008108327226
[26]
Caroline Jack. 2017. Lexicon of lies: Terms for problematic information. (2017).
[27]
Jasser Jasser. 2019. Dynamics of Misinformation Cascades. In Companion Proceedings of The 2019 World Wide Web Conference (WWW '19). Association for Computing Machinery, New York, NY, USA, 33--36. https://doi.org/10.1145/ 3308560.3314194
[28]
TERRENCE J Keating, PR Wolf, and FL Scarpace. 1975. An improved method of digital image correlation. Photogrammetric Engineering and Remote Sensing 41, 8 (1975), 993--1002.
[29]
Brit Kelley and Stephanie Weaver. 2020. Researching People who (Probably) Hate You: When Practicing Good Ethics Means Protecting Yourself. Computers and Composition 56 (June 2020), 102567. https://doi.org/10.1016/j.compcom.2020. 102567
[30]
Zarine Kharazian, Madeline Jalbert, Saloni Dash, Shahan Ali Memon, Kate Starbird, Emma Spiro, and JevinWest. 2024. Our field was built on decades-old bodies of research across a range of disciplines. It wasnt invented by a class of misinformation experts in 2016. https://www.cip.uw.edu/2024/01/24/misinformationfield- research/
[31]
Jae Yeon Kim and Aniket Kesari. 2021. Misinformation and Hate Speech: The Case of Anti-Asian Hate Speech During the COVID-19 Pandemic. Journal of Online Trust and Safety 1, 1 (Oct. 2021). https://doi.org/10.54501/jots.v1i1.13 Section: Peer-reviewed Articles.
[32]
Sukwon Lee, Sung-Hee Kim, Ya-Hsin Hung, Heidi Lam, Youn-Ah Kang, and Ji Soo Yi. 2016. How do People Make Sense of Unfamiliar Visualizations?: A Grounded Model of Novice?s Information Visualization Sensemaking. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 499--508. https: //doi.org/10.1109/TVCG.2015.2467195
[33]
Audre Lorde. 2018. The masters tools will never dismantle the masters house. Penguin UK.
[34]
Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Yong, Juhyun Lee, Wan-Teh Chang, Wei Hua, Manfred Georg, and Matthias Grundmann. 2019. MediaPipe: A Framework for Perceiving and Processing Reality. In Third Workshop on Computer Vision for AR/VR at IEEE Computer Vision and Pattern Recognition (CVPR) 2019. https://mixedreality.cs.cornell.edu/s/NewTitle_May1_MediaPipe_CVPR_ CV4ARVR_Workshop_2019.pdf
[35]
Nina Lutz. 2020. Cuties, Netflix, and Computation. https://ninalutz.medium. com/cuties-netflix-and-computation-colors-b89a3ec302b1
[36]
Lena Mamykina, Drashko Nakikj, and Noemie Elhadad. 2015. Collective Sensemaking in Online Health Forums. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3217--3226. https://doi.org/10.1145/2702123.2702566
[37]
Lev Manovich. 2020. Chapter 10 - media visualization. The MIT Press. https: //doi.org/10.7551/mitpress/11214.001.0001
[38]
Philipp Mayring. 2015. Qualitative content analysis: Theoretical background and procedures. Approaches to qualitative research in mathematics education: Examples of methodology and methods (2015), 365--380.
[39]
Juan Carlos Medina Serrano, Orestis Papakyriakopoulos, and Simon Hegelich. 2020. Dancing to the Partisan Beat: A First Analysis of Political Communication on TikTok. In 12th ACM Conference on Web Science. ACM, Southampton United Kingdom, 257--266. https://doi.org/10.1145/3394231.3397916
[40]
Kate M. Miltner. 2021. One part politics, one part technology, one part history: Racial representation in the Unicode 7.0 emoji set. New Media & Society 23, 3 (March 2021), 515--534. https://doi.org/10.1177/1461444819899623 Publisher: SAGE Publications.
[41]
Ellis Monk. 2023. The Monk Skin Tone Scale. (May 2023). https://doi.org/10. 31235/osf.io/pdf4c Publisher: OSF.
[42]
Sadiq Muhammed T and Saji K. Mathew. 2022. The disaster of misinformation: a review of research in social media. International Journal of Data Science and Analytics 13, 4 (2022), 271--285. https://doi.org/10.1007/s41060-022-00311--6
[43]
Ihudiya Finda Ogbonnaya-Ogburu, Angela D.R. Smith, Alexandra To, and Kentaro Toyama. 2020. Critical Race Theory for HCI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3313831.3376392
[44]
Onook Oh, Manish Agrawal, and H. Raghav Rao. 2013. Anxiety and rumor: exploratory analysis of Twitter posts during the Mumbai terrorist attack. In Rumor and Communication in Asia in the Internet Age. Routledge, 143--155. https://api.taylorfrancis.com/content/chapters/edit/download?identifierName=doi&identifierValue=10.4324/9780203403327--9&type=chapterpdf
[45]
Onook Oh, Manish Agrawal, and H. Raghav Rao. 2013. Community Intelligence and Social Media Services: A Rumor Theoretic Analysis of Tweets During Social Crises. MIS Quarterly 37, 2 (2013), 407--426. http://www.jstor.org/stable/43825916 Publisher: Management Information Systems Research Center, University of Minnesota.
[46]
M.T. Orchard and C.A. Bouman. 1991. Color quantization of images. IEEE Transactions on Signal Processing 39, 12 (Dec. 1991), 2677--2690. https://doi.org/ 10.1109/78.107417
[47]
Ray Oshikawa, Jing Qian, and William YangWang. 2020. A Survey on Natural Language Processing for Fake News Detection. In Proceedings of the Twelfth Language Resources and Evaluation Conference, Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, and Stelios Piperidis (Eds.). European Language Resources Association, Marseille, France, 6086--6093. https://aclanthology.org/2020.lrec-1.747
[48]
Britt Paris and Joan Donovan. 2019. Deepfakes and Cheap Fakes. https: //datasociety.net/library/deepfakes-and-cheap-fakes/ Publisher: Data & Society Research Institute.
[49]
Ralph W. Pridmore. 2011. Complementary colors theory of color vision: Physiology, color mixture, color constancy and color perception. Color Research & Application 36, 6 (2011), 394--412. https://doi.org/10.1002/col.20611 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/col.20611
[50]
Stephen Prochaska, Kayla Duskin, Zarine Kharazian, Carly Minow, Stephanie Blucker, Sylvie Venuto, Jevin D. West, and Kate Starbird. 2023. Mobilizing Manufactured Reality: How Participatory Disinformation Shaped Deep Stories to Catalyze Action during the 2020 U.S. Presidential Election. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 1--39. https://doi.org/10.1145/3579616
[51]
Alexander Robertson, Walid Magdy, and Sharon Goldwater. 2018. Self- Representation on Twitter Using Emoji Skin Color Modifiers. Proceedings of the International AAAI Conference on Web and Social Media 12, 1 (June 2018). https://doi.org/10.1609/icwsm.v12i1.15055 Number: 1.
[52]
Alexander Robertson,Walid Magdy, and Sharon Goldwater. 2021. Black or White but Never Neutral: How Readers Perceive Identity from Yellow or Skin-toned Emoji. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 350:1--350:23. https://doi.org/10.1145/3476091
[53]
Nicolaas Rupke and Gerhard Lauer. 2018. Johann Friedrich Blumenbach: race and natural history, 1750--1850. Routledge.
[54]
Joseph S. Schafer, Brett A. Halperin, Sourojit Ghosh, and Julie Vera. 2024. TO SCREENSHOT OR NOT TO SCREENSHOT? TENSIONS IN REPRESENTING VISUAL SOCIAL MEDIA PLATFORM POSTS. In AoIR Selected Papers of Internet Research. Sheffield, United Kingdom.
[55]
Joseph S. Schafer, Kate Starbird, and Daniela K. Rosner. 2023. Participatory Design and Power in Misinformation, Disinformation, and Online Hate Research. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS '23). Association for Computing Machinery, New York, NY, USA, 1724--1739. https://doi.org/10.1145/3563657.3596119
[56]
Morgan Klaus Scheuerman, Kandrea Wade, Caitlin Lustig, and Jed R. Brubaker. 2020. How Weve Taught Algorithms to See Identity: Constructing Race and Gender in Image Databases for Facial Analysis. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 58 (may 2020), 35 pages. https://doi.org/10.1145/3392866
[57]
Tomotsu Shibutani. 1966. Improvised news: A sociological study of rumor. Bobbs- Merrill, Oxford, England. Pages: x, 262.
[58]
Li Shuhua and Guo Gaizhi. 2010. The application of improved HSV color space model in image processing. In 2010 2nd International Conference on Future Computer and Communication, Vol. 2. Ieee, V2--10.
[59]
John R Smith and Shih-Fu Chang. 1996. Tools and techniques for color image retrieval. In Storage and retrieval for still image and video databases iv, Vol. 2670. SPIE, 426--437.
[60]
Robert Soden, David Ribes, Seyram Avle, and Will Sutherland. 2021. Time for Historicism in CSCW: An Invitation. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 459:1--459:18. https://doi.org/10.1145/3479603
[61]
Kate Starbird, Renée DiResta, and Matt DeButts. 2023. Influence and Improvisation: Participatory Disinformation during the 2020 US Election. Social Media Society 9, 2 (2023), 20563051231177943. https://doi.org/10.1177/20563051231177943 arXiv:https://doi.org/10.1177/20563051231177943
[62]
Kate Starbird, Emma Spiro, Isabelle Edwards, Kaitlyn Zhou, Jim Maddock, and Sindhuja Narasimhan. 2016. Could This Be True?: I Think So! Expressed Uncertainty in Online Rumoring. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 360--371. https://doi.org/10.1145/2858036.2858551
[63]
CM Sukanya, Roopa Gokul, and Vince Paul. 2016. A survey on object recognition methods. International Journal of Science, Engineering and Computer Technology 6, 1 (2016), 48.
[64]
Sabine Süsstrunk, Robert Buckley, and Steve Swen. 1999. Standard RGB color spaces. In Color and imaging conference, Vol. 7. Society of Imaging Science and Technology, 127--134.
[65]
Anna K Swiatoniowski, Ellen E Quillen, Mark D Shriver, and Nina G Jablonski. 2013. Comparing von Luschan skin color tiles and modern spectrophotometry for measuring human skin pigmentation. American journal of physical anthropology 151, 2 (2013), 325--330. Publisher: Wiley Online Library.
[66]
William Thong, Przemyslaw Joniak, and Alice Xiang. 2023. Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color. arXiv:2309.05148 [cs.CV]
[67]
Maxim Tkachenko, Mikhail Malyuk, Andrey Holmanyuk, and Nikolai Liubimov. 2020--2022. Label Studio: Data labeling software. https:// github.com/heartexlabs/label-studio Open source software available from https://github.com/heartexlabs/label-studio.
[68]
Sara Vieweg, Leysia Palen, Sophia B. Liu, Amanda L. Hughes, and Jeannette N. Sutton. 2008. Collective intelligence in disaster: Examination of the phenomenon in the aftermath of the 2007 Virginia Tech Shooting. In Proceedings of ISCRAM 2008 -- 5th International Conference on Information Systems for Crisis Response and Management, F. Fiedrich and B Van de Walle (Eds.). Information Systems for Crisis Response and Management, ISCRAM, Washington, DC, 44--54. http: //idl.iscram.org/files/vieweg/2008/1051_Vieweg_etal2008.pdf ISSN: 2411--3387 Journal Abbreviation: ISCRAM 2008.
[69]
YuanWang, Yukun Li, Xinning Gui, Yubo Kou, and Fenglian Liu. 2019. Culturally- Embedded Visual Literacy: A Study of Impression Management via Emoticon, Emoji, Sticker, and Meme on Social Media in China. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 68:1--68:24. https://doi.org/ 10.1145/3359170
[70]
Karl E. Weick, Kathleen M. Sutcliffe, and David Obstfeld. 2005. Organizing and the Process of Sensemaking. Organization Science 16, 4 (2005), 409--421. https://doi.org/10.1287/orsc.1050.0133 arXiv:https://doi.org/10.1287/orsc.1050.0133
[71]
AdrienneWerle. 2019. Beyond Light, Medium, and Dark: Diversity and Inclusivity in the Makeup and Beauty Industries. (2019).
[72]
Zhengxia Zou, Keyan Chen, Zhenwei Shi, Yuhong Guo, and Jieping Ye. 2023. Object Detection in 20 Years: A Survey. Proc. IEEE 111, 3 (2023), 257--276. https://doi.org/10.1109/JPROC.2023.3238524
Index Terms
- Working with Color: How Color Quantization Can Aid Researchers of Problematic Information
Recommendations
Comparative analysis of the quantization of color spaces on the basis of the CIELAB color-difference formula
This article discusses the CIELAB color spave within the limits of optimal colors including the complete volume of object colors. A graphical representation of this color space is composed of planes of constant lightness L* with an net of lines parallel ...
DWT-based scene-adaptive color quantization
Special issue on multi-dimensional image processingColor quantization is the process of reducing the number of colors in an image. That is, color quantization maps a large number of colors into a much smaller number of representative colors while keeping color distortion to an acceptable level. The ...
Colour quantization with Ant-tree
Graphical abstractDisplay Omitted HighlightsThe Ant-tree clustering algorithm is adapted for colour quantization.The algorithm performs the two basic operations of colour quantization.A threshold determines if a pixel is associated to the most similar ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2024
755 pages
ISBN:9798400711145
DOI:10.1145/3678884
- General Chairs:
- Rosta Farzan,
- Claudia López,
- Program Chairs:
- Daniel Cardoso Llach,
- Daniele Quercia,
- Maryam Mustafa,
- Shuo Niu,
- Marisol Wong-Villacrés
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 November 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
CSCW '24
Sponsor:
CSCW '24: The 27th ACM Conference on Computer-Supported Cooperative Work and Social Computing
November 9 - 13, 2024
San Jose, Costa Rica
Acceptance Rates
Overall Acceptance Rate 2,235 of 8,521 submissions, 26%
Upcoming Conference
CSCW '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 64Total Downloads
- Downloads (Last 12 months)64
- Downloads (Last 6 weeks)15
Reflects downloads up to 04 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in