Dangers of Designing with Data
Authors: 
Hamed Alavi, 
Jakub MlynarAuthors Info & Claims
Pages 153 - 156
Abstract
In an analytical discussion structured by the framework of social justice, we scrutinize the shift of attention and focus in the HCI and interaction design communities towards “designing with data”. Specifically, acknowledging social justice as a horizon for design research to work towards [10], we investigate the six strategies for social justice as developed by Lötter [24], namely, recognition, reciprocity, enablement, distribution, accountability, and transformation. For each of these dimensions, we demonstrate how the inherent features associated with data-oriented design processes may be a substantial impediment to our attempt toward a more just society.
References
[1]
Hamed S Alavi and Farzaneh Bahrami. 2019. Walking in smart cities. interactions 26, 2 (2019), 66–68.
[2]
Hamed S Alavi, Farzaneh Bahrami, Himanshu Verma, and Denis Lalanne. 2017. Is Driverless Car Another Weiserian Mistake?. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems. 249–253.
[3]
Albert Bandura. 2006. Toward a psychology of human agency. Perspectives on psychological science 1, 2 (2006), 164–180.
[4]
Shaowen Bardzell. 2010. Feminist HCI: taking stock and outlining an agenda for design. In Proceedings of the SIGCHI conference on human factors in computing systems. 1301–1310.
[5]
Reuben Binns. 2017. Fairness in machine learning: Lessons from political philosophy. arXiv preprint arXiv:1712.03586 (2017).
[6]
Arianna Brambilla, Hamed Alavi, Himanshu Verma, Denis Lalanne, Thomas Jusselme, and Marilyne Andersen. 2017. “Our inherent desire for control”: a case study of automation’s impact on the perception of comfort. Energy Procedia 122 (2017), 925–930.
[7]
John M Carroll and Mary Beth Rosson. 2013. Wild at home: the neighborhood as a living laboratory for HCI. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 3 (2013), 1–28.
[8]
Sam Corbett-Davies and Sharad Goel. 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023 (2018).
[9]
Catherine D’ignazio and Lauren F Klein. 2023. Data feminism. MIT press.
[10]
Lynn Dombrowski, Ellie Harmon, and Sarah Fox. 2016. Social justice-oriented interaction design: Outlining key design strategies and commitments. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. 656–671.
[11]
Anthony Dunne and Fiona Raby. 2013. Speculative everything: design, fiction, and social dreaming. MIT press.
[12]
Richard Fitzgerald, William Housley, and Sean Rintel. 2017. Introduction: Membership Categorisation Analysis: Technologies of social action. Journal of Pragmatics 118 (2017), 51–55.
[13]
Alexander Hevelke and Julian Nida-Rümelin. 2015. Responsibility for crashes of autonomous vehicles: an ethical analysis. Science and engineering ethics 21, 3 (2015), 619–630.
[14]
Lars Erik Holmquist. 2017. Intelligence on tap: artificial intelligence as a new design material. interactions 24, 4 (2017), 28–33.
[15]
Sounman Hong and Sun Hyoung Kim. 2016. Political polarization on twitter: Implications for the use of social media in digital governments. Government Information Quarterly 33, 4 (2016), 777–782.
[16]
Lilly Irani. 2015. Hackathons and the making of entrepreneurial citizenship. Science, Technology, & Human Values 40, 5 (2015), 799–824.
[17]
Inge Kaul and Ronald U Mendoza. 2003. Advancing the concept of public goods. Providing global public goods: Managing globalization 78 (2003), 95–98.
[18]
Rochelle King, Elizabeth F Churchill, and Caitlin Tan. 2017. Designing with data: Improving the user experience with A/B testing. " O’Reilly Media, Inc.".
[19]
Francisco Klauser, Till Paasche, and Ola Söderström. 2014. Michel Foucault and the smart city: power dynamics inherent in contemporary governing through code. Environment and Planning D: Society and Space 32, 5 (2014), 869–885.
[20]
Astrid Kunze. 2008. Gender wage gap studies: consistency and decomposition. Empirical Economics 35, 1 (2008), 63–76.
[21]
Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems. 4066–4076.
[22]
Changjun Lee, Jieun Shin, and Ahreum Hong. 2018. Does social media use really make people politically polarized? Direct and indirect effects of social media use on political polarization in South Korea. Telematics and Informatics 35, 1 (2018), 245–254.
[23]
Jamy Li, Xuan Zhao, Mu-Jung Cho, Wendy Ju, and Bertram F Malle. 2016. From trolley to autonomous vehicle: Perceptions of responsibility and moral norms in traffic accidents with self-driving cars. Technical Report. SAE Technical Paper.
[24]
Hennie Lötter. 2011. Poverty, ethics and justice. University of Wales Press.
[25]
Friederike Mengel, Jan Sauermann, and Ulf Zölitz. 2019. Gender bias in teaching evaluations. Journal of the European economic association 17, 2 (2019), 535–566.
[26]
Jakub Mlynář and Ilkka Arminen. 2023. Respecifying social change: the obsolescence of practices and the transience of technology. Frontiers in Sociology 8 (2023), 1222734.
[27]
Jakub Mlynář, Farzaneh Bahrami, André Ourednik, Nico Mutzner, Himanshu Verma, and Hamed Alavi. 2022. Ai beyond deus ex machina–Reimagining intelligence in future cities with urban experts. In Proceedings of the 2022 Chi conference on human factors in computing systems. 1–13.
[28]
André Ourednik, Jakub Mlynář, Nico Mutzner, and Hamed Alavi. 2021. Social media platforms are failed cities. Interactions 28, 6 (2021), 62–66.
[29]
Anne Warfield Rawls and Waverly Duck. 2020. Tacit Racism. University of Chicago Press, Chicago.
[30]
Harvey Sacks. 1972. An initial investigation of the usability of conversational data for doing sociology. In Studies in Social Interaction, David Sudnow (Ed.). Free Press, New York, Chapter 2, 31–74.
[31]
Wojciech Samek, Thomas Wiegand, and Klaus-Robert Müller. 2017. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296 (2017).
[32]
Ola Söderström, Till Paasche, and Francisco Klauser. 2014. Smart cities as corporate storytelling. City 18, 3 (2014), 307–320.
[33]
H Akin Unver. 2017. Digital challenges to democracy: Politics of automation, attention, and engagement. Journal of International Affairs 71, 1 (2017), 127–146.
Index Terms
- Dangers of Designing with Data
Recommendations
CHI4EVIL: Creative Speculation on the Negative Impacts of HCI Research
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsThe HCI community is experiencing a resurgence of interest in the ethical, social, and political dimensions of HCI research and practice. Despite increased attention to these issues is not always clear that our community has the tools or training to ...
No Longer “Neutral Among Ends” – Liberal Versus Communitarian Ethics in Library and Information Science
Diversity, Divergence, DialogueAbstractAs the concept of neutrality is under significant challenge as an ethic in LIS in the past decade from more critical approaches to social justice, the paper argues that in such a polarized world, we must seek to consider ethical approaches that do ...
Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsMany organizations have published principles intended to guide the ethical development and deployment of AI systems; however, their abstract nature makes them difficult to operationalize. Some organizations have therefore produced AI ethics checklists, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
501 pages
ISBN:9798400706325
DOI:10.1145/3656156
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
DIS '24
Sponsor:
DIS '24: Designing Interactive Systems Conference
July 1 - 5, 2024
IT University of Copenhagen, Denmark
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 116Total Downloads
- Downloads (Last 12 months)116
- Downloads (Last 6 weeks)18
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in