research-article

Open access

Examining Algorithmic Metrics and their Effects through the Lens of Reactivity

Author:

EunJeong CheonAuthors Info & Claims

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

Pages 3179 - 3192

https://doi.org/10.1145/3643834.3660676

Published: 01 July 2024 Publication History

All formats PDF

Abstract

Algorithmic systems that provide quantitative assessments of labor practices have proliferated in response to growing calls for accountability and transparency. Workers, according to the existing literature, are able to make sense of algorithmic metrics and even find ways to manipulate them. Human reactions like these show how metrics for tracking and measuring labor productivity can have unintended consequences, such as gaming the system, beyond the original goal of collecting accurate data on worker output. However, these metrics’ effects have not been much discussed from the perspective of reactivity. Drawing from Espeland and Sauder’s work theorizing reactivity to measures, I offer a deeper understanding of responses to algorithmic systems. Distilling three intertwined facets from their insights—quantification towards accountability, agency, and reflexivity—I frame my fieldwork findings on warehouse workers’ experiences with labor-tracking technologies. I describe the patterns of algorithmic system effects. Lastly, I explore potential design directions, viewed through the lens of reactivity.

References

[1]

NY State Senate Bill 2021-S8922A. 2022. Establishes the Warehouse Worker Protection Act. https://www.nysenate.gov/legislation/bills/2021/S8922

[2]

Daniel A Adler, Emily Tseng, Khatiya C Moon, John Q Young, John M Kane, Emanuel Moss, David C Mohr, and Tanzeem Choudhury. 2022. Burnout and the Quantified Workplace: Tensions around Personal Sensing Interventions for Stress in Resident Physicians. Proceedings of the ACM on Human-computer Interaction 6, CSCW2 (2022), 1–48.

Digital Library

[3]

Massimo Airoldi. 2018. Ethnography and the digital fields of social media. International Journal of Social Research Methodology 21, 6 (2018), 661–673.

[4]

Btihaj Ajana. 2017. Digital health and the biopolitics of the Quantified Self. Digital health 3 (2017), 2055207616689509.

[5]

G Stoney Alder. 1998. Ethical issues in electronic performance monitoring: A consideration of deontological and teleological perspectives. Journal of Business Ethics 17, 7 (1998), 729–743.

[6]

Peter Bain and Phil Taylor. 2000. Entrapped by the ‘electronic panopticon’? Worker resistance in the call centre. New technology, work and employment 15, 1 (2000), 2–18.

[7]

Lyndsey L Bakewell, Konstantina Vasileiou, Kiel S Long, Mark Atkinson, Helen Rice, Manuela Barreto, Julie Barnett, Michael Wilson, Shaun Lawson, and John Vines. 2018. Everything we do, everything we press: Data-driven remote performance management in a mobile workplace. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[8]

Kirstie S Ball and Kevin D Haggerty. 2005. Doing surveillance studies. Surveillance & Society 3, 2/3 (2005).

[9]

Kirstie S Ball and Stephen T Margulis. 2011. Electronic monitoring and surveillance in call centres: a framework for investigation. New technology, work and employment 26, 2 (2011), 113–126.

[10]

Albert Bandura. 1999. Social cognitive theory of personality. Handbook of personality 2 (1999), 154–96.

[11]

Eric PS Baumer and M Six Silberman. 2011. When the implication is not to design (technology). In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2271–2274.

Digital Library

[12]

Ulrich Beck. 1996. World risk society as cosmopolitan society? Ecological questions in a framework of manufactured uncertainties. Theory, culture & society 13, 4 (1996), 1–32.

[13]

David Beer. 2016. Metric Power. Palgrave Macmillan UK.

[14]

Rosanna Bellini, Simon Forrest, Nicole Westmarland, Dan Jackson, and Jan David Smeddinck. 2020. Choice-point: fostering awareness and choice with perpetrators in domestic violence interventions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[15]

Steve Benford, Chris Greenhalgh, Gabriella Giannachi, Brendan Walker, Joe Marshall, and Tom Rodden. 2012. Uncomfortable interactions. In Proceedings of the sigchi conference on human factors in computing systems. 2005–2014.

Digital Library

[16]

Ruha Benjamin. 2016. Informed refusal: Toward a justice-based bioethics. Science, Technology, & Human Values 41, 6 (2016), 967–990.

[17]

Bruno Berberian, Jean-Christophe Sarrazin, Patrick Le Blaye, and Patrick Haggard. 2012. Automation technology and sense of control: a window on human agency. PloS one 7, 3 (2012), e34075.

[18]

Mario Biagioli. 2016. Watch out for cheats in citation game. Nature 535, 7611 (2016), 201–201.

[19]

Susanne Bødker and Clemens Nylandsted Klokmose. 2012. Dynamics in artifact ecologies. In Proceedings of the 7th Nordic conference on human-computer interaction: Making sense through design. 448–457.

Digital Library

[20]

Tom Boellstorff, Bonnie Nardi, Celia Pearce, and Tina L Taylor. 2012. Ethnography and virtual worlds. Princeton University Press.

[21]

Michael Burawoy. 1998. The extended case method. Sociological theory 16, 1 (1998), 4–33.

[22]

Koray Çalışkan and Michel Callon. 2010. Economization, part 2: a research programme for the study of markets. Economy and society 39, 1 (2010), 1–32.

[23]

Michel Callon and Fabian Muniesa. 2005. Peripheral vision: Economic markets as calculative collective devices. Organization studies 26, 8 (2005), 1229–1250.

[24]

DT CAMPBELL. 1957. Factors relevant to the validity of experiments in social settings. Psychological bulletin 54, 4 (1957), 297–312.

[25]

Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis. sage.

[26]

Kathy Charmaz. 2011. A constructivist grounded theory analysis of losing and regaining a valued self. Five ways of doing qualitative analysis: Phenomenological psychology, grounded theory, discourse analysis, narrative research, and intuitive inquiry (2011), 165–204.

[27]

Kathy Charmaz. 2017. The power of constructivist grounded theory for critical inquiry. Qualitative inquiry 23, 1 (2017), 34–45.

[28]

Kathy Charmaz. 2021. The genesis, grounds, and growth of constructivist grounded theory. In Developing grounded theory. Routledge, 153–187.

[29]

EunJeong Cheon. 2023. Powerful Futures: How a Big Tech Company Envisions Humans and Technologies in the Workplace of the Future. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1–35.

Digital Library

[30]

EunJeong Cheon and Vera Khovanskaya. 2024. Amazon Z to A: Speculative Design to Understand the Future of Labor-Intensive Workplaces. In Proceedings of the 2024 ACM Designing Interactive Systems Conference(DIS ’24). Association for Computing Machinery, New York, NY, USA.

Digital Library

[31]

EunJeong Cheon, Eike Schneiders, Kristina Diekjobst, and Mikael B Skov. 2022. Robots as a Place for Socializing: Influences of Collaborative Robots on Social Dynamics In-and Outside the Production Cells. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–26.

Digital Library

[32]

EunJeong Cheon, Eike Schneiders, and Mikael B Skov. 2022. Working with bounded collaboration: A qualitative study on how collaboration is co-constructed around collaborative robots in industry. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–34.

Digital Library

[33]

Adrian W Chew. 2020. Informed guessing: enacting abductively-driven research. International Journal of Research & Method in Education 43, 2 (2020), 189–200.

[34]

Shreya Chowdhary, Anna Kawakami, Mary L Gray, Jina Suh, Alexandra Olteanu, and Koustuv Saha. 2023. Can Workers Meaningfully Consent to Workplace Wellbeing Technologies?. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 569–582.

Digital Library

[35]

Angèle Christin. 2020. Metrics at work: Journalism and the contested meaning of algorithms. Princeton University Press.

[36]

Angèle Christin and Rebecca Lewis. 2021. The drama of metrics: Status, spectacle, and resistance among YouTube drama creators. Social Media+ Society 7, 1 (2021).

[37]

David Coyle, James Moore, Per Ola Kristensson, Paul Fletcher, and Alan Blackwell. 2012. I did that! Measuring users’ experience of agency in their own actions. In Proceedings of the SIGCHI conference on human factors in computing systems. 2025–2034.

Digital Library

[38]

Alan Dix. 2007. Designing for appropriation. In Proceedings of HCI 2007 The 21st British HCI Group Annual Conference University of Lancaster, UK 21. 1–4.

[39]

Niels van Doorn. 2020. At what price? Labour politics and calculative power struggles in on-demand food delivery. Work Organisation, Labour & Globalisation 14, 1 (2020), 136–149.

[40]

Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 541–550.

Digital Library

[41]

Paul Dourish. 2019. User experience as legitimacy trap. Interactions 26, 6 (2019), 46–49.

Digital Library

[42]

Paul Dourish and Graham Button. 1998. On" technomethodology": Foundational relationships between ethnomethodology and system design. Human-computer interaction 13, 4 (1998), 395–432.

[43]

Andy Dow, John Vines, Toby Lowe, Rob Comber, and Rob Wilson. 2017. What Happens to Digital Feedback? Studying the Use of a Feedback Capture Platform by Care Organisations. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 5813–5825.

Digital Library

[44]

Chloe Eghtebas, Gudrun Klinker, Susanne Boll, and Marion Koelle. 2023. Co-Speculating on Dark Scenarios and Unintended Consequences of a Ubiquitous (ly) Augmented Reality. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 2392–2407.

Digital Library

[45]

Chris Elsden, Sebastian Mellor, Patrick Olivier, Pete Wheldon, David Kirk, and Rob Comber. 2016. ResViz: Politics and design issues in visualizing academic metrics. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5015–5027.

Digital Library

[46]

Wendy Nelson Espeland and Michael Sauder. 2007. Rankings and reactivity: How public measures recreate social worlds. American journal of sociology 113, 1 (2007), 1–40.

[47]

Wendy Nelson Espeland and Mitchell L Stevens. 2008. A sociology of quantification. European Journal of Sociology/Archives européennes de sociologie 49, 3 (2008), 401–436.

[48]

Fabian Ferrari and Mark Graham. 2021. Fissures in algorithmic power: Platforms, code, and contestation. Cultural Studies 35, 4-5 (2021), 814–832.

[49]

Batya Friedman and Helen Nissenbaum. 1996. User autonomy: who should control what and when?. In Conference Companion on Human Factors in Computing Systems. 433.

Digital Library

[50]

Chris D Frith. 2014. Action, agency and responsibility. Neuropsychologia 55 (2014), 137–142.

[51]

Clifford Geertz 1973. The interpretation of cultures. Vol. 5019. Basic books.

[52]

Carolin Gerlitz and Celia Lury. 2014. Social media and self-evaluating assemblages: On numbers, orderings and values. Distinktion: Scandinavian Journal of Social Theory 15, 2 (2014), 174–188.

[53]

Stéphanie Giamporcaro and Jean-Pascal Gond. 2016. Calculability as politics in the construction of markets: The case of socially responsible investment in France. Organization Studies 37, 4 (2016), 465–495.

[54]

Tarleton Gillespie. 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society 167, 2014 (2014), 167.

[55]

Erving Goffman. 1974. Frame analysis: An essay on the organization of experience.Harvard University Press.

[56]

Nanna Gorm and Irina Shklovski. 2016. Sharing steps in the workplace: Changing privacy concerns over time. In proceedings of the 2016 CHI conference on human factors in computing systems. 4315–4319.

Digital Library

[57]

Itai Gurvich, Martin Lariviere, and Antonio Moreno. 2019. Operations in the on-demand economy: Staffing services with self-scheduling capacity. Springer.

[58]

Richard HR Harper. 1992. Looking at ourselves: an examination of the social organisation of two research laboratories. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. 330–337.

Digital Library

[59]

Christine Hine. 2020. Ethnography for the internet: Embedded, embodied and everyday. Routledge.

[60]

Michael Jeffrey Daniel Hoefer, Lucy Van Kleunen, Cassandra Goodby, Lanea Blyss Blackburn, Priyanka Panati, and Stephen Voida. 2021. The multiplicative patient and the clinical workflow: Clinician perspectives on social interfaces for self-tracking and managing bipolar disorder. In Designing Interactive Systems Conference 2021. 907–925.

[61]

Naja L Holten Møller, Pernille Bjørn, Jonas Christoffer Villumsen, Tine C Hansen Hancock, Toshimitsu Aritake, and Shigeyuki Tani. 2017. Data tracking in search of workflows. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. 2153–2165.

Digital Library

[62]

David M Holtz, Liane Scult, and Siddharth Suri. 2022. How Much Do Platform Workers Value Reviews? An Experimental Method. In CHI Conference on Human Factors in Computing Systems. 1–11.

[63]

Kristina Höök, Anna Ståhl, Petra Sundström, and Jarmo Laaksolaahti. 2008. Interactional empowerment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 647–656.

Digital Library

[64]

Keith Hoskin. 1996. The ‘awful idea of accountability’: inscribing people into the measurement of objects. Accountability: Power, ethos and the technologies of managing 265 (1996).

[65]

D. Ihde. 1998. Philosophy of Technology. Paragon House. https://books.google.com/books?id=XG95QgAACAAJ

[66]

Sarah Inman and David Ribes. 2019. " Beautiful Seams" Strategic Revelations and Concealments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[67]

Mohammad Hossein Jarrahi, Gemma Newlands, Min Kyung Lee, Christine T Wolf, Eliscia Kinder, and Will Sutherland. 2021. Algorithmic management in a work context. Big Data & Society 8, 2 (2021), 20539517211020332.

[68]

Mohammad Hossein Jarrahi and Will Sutherland. 2019. Algorithmic management and algorithmic competencies: Understanding and appropriating algorithms in gig work. In International conference on information. Springer, 578–589.

[69]

Shagun Jhaver, Yoni Karpfen, and Judd Antin. 2018. Algorithmic anxiety and coping strategies of Airbnb hosts. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.

Digital Library

[70]

Cecilia Kang. 2022. Here Comes the Full Amazonification of Whole Foods. The New York Times (Feb 2022). https://www.nytimes.com/2022/02/28/technology/whole-foods-amazon-automation.html

[71]

Jodi Kantor, Arya Sundaram, Aliza Aufrichtig, and Rumsey Taylor. 2022. The Rise of the Worker Productivity Score. The New York Times (Aug. 2022). https://www.nytimes.com/interactive/2022/08/14/business/worker-productivity-tracking.html

[72]

J Katz and RM Emerson. 1983. Analytic induction: A theory of qualitative methodology. Contemporary field research (1983).

[73]

Harmanpreet Kaur, Alex C Williams, Daniel McDuff, Mary Czerwinski, Jaime Teevan, and Shamsi T Iqbal. 2020. Optimizing for happiness and productivity: Modeling opportune moments for transitions and breaks at work. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[74]

Alan E Kazdin. 1982. Observer effects: Reactivity of direct observation.New Directions for Methodology of Social & Behavioral Science (1982).

[75]

Eliscia Kinder, Mohammad Hossein Jarrahi, and Will Sutherland. 2019. Gig platforms, tensions, alliances and ecosystems: An actor-network perspective. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–26.

Digital Library

[76]

Kalle Kusk and Midas Nouwens. 2022. Platform-Mediated Food Delivery Work: A Review for CSCW. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–25.

Digital Library

[77]

Max Kutner. 2014. How to game the college rankings. Boston Magazine (2014).

[78]

Stephen D Lapan, MaryLynn T Quartaroli, and Frances J Riemer. 2011. Qualitative research: An introduction to methods and designs. Vol. 37. John Wiley & Sons.

[79]

Marty Laubach. 2005. Consent, informal organization and job rewards: A mixed methods analysis. Social Forces 83, 4 (2005), 1535–1565.

[80]

Kevin Le Goff, Arnaud Rey, Patrick Haggard, Olivier Oullier, and Bruno Berberian. 2018. Agency modulates interactions with automation technologies. Ergonomics 61, 9 (2018), 1282–1297.

[81]

Min Kyung Lee, Daniel Kusbit, Evan Metsky, and Laura Dabbish. 2015. Working with machines: The impact of algorithmic and data-driven management on human workers. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 1603–1612.

Digital Library

[82]

Samantha Lee and Brian H Kleiner. 2003. Electronic surveillance in the workplace. Management Research News 26, 2/3/4 (2003), 72–81.

[83]

Robin Leidner. 1993. Fast food, fast talk: Service work and the routinization of everyday life. Univ of California Press.

[84]

Karen EC Levy. 2015. The contexts of control: Information, power, and truck-driving work. The Information Society 31, 2 (2015), 160–174.

Digital Library

[85]

Andrew Likierman. 2009. The five traps of performance measurement. Harvard business review 87, 10 (2009), 96–101.

[86]

Kai Lukoff, Ulrik Lyngs, Himanshu Zade, J Vera Liao, James Choi, Kaiyue Fan, Sean A Munson, and Alexis Hiniker. 2021. How the design of youtube influences user sense of agency. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[87]

Deborah Lupton. 2016. The diverse domains of quantified selves: self-tracking modes and dataveillance. Economy and Society 45, 1 (2016), 101–122.

[88]

Donald A MacKenzie, Fabian Muniesa, and Lucia Siu. 2007. Do economists make markets?: on the performativity of economics. Princeton University Press.

[89]

Michael David Maffie. 2022. The perils of laundering control through customers: A study of control and resistance in the ride-hail industry. ILR Review 75, 2 (2022), 348–372.

[90]

George E Marcus. 1995. Ethnography in/of the world system: The emergence of multi-sited ethnography. Annual review of anthropology (1995), 95–117.

[91]

Afra Mashhadi, Fahim Kawsar, Akhil Mathur, Casey Dugan, and N Sadat Shami. 2016. Let’s talk about the quantified workplace. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion. 522–528.

Digital Library

[92]

Akhil Mathur, Marc Van den Broeck, Geert Vanderhulst, Afra Mashhadi, and Fahim Kawsar. 2015. Tiny habits in the giant enterprise: understanding the dynamics of a quantified workplace. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 577–588.

Digital Library

[93]

Stephen M Mattingly, Julie M Gregg, Pino Audia, Ayse Elvan Bayraktaroglu, Andrew T Campbell, Nitesh V Chawla, Vedant Das Swain, Munmun De Choudhury, Sidney K D’Mello, Anind K Dey, 2019. The tesserae project: Large-scale, longitudinal, in situ, multimodal sensing of information workers. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8.

Digital Library

[94]

George J McCall. 1984. Systematic field observation. Annual review of sociology 10, 1 (1984), 263–282.

[95]

Nora McDonald and Helena M Mentis. 2021. Building for ‘we’: safety settings for couples with memory concerns. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[96]

Andrea Mennicken and Wendy Nelson Espeland. 2019. What’s new with numbers? Sociological approaches to the study of quantification. Annual Review of Sociology 45 (2019), 223–245.

[97]

Andre N Meyer, Gail C Murphy, Thomas Zimmermann, and Thomas Fritz. 2017. Design recommendations for self-monitoring in the workplace: Studies in software development. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 1–24.

Digital Library

[98]

Peter Miller. 2001. Governing by numbers: Why ranking systems matter. Social Research: An International Quarterly 68, 2 (2001).

[99]

Marieke Möhlmann and Lior Zalmanson. 2017. Hands on the wheel: Navigating algorithmic management and Uber drivers’. In Autonomy’, in proceedings of the international conference on information systems (ICIS), Seoul South Korea. 10–13.

[100]

Phoebe Moore and Andrew Robinson. 2016. The quantified self: What counts in the neoliberal workplace. new media & society 18, 11 (2016), 2774–2792.

[101]

Phoebe V Moore. 2017. The quantified self in precarity: Work, technology and what counts. Routledge.

[102]

Jerry Muller. 2018. The tyranny of metrics. Princeton University Press.

[103]

Sean Peacock, Robert Anderson, and Clara Crivellaro. 2018. Streets for people: Engaging children in placemaking through a socio-technical process. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–14.

Digital Library

[104]

James Pierce and Eric Paulos. 2015. Making multiple uses of the obscura 1C digital camera: reflecting on the design, production, packaging and distribution of a counterfunctional device. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2103–2112.

Digital Library

[105]

Gary Pritchard, John Vines, Pam Briggs, Lisa Thomas, and Patrick Olivier. 2014. Digitally driven: how location based services impact the work practices of London bus drivers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3617–3626.

Digital Library

[106]

Gary W Pritchard, Pam Briggs, John Vines, and Patrick Olivier. 2015. How to drive a london bus: Measuring performance in a mobile and remote workplace. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 1885–1894.

Digital Library

[107]

Daniel M Ravid, David L Tomczak, Jerod C White, and Tara S Behrend. 2020. EPM 20/20: A review, framework, and research agenda for electronic performance monitoring. Journal of Management 46, 1 (2020), 100–126.

[108]

Johan Redström. 2006. Towards user design? On the shift from object to user as the subject of design. Design studies 27, 2 (2006), 123–139.

[109]

Albert J Reiss. 1971. Systematic observation of natural social phenomena. Sociological methodology 3 (1971), 3–33.

[110]

Matteo Rizzo and Maurizio Atzeni. 2020. Workers’ power in resisting precarity: Comparing transport workers in Buenos Aires and Dar es Salaam. Work, Employment and Society 34, 6 (2020), 1114–1130.

[111]

Kat Roemmich, Florian Schaub, and Nazanin Andalibi. 2023. Emotion AI at Work: Implications for Workplace Surveillance, Emotional Labor, and Emotional Privacy. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–20.

Digital Library

[112]

Alex Rosenblat and Luke Stark. 2016. Algorithmic labor and information asymmetries: A case study of Uber’s drivers. International journal of communication 10 (2016), 27.

[113]

Jeff Sallaz. 2009. The labor of luck: Casino capitalism in the United States and South Africa. Univ of California Press.

[114]

mc schraefel, Eric Hekler, and Jennifer Taylor. 2019. WellComm2019: Towards Tools for Groups to Build Their Own Healthful Workplace Cultures. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 511–516.

[115]

Aaron Shapiro. 2020. Dynamic exploits: calculative asymmetries in the on-demand economy. New Technology, Work and Employment 35, 2 (2020), 162–177.

[116]

Rachel Sherman. 2007. Class acts: Service and inequality in luxury hotels. Univ of California Press.

[117]

Robert Soden, Austin Toombs, and Michaelanne Thomas. 2024. Evaluating Interpretive Research in HCI. Interactions 31, 1 (2024), 38–42.

Digital Library

[118]

Corinne Squire. 2013. From experience-centred to socioculturally-oriented approaches to narrative. Doing narrative research 2 (2013), 47–71.

[119]

Stefan Stepanovic, Tobias Mettler, Manuel Schmidt-Kraepelin, Scott Thiebes, and Ali Sunyaev. 2019. Wearable health devices in the workplace: The importance of habits to sustain the use. In 2019 IEEE 21st Conference on Business Informatics (CBI), Vol. 2. IEEE, 363–372.

[120]

Marilyn Strathern. 1997. ‘Improving ratings’: audit in the British University system. European review 5, 3 (1997), 305–321.

[121]

Ella Tallyn, Joe Revans, Evan Morgan, Keith Fisken, and Dave Murray-Rust. 2021. Enacting the last mile: experiences of smart contracts in courier deliveries. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[122]

Robert Thornberg, Kathy Charmaz, 2014. Grounded theory and theoretical coding. The SAGE handbook of qualitative data analysis 5, 2014 (2014), 153–69.

[123]

Maria Tomprou and Min Kyung Lee. 2022. Employment relationships in algorithmic management: A psychological contract perspective. Computers in Human Behavior 126 (2022), 106997.

Digital Library

[124]

Jasper Tran O’Leary, Sara Zewde, Jennifer Mankoff, and Daniela K Rosner. 2019. Who gets to future? Race, representation, and design methods in Africatown. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[125]

Sayako Ueda, Ryoichi Nakashima, and Takatsune Kumada. 2021. Influence of levels of automation on the sense of agency during continuous action. Scientific reports 11, 1 (2021), 2436.

[126]

Eugene J Webb, Donald T Campbell, Richard D Schwartz, and Lee Sechrest. 1999. Unobtrusive measures. Vol. 2. Sage Publications.

[127]

Tracee Vetting Wolf, Jennifer A Rode, Jeremy Sussman, and Wendy A Kellogg. 2006. Dispelling" design" as the black art of CHI. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 521–530.

Digital Library

[128]

Nur Yildirim, James McCann, and John Zimmerman. 2020. Digital Fabrication Tools at Work: Probing Professionals’ Current Needs and Desired Futures. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.

Digital Library

[129]

Camellia Zakaria, Rajesh Balan, and Youngki Lee. 2019. StressMon: Scalable detection of perceived stress and depression using passive sensing of changes in work routines and group interactions. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–29.

Digital Library

[130]

Angie Zhang, Alexander Boltz, Chun Wei Wang, and Min Kyung Lee. 2022. Algorithmic management reimagined for workers and by workers: Centering worker well-being in gig work. In CHI Conference on Human Factors in Computing Systems. 1–20.

Digital Library

Cited By

Toxtli CCurtis CSavage S(2024)A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work StylesProceedings of the ACM on Human-Computer Interaction10.1145/36868998:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686899
Ming JPei LVaranasi RKawakami AVerdezoto NCheon EFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Labor, Visibility, and Technology: Weaving Together Academic Insights and On-Ground RealitiesCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681827(708-711)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681827
Cheon EKhovanskaya V(2024)Amazon Z to A: Speculative Design to Understand the Future of Labor-Intensive WorkplacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661561(314-327)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661561

Index Terms

Examining Algorithmic Metrics and their Effects through the Lens of Reactivity
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Algorithmic Management Reimagined For Workers and By Workers: Centering Worker Well-Being in Gig Work
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Prior research has studied the detrimental impact of algorithmic management on gig workers and strategies that workers devise in response. However, little work has investigated alternative platform designs to promote worker well-being, particularly from ...
Designing for Wellbeing: Worker-Generated Ideas on Adapting Algorithmic Management in the Hospitality Industry
DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

Labor shortages have shaped many industries over the past several years, with hospitality experiencing one of the largest rates of attrition. Workers are leaving their jobs for a variety of reasons, ranging from burnout and work intensification to a ...
Entangled Independence: From Labor Rights to Gig "Empowerment" Under the Algorithmic Gaze
CSCW

This study offers a critical analysis of how the Indian gig platform, Urban Company (UC), mobilizes the promise of empowerment to assemble, discipline and algorithmically entangle its gig labor force. Much of the scholarship on gig work has described how ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

July 2024

3616 pages

ISBN:9798400705830

DOI:10.1145/3643834

Editors:
Anna Vallgårda
IT University of Copenhagen
,
Li Jönsson
Malmö University
,
Jonas Fritsch
IT University of Copenhagen
,
Sarah Fdili Alaoui
LISN-Université Paris Saclay
,
Christopher A. Le Dantec
Northeastern University

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

DIS '24

Sponsor:

SIGCHI

DIS '24: Designing Interactive Systems Conference

July 1 - 5, 2024

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)180
Downloads (Last 6 weeks)38

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Toxtli CCurtis CSavage S(2024)A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work StylesProceedings of the ACM on Human-Computer Interaction10.1145/36868998:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686899
Ming JPei LVaranasi RKawakami AVerdezoto NCheon EFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Labor, Visibility, and Technology: Weaving Together Academic Insights and On-Ground RealitiesCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681827(708-711)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681827
Cheon EKhovanskaya V(2024)Amazon Z to A: Speculative Design to Understand the Future of Labor-Intensive WorkplacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661561(314-327)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661561

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents