abstract

Took a Pic and Got Declined, Vexed and Perplexed: Facial Recognition in Algorithmic Management

Author:

Elizabeth Anne WatkinsAuthors Info & Claims

CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

Pages 177 - 182

https://doi.org/10.1145/3406865.3418383

Published: 17 October 2020 Publication History

Abstract

The rise of biometric security changes how users make decisions about their privacy. As passwords give way to faces and fingerprints, the algorithmic nature of these processes creates new cognitive labor for users. When biometrics are used in spaces of algorithmic management, workers must negotiate tradeoffs between security, privacy, fairness, and their livelihood. A mixed-methods, human-centered research design paired with theory frameworks from algorithmic management, usable security, and algorithmic fairness illuminates how workers navigate facial recognition at the level of local practice. As AI/ML technologies for management and security become increasingly interwoven, the implications of this research are significant.

References

[1]

Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P.N., Inkpen, K. and Teevan, J., 2019, May. Guidelines for human-ai interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1--13).

[2]

Anderson, K., Bezaitis, M., Disalvo, C. and Fauklner, S., 2019, November. AI Among Us: Agency in a World of Cameras and Recognition Systems. In Ethnographic Praxis in Industry Conference Proceedings (Vol. 2019, No. 1, pp. 38--64).

[3]

Anteby, M. and Chan, C.K., 2018. A self-fulfilling cycle of coercive surveillance: Workers? invisibility practices and managerial justification. Organization Science, 29(2), pp.247--263.

Digital Library

[4]

Bansal, G., Nushi, B., Kamar, E., Lasecki, W.S., Weld, D.S. and Horvitz, E., 2019, October. Beyond accuracy: The role of mental models in human-AI team performance. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing (Vol. 7, No. 1, pp. 2--11).

[5]

Beunza, Daniel. 2019. Taking the Floor: Models, Morals, and Management in a Wall Street Trading Room. Princeton: Princeton University Press.

[6]

Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J. and Shadbolt, N., 2018, April. 'It's Reducing a Human Being to a Percentage' Perceptions of Justice in Algorithmic Decisions. In Proceedings of the 2018 Chi conference on human factors in computing systems (pp. 1--14).

[7]

Bravo-Lillo, C., Cranor, L.F., Downs, J. and Komanduri, S., 2010. Bridging the gap in computer security warnings: A mental model approach. IEEE Security & Privacy, 9(2), pp.18--26

Digital Library

[8]

Buolamwini, J. and Gebru, T., 2018, January. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency (pp. 77--91).

[9]

Cai, C.J., Winter, S., Steiner, D., Wilcox, L. and Terry, M., 2019. 'Hello AI': Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), pp.1--24.

[10]

Cameron, L. 2020. Allies or Adversaries?: Making Meaning of Work in the ?New? Gig Employment Relationship. In Guclu Atinc (Ed.), Proceedings of the 80th Annual Meeting of the Academy of Management. Online ISSN: 2151--6561.

[11]

Collins, H.M., 1997. RAT-tale: sociology's contribution to understanding human and machine cognition. In Expertise in context: human and machine (pp. 293--311)

[12]

DeVito, M.A., Birnholtz, J., Hancock, J.T., French, M. and Liu, S., 2018, April. How people form folk theories of social media feeds and what it means for how we study self-presentation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (p. 120). ACM.

[13]

Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K. and Kirlik, A., 2016, May. First I like it, then i hide it: Folk theories of social feeds. In Proceedings of the 2016 cHI conference on human factors in computing systems (pp. 2371--2382). ACM.

[14]

Gray, M.L. and Suri, S., 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt.

[15]

Grgic-Hlaca, Nina, Elissa M. Redmiles, Krishna P. Gummadi, and Adrian Weller. "Human perceptions of fairness in algorithmic decision making: A case study of criminal risk prediction." In Proceedings of the 2018 World Wide Web Conference, pp. 903--912. 2018.

[16]

Hargittai, E., Gruber, J., Djukaric, T., Fuchs, J. and Brombach, L., 2020. Black box measures? How to study people's algorithm skills. Information, Communication & Society, pp.1--12.

[17]

Jackson, S.J., 2014. 11 Rethinking Repair. Media technologies: Essays on communication, materiality, and society, pp.221--39.

[18]

Jarrahi, M.H. and Sutherland, W., 2019, March. Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig work. In International Conference on Information (pp. 578--589). Springer, Cham.

[19]

Kellogg, K.C., Valentine, M.A. and Christin, A., 2020. Algorithms at work: The new contested terrain of control. Academy of Management Annals, 14(1), pp.366--410.

[20]

Keyes, O., 2018. The misgendering machines: Trans/HCI implications of automatic gender recognition. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), pp.1--22.

Digital Library

[21]

Kulesza, T., Stumpf, S., Burnett, M. and Kwan, I., 2012, May. Tell me more? The effects of mental model soundness on personalizing an intelligent agent. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1--10).

[22]

Lee, M.K., Jain, A., Cha, H.J., Ojha, S. and Kusbit, D., 2019. Procedural justice in algorithmic fairness: Leveraging transparency and outcome control for fair algorithmic mediation. Proceedings of the ACM on Human-Computer

[23]

Lee, M.K., Kusbit, D., Metsky, E. and Dabbish, L., 2015, April. Working with machines: The impact of algorithmic and data-driven management on human workers. In Proceedings of the 33rd annual ACM conference on human factors in computing systems (pp. 1603--1612).

[24]

Mateescu, A. and Elish, M.C., 2019. AI in context: the labor of integrating new technologies. Data & Society.

[25]

Nkonde, M., 2019. Automated Anti-Blackness: Facial Recognition in Brooklyn, New York. Kennedy School Review, 20, pp.30--36.

[26]

Rader, E., Cotter, K. and Cho, J., 2018, April. Explanations as mechanisms for supporting algorithmic transparency. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1--13) Interaction, 3(CSCW), pp.1--26

[27]

Sachs, S.E., 2019. The algorithm at work? Explanation and repair in the enactment of similarity in art data. Information, Communication & Society, pp.1--17.

[28]

Selbst, A.D., Boyd, D., Friedler, S.A., Venkatasubramanian, S. and Vertesi, J., 2019, January. Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 59--68).

[29]

Sendak, M., Elish, M.C., Gao, M., Futoma, J., Ratliff, W., Nichols, M., Bedoya, A., Balu, S. and O'Brien, C., 2020, January. " The human body is a black box" supporting clinical decision-making with deep learning. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 99--109).

Digital Library

[30]

Star, S.L. and Strauss, A., 1999. Layers of silence, arenas of voice: The ecology of visible and invisible work. Computer supported cooperative work (CSCW), 8(1--2), pp.9--30.

[31]

Wash, R. 2010. Folk models of home computer security. Proc. SOUPS '10, ACM Press, 1. http://doi.org/10.1145/1837110.1837125

Digital Library

[32]

Woodruff, A., Fox, S.E., Rousso-Schindler, S. and Warshaw, J., 2018, April. A qualitative exploration of perceptions of algorithmic fairness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1--14)

Cited By

Elmimouni HSkop YAbokhodair NRüller SAal KWeibert AAl-Dawood AWulf VTolmie P(2024)Shielding or Silencing?: An Investigation into Content Moderation during the Sheikh Jarrah CrisisProceedings of the ACM on Human-Computer Interaction10.1145/36330718:GROUP(1-21)Online publication date: 21-Feb-2024
https://doi.org/10.1145/3633071
Awumey EDas SForlizzi J(2024)A Systematic Review of Biometric Monitoring in the Workplace: Analyzing Socio-technical Harms in Development, Deployment and UseProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658945(920-932)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658945
Watkins E(2023)Face Work: A Human-Centered Investigation into Facial Verification in Gig WorkProceedings of the ACM on Human-Computer Interaction10.1145/35794857:CSCW1(1-24)Online publication date: 16-Apr-2023
https://doi.org/10.1145/3579485
Show More Cited By

Index Terms

Took a Pic and Got Declined, Vexed and Perplexed: Facial Recognition in Algorithmic Management
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
2. Security and privacy
  1. Human and societal aspects of security and privacy
    1. Social aspects of security and privacy
    2. Usability in security and privacy

Recommendations

Algorithmic Management Reimagined For Workers and By Workers: Centering Worker Well-Being in Gig Work
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Prior research has studied the detrimental impact of algorithmic management on gig workers and strategies that workers devise in response. However, little work has investigated alternative platform designs to promote worker well-being, particularly from ...
Enhancing eID card mobile-based authentication through 3D facial reconstruction
Abstract
In recent years the number of credentials and digital identities needed to access online services is exploding, increasing the risk of fraud and unauthorized access to personal data.Biometric verification techniques can help to build ...
AI-powered biometrics for Internet of Things security: A review and future vision
Abstract
Biometrics is a set of advanced technologies that use the physical or behavioral characteristics of individuals to provide reliable access control. With the rapid development in information and communication technology, biometrics has become an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

October 2020

559 pages

ISBN:9781450380591

DOI:10.1145/3406865

General Chairs:
Matthew Bietz
University of California, Irvine
,
Andrea Wiggins

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Center for Long-Term Cybersecurity, University of California Berkeley

Conference

CSCW '20

Sponsor:

SIGCHI

CSCW '20: Computer Supported Cooperative Work and Social Computing

October 17 - 21, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
328
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Elmimouni HSkop YAbokhodair NRüller SAal KWeibert AAl-Dawood AWulf VTolmie P(2024)Shielding or Silencing?: An Investigation into Content Moderation during the Sheikh Jarrah CrisisProceedings of the ACM on Human-Computer Interaction10.1145/36330718:GROUP(1-21)Online publication date: 21-Feb-2024
https://doi.org/10.1145/3633071
Awumey EDas SForlizzi J(2024)A Systematic Review of Biometric Monitoring in the Workplace: Analyzing Socio-technical Harms in Development, Deployment and UseProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658945(920-932)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658945
Watkins E(2023)Face Work: A Human-Centered Investigation into Facial Verification in Gig WorkProceedings of the ACM on Human-Computer Interaction10.1145/35794857:CSCW1(1-24)Online publication date: 16-Apr-2023
https://doi.org/10.1145/3579485
Watkins E(2022)“Have you learned your lesson?” Communities of practice under algorithmic competitionNew Media & Society10.1177/1461444822109922924:7(1567-1590)Online publication date: 9-Jul-2022
https://doi.org/10.1177/14614448221099229
Cameron LChristin AAnn DeVito MR. Dillahunt TElish MGray MQadri RRaval NValentine MAnne Watkins E(2021)“This Seems to Work”: Designing Technological Systems with The Algorithmic Imaginations of Those Who LaborExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441331(1-5)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3441331
Moss E(2021)Technologies of Speculation: The Limits of Knowledge in a Data-Driven SocietyJournal of Cultural Economy10.1080/17530350.2021.188253914:4(506-509)Online publication date: 18-Feb-2021
https://doi.org/10.1080/17530350.2021.1882539

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents