Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3593013.3594121acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfacctConference Proceedingsconference-collections
research-article
Open access

Legal Taxonomies of Machine Bias: Revisiting Direct Discrimination

Published: 12 June 2023 Publication History

Abstract

Previous literature on ‘fair’ machine learning has appealed to legal frameworks of discrimination law to motivate a variety of discrimination and fairness metrics and de-biasing measures. Such work typically applies the US doctrine of disparate impact rather than the alternative of disparate treatment, and scholars of EU law have largely followed along similar lines, addressing algorithmic bias as a form of indirect rather than direct discrimination. In recent work, we have argued that such focus is unduly narrow in the context of European law: certain forms of algorithmic bias will constitute direct discrimination [1]. In this paper, we explore the ramifications of this argument for existing taxonomies of machine bias and algorithmic fairness, how existing fairness metrics might need to be adapted, and potentially new measures may need to be introduced. We outline how the mappings between fairness measures and discrimination definitions implied hitherto may need to be revised and revisited.

References

[1]
Adams‐Prassl, Jeremias, Reuben Binns, and Aislinn Kelly‐Lyth. "Directly discriminatory algorithms." The Modern Law Review 86.1 (2022): 144-175.
[2]
Barocas, Solon and Andrew Selbst. 2016. Big Data's Disparate Impact. California Law Review, 104, 671-732.
[3]
Bailey and Norbury(eds). 2020. Bennion on Statutory Interpretation. (8th ed). LexisNexis.
[4]
Bower, Amanda, Sarah N. Kitchen, Laura Niss, Martin J. Strauss, Alexander Vargas, and Suresh Venkatasubramanian. "Fair Pipelines." arXiv e-prints (2017): arXiv-1707
[5]
Bright, Liam Kofi, Daniel Malinsky, and Morgan Thompson. 2016. Causally interpreting intersectionality theory. Philosophy of Science, 83(1), 60-81
[6]
Buolamwini, Joy and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of Machine Learning Research, 81, 1-15
[7]
Campbell, Colin, and Dale Smith. 2020. The Grounding Requirement for Direct Discrimination. The Law Quarterly Review, 136, 285-283
[8]
Collins, Hugh, and Tarunabh Khaitan. 2018. Indirect Discrimination Law: Controversies and Critical Questions. In Collins and Khaitan (Eds.), Foundations of Indirect Discrimination Law. Bloomsbury Publishing
[9]
Dwork, Cynthia, . 2012. Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference, 214-226.
[10]
European Union Agency for Fundamental Rights (‘FRA’) and Council of Europe. 2018. Handbook on European non-discrimination law. Luxembourg: Publications Office of the European Union.
[11]
Feldman, Michael, 2015. Certifying and removing disparate impact. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 259-268.
[12]
Fredman. 2018. Direct and Indirect Discrimination: Is There Still a Divide? In Collins and Khaitan (Eds.), Foundations of Indirect Discrimination Law. Bloomsbury Publishing.
[13]
Hacker, Philipp. 2018. Teaching fairness to artificial intelligence: Existing and novel strategies against algorithmic discrimination under EU law. Common Market Law Review, 55(4), 1143–1185.
[14]
Kasirzadeh, Atoosa, and Andrew Smart. 2021. The use and misuse of counterfactuals in ethical machine learning. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 228-236.
[15]
Kleinberg, Jon, 2018. Discrimination in the Age of Algorithms. Journal of Legal Analysis, 10, 113-174.
[16]
Hu, Lily and Issa Kohler-Hausmann. 2020. What's Sex Got To Do With Fair Machine Learning? In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 513.
[17]
Kilbertus, Niki, Mateo Rojas Carulla, Giambattista Parascandolo, Moritz Hardt, Dominik Janzing, and Bernhard Schölkopf. "Avoiding discrimination through causal reasoning." Advances in neural information processing systems 30 (2017).
[18]
Kusner, Matt J., 2017. Counterfactual fairness. arXiv preprint arXiv:1703.06856 (2017).
[19]
Lipton, Zachary, Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity? Advances in neural information processing systems 31.
[20]
Malinsky, Daniel. "Intervening on structure." Synthese 195, no. 5 (2018): 2295-2312.
[21]
Mitchell, Shira, Eric Potash, Solon Barocas, Alexander D'Amour, and Kristian Lum. "Algorithmic fairness: Choices, assumptions, and definitions." Annual Review of Statistics and Its Application 8 (2021): 141-163.
[22]
Sánchez-Monedero, Javier, Lina Dencik, and Lilian Edwards. "What does it mean to'solve'the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems." Proceedings of the 2020 conference on fairness, accountability, and transparency. 2020.
[23]
Singh, Harvineet, 2021. Fairness violations and mitigation under covariate shift’. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 3-13.
[24]
Stark, Luke, and Jevan Hutson. 2021. Physiognomic Artificial Intelligence. Available at SSRN 3927300 (2021).
[25]
Steel, Sandy. 2015. Proof of Causation in Tort Law. Cambridge University Press.
[26]
Tschantz, Michael Carl. "What is Proxy Discrimination?." 2022 ACM Conference on Fairness, Accountability, and Transparency. 2022.
[27]
Wachter, Sandra. 2020. Affinity Profiling and Discrimination by Association in Online Behavioral Advertising. Berkeley Technology Law Journal, 35, 367-430.
[28]
Wachter, Sandra, Brent Mittelstadt, and Chris Russell. "Why fairness cannot be automated: Bridging the gap between EU non-discrimination law and AI." Computer Law & Security Review 41 (2021): 105567.
[29]
Xenidis, Raphaele and Linda Senden. 2020. EU Non-Discrimination Law in the Era of Artificial Intelligence: Mapping the Challenges of Algorithmic Discrimination. In Ulf Bernitz (Eds.), General Principles of EU Law and the EU Digital Order. Wolters Kluwer.
[30]
Yang, Ke, Joshua R. Loftus, and Julia Stoyanovich. 2020. Causal intersectionality for fair ranking. arXiv preprint arXiv:2006.08688 (2020)
[31]
y Arcas, Blaise Agüera, Margaret Mitchell, and Alexander Todorov. "Physiognomy's new clothes." Medium (6 May 2017), online:https://medium.com/@blaisea/physiognomys-new-clothesf2d4b59fdd6a 52 (2017).
[32]
Zafar, Muhammad Bilal, "Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment." Proceedings of the 26th international conference on world wide web. 2017
[33]
Patmalniece v Secretary of State for Work and Pensions [2011]UKSC 11, [2011]WLR 783
[34]
R (on the application of E) v JFS Governing Body [2009]UKSC 15, [2010]2 AC 728.
[35]
Joined Cases C-804/18 and C-341/19 IX v WABE eV and MH Müller Handels GmbH v MJ ECLI:EU:C:2021:594
[36]
James v Eastleigh BC [1990]2 AC 751, [1990]3 WLR 55
[37]
Nagarajan v London Regional Transport and others [2000]1 AC 501, [1999]3 WLR 425
[38]
O'Neill v Governors of St Thomas More Roman Catholic Voluntary Aided Upper School [1997 ICR 33, [1996]IRLR 372.
[39]
Reynolds v CLFIS Ltd [2015]EWCA Civ 439, [2015]ICR 1010
[40]
Case C‑267/06 Tadao Maruko v Versorgungsanstalt der deutschen Bühnen ECLI:EU:C:2008:179.
[41]
Kentucky Retirement Systems v EEOC 554 US 135 (2008)

Cited By

View all
  • (2024)Algorithmic Arbitrariness in Content ModerationProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659036(2234-2253)Online publication date: 3-Jun-2024
  • (2024)Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory AlgorithmsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659010(1850-1860)Online publication date: 3-Jun-2024
  • (2024)Policy advice and best practices on bias and fairness in AIEthics and Information Technology10.1007/s10676-024-09746-w26:2Online publication date: 29-Apr-2024

Index Terms

  1. Legal Taxonomies of Machine Bias: Revisiting Direct Discrimination

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency
      June 2023
      1929 pages
      ISBN:9798400701924
      DOI:10.1145/3593013
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 12 June 2023

      Check for updates

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • European Research Council under the European Union?s Horizon 2020 research and innovation programme

      Conference

      FAccT '23

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)569
      • Downloads (Last 6 weeks)74
      Reflects downloads up to 24 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Algorithmic Arbitrariness in Content ModerationProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659036(2234-2253)Online publication date: 3-Jun-2024
      • (2024)Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory AlgorithmsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659010(1850-1860)Online publication date: 3-Jun-2024
      • (2024)Policy advice and best practices on bias and fairness in AIEthics and Information Technology10.1007/s10676-024-09746-w26:2Online publication date: 29-Apr-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media