research-article

Public Access

A Comparative Study of Dark Patterns Across Web and Mobile Modalities

Authors:

Johanna Gunawan,

David Choffnes,

Woodrow Hartzog,

Christo WilsonAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue CSCW2

Article No.: 377, Pages 1 - 29

https://doi.org/10.1145/3479521

Published: 18 October 2021 Publication History

Abstract

Dark patterns are user interface elements that can influence a person's behavior against their intentions or best interests. Prior work identified these patterns in websites and mobile apps, but little is known about how the design of platforms might impact dark pattern manifestations and related human vulnerabilities. In this paper, we conduct a comparative study of mobile application, mobile browser, and web browser versions of 105 popular services to investigate variations in dark patterns across modalities. We perform manual tests, identify dark patterns in each service, and examine how they persist or differ by modality. Our findings show that while services can employ some dark patterns equally across modalities, many dark patterns vary between platforms, and that these differences saddle people with inconsistent experiences of autonomy, privacy, and control. We conclude by discussing broader implications for policymakers and practitioners, and provide suggestions for furthering dark patterns research.

References

[1]

Eytan Adar, Desney S. Tan, and Jaime Teevan. 2013. Benevolent Deception in Human Computer Interaction. In Proc. of CHI.

Digital Library

[2]

Idris Adjerid, Alessandro Acquisti, Laura Brandimarte, and George F. Loewenstein. 2013. Sleights of privacy: framing, disclosures, and the limits of transparency. In Proc. of the Workshop on Usable Security.

[3]

Kevin Allix, Tegawendé F. Bissyandé, Jacques Klein, and Yves Le Traon. 2016. AndroZoo: Collecting Millions of Android Apps for the Research Community. In Proceedings of the 13th International Conference on Mining Software Repositories (Austin, Texas) (MSR '16). ACM, New York, NY, USA, 468--471. https://doi.org/10.1145/2901739.2903508

Digital Library

[4]

Monica Anderson. 2015. Smartphone, computer, or tablet? 36% of Americans own all three. Pew Research Center. (2015). https://www.pewresearch.org/fact-tank/2015/11/25/device-ownership/.

[5]

Rebecca Balebako, Florian Schaub, Idris Adjerid, Alessandro Acquisti, and Lorrie Cranor. 2015. The Impact of Timing on the Salience of Smartphone App Privacy Notices. In Proc. of the ACM CCS Workshop on Security and Privacy in Smartphones and Mobile Devices.

Digital Library

[6]

Lindsey Barrett and Angela J. Campbel. 2018. Request to Investigate Google's Unfair and Deceptive Practices in Marketing Apps for Children. https://commercialfreechildhood.org/sites/default/files/devel-generate/vad/google_ftc_complaint.pdf.

[7]

Christoph Bösch, Benjamin Erb, Frank Kargl, Henning Kopp, and Stefan Pfattheicher. 2016. Tales from the Dark Side: Privacy Dark Strategies and Privacy Dark Patterns. Proc. of PETS, Vol. 2016, 4 (2016), 237--254. https://content.sciendo.com/view/journals/popets/2016/4/article-p237.xml

[8]

Harry Brignull. 2019. Dark Patterns. https://www.darkpatterns.org/.

[9]

Angela J. Campbell. 2018. Letter to Donald S. Clark, Secretary of the Commission, and Andrew Smith, Director, Bureau of Consumer Protection, Federal Trade Commission. https://www.commercialfreechildhood.org/sites/default/files/devel-generate/piw/apps_FTC_letter.pdf.

[10]

Pew Research Center. 2018. Mobile Fact Sheet. pewinternet.org. http://www.pewinternet.org/fact-sheet/mobile/.

[11]

Shruthi Sai Chivukula, Jason Brier, and Colin M. Gray. 2018. Dark Intentions or Persuasion?: UX Designers' Activation of Stakeholder and User Values. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems (DIS '18 Companion).

[12]

Shruthi Sai Chivukula and Colin M. Gray. 2020. Co-Evolving Towards Evil Design Outcomes: Mapping Problem and Solution Process Moves. In Proc. of the Design Research Society.

[13]

Shruthi Sai Chivukula, Colin M. Gray, and Jason A. Brier. 2019 a. Analyzing Value Discovery in Design Decisions Through Ethicography. In Proc. of CHI.

[14]

Shruthi Sai Chivukula, Chris Watkins, Lucca McKay, and Colin M. Gray. 2019 b. “Nothing Comes Before Profit”: Asshole Design In the Wild. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems.

[15]

Gregory Conti and Edward Sobiesk. 2010. Malicious Interface Design: Exploiting the User. In Proc. of WWW.

Digital Library

[16]

Norwegian Consumer Council. 2018. Deceived By Design. https://fil.forbrukerradet.no/wp-content/uploads/2018/06/2018-06--27-deceived-by-design-final.pdf.

[17]

Martin Degeling, Christine Utz, Christopher Lentzsch, Henry Hosseini, Florian Schaub, and Thorsten Holz. 2019. We Value Your Privacy... Now Take Some Cookies: Measuring the GDPR's Impact on Web Privacy. In Proc of NDSS.

[18]

Jayati Dev, Emilee Rader, and Sameer Patil. 2020. Why Johnny Can't Unsubscribe: Barriers to Stopping Unwanted Email. In Proc. of CHI.

Digital Library

[19]

Linda Di Geronimo, Larissa Braz, Enrico Fregnan, Fabio Palomba, and Alberto Bacchelli. 2020. UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception. In Proc. of CHI.

Digital Library

[20]

J. Elliott and L. Waldron. 2019. Here's how TurboTax just tricked you into paying to file your taxes. https://www.propublica.org/article/turbotax-just-tricked-you-into-paying-to-file-your-taxes.

[21]

Benjamin Fabian, Tatiana Ermakova, and Tino Lentz. 2017. Large-Scale Readability Analysis of Privacy Policies. In Proc. of the International Conference on Web Intelligence.

Digital Library

[22]

Madison Fansher, Shruthi Sai Chivukula, and Colin M. Gray. 2018. #darkpatterns: UX Practitioner Conversations About Ethical Design. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems.

[23]

Alvan R. Feinstein and Domenic V. Cicchetti. 1990 a. High Agreement but Low Kappa: I. The Problems of Two Paradoxes. J. Clin. Epidemiol., Vol. 43, 6 (1990), 543--549.

[24]

Alvan R. Feinstein and Domenic V. Cicchetti. 1990 b. High Agreement but Low Kappa: II. Resolving the Paradoxes. J. Clin. Epidemiol., Vol. 43, 6 (1990), 551--558.

[25]

Jon Fingas. 2019. Senate bill would ban deceptive data collection by internet giants. https://www.engadget.com/2019/04/09/senate-detour-act/.

[26]

Ina Fried. 2019. Google claims it doesn't use “dark patterns” during Senate hearing. https://www.axios.com/google-dark-patterns-senate-hearing-c75afbc9--2462--4afc-bfd2--4b059c2a1d3d.html.

[27]

Stacia Garlach and Daniel D. Suther. 2018. 'I'm supposed to see that?' AdChoices Usability in the Mobile Environment. In Proc. of HICSS.

[28]

Joshua Gluck, Florian Schaub, Amy Friedman, Hana Habib, Norman Sadeh, Lorrie Faith Cranor, and Yuvraj Agarwal. 2016. How Short Is Too Short? Implications of Length and Framing on the Effectiveness of Privacy Notices. In Proc. of the Workshop on Usable Security.

[29]

Colin M. Gray and Shruthi Sai Chivukula. 2019. Ethical Mediation in UX Practice. In Proc. of CHI.

[30]

Colin M. Gray, Shruthi Sai Chivukula, and Ahreum Lee. 2020. What Kind of Work Do “Asshole Designers” Create? Describing Properties of Ethical Concern on Reddit. In Proc. of the Designing Interactive Systems Conference.

Digital Library

[31]

Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The Dark (Patterns) Side of UX Design. In Proc. of CHI.

Digital Library

[32]

Colin M. Gray, Cristiana Santos, Nataliia Bielova, Michael Toth, and Damian Clifford. 2021. Dark Patterns and the Legal Requirements of Consent Banners: An Interaction Criticism Perspective. In Proc. of CHI.

Digital Library

[33]

Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proc. of the Designing Interactive Systems Conference.

Digital Library

[34]

Hana Habib, Sarah Pearman, Jiamin Wang, Yixin Zou, Alessandro Acquisti, Lorrie Faith Cranor, Norman Sadeh, and Florian Schaub. 2020. “It's a Scavenger Hunt”: Usability of Websites' Opt-Out and Data Deletion Choices. In Proc. of CHI.

Digital Library

[35]

Hana Habib, Yixin Zou, Aditi Jannu, Neha Sridhar, Chelse Swoopes, Alessandro Acquisti, Lorrie Faith Cranor, Norman Sadeh, and Florian Schaub. 2019. An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites. In Proc. of the Workshop on Usable Security.

[36]

Woodrow Hartzog. 2011. Website Design as Contract. American University Law Review, Vol. 60, 1635 (2011). https://ssrn.com/abstract=1808108

[37]

Woodrow Hartzog. 2018. Privacy's Blueprint: The Battle to Control the Design of New Technologies .Harvard University Press.

[38]

Adrianne Jeffries. 2019. Yelp is Screwing Over Restaurants By Quietly Replacing Their Phone Numbers. https://www.vice.com/en_us/article/wjwebw/yelp-is-sneakily-replacing-restaurants-phone-numbers-so-grubhub-can-take-a-cut.

[39]

Carlos Jensen and Colin Potts. 2004. Privacy Policies As Decision-making Tools: An Evaluation of Online Privacy Notices. In Proc. of CHI.

Digital Library

[40]

Shan Jiang, John Martin, and Christo Wilson. 2019. Who's the Guinea Pig? Investigating Online A/B/n Tests in-the-Wild. In Proc. of the Conference on Fairness, Accountability, and Transparency (FAT* 2019).

Digital Library

[41]

Oksana Kulyk, Annika Hilt, Nina Gerber, and Melanie Volkamer. 2018. “This Website Uses Cookies”: Users' Perceptions and Reactions to the Cookie Disclaimer. In Proc. of European Workshop on Usable Security (EuroUSEC).

[42]

Thomas Linden, Rishabh Khandelwal, Hamza Harkous, and Kassem Fawaz. 01 Jan. 2020. The Privacy Policy Landscape After the GDPR. Proceedings on Privacy Enhancing Technologies, Vol. 2020, 1 ( 01 Jan. 2020), 47--64. https://doi.org/10.2478/popets-2020-0004

[43]

Jamie Luguri and Lior Strahilevitz. 2019. Shining a Light on Dark Patterns. U of Chicago, Public Law Working Paper No. 719; University of Chicago Coase-Sandor Institute for Law & Economics Research Paper No. 879 (2019). https://ssrn.com/abstract=3431205

[44]

Arunesh Mathur, Gunes Acar, Michael Friedman, Elena Lucherini, Jonathan Mayer, Marshini Chetty, and Arvind Narayanan. 2019. Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites. Proc. ACM Hum.-Comput. Interact., Vol. 1, CSCW (2019).

Digital Library

[45]

Arunesh Mathur, Jonathan Mayer, and Mihir Kshirsagar. 2021. What Makes a Dark Pattern... Dark?. In Proc. of CHI.

Digital Library

[46]

Anthony D. Miyazaki. 2008. Online Privacy and the Disclosure of Cookie Use: Effects on Consumer Trust and Anticipated Patronage. Journal of Public Policy & Marketing, Vol. 27, 1 (2008), 19--33. https://doi.org/10.1509/jppm.27.1.19

[47]

Carol Moser, Sarita Y. Schoenebeck, and Paul Resnick. 2019. Impulse Buying: Design Practices and Consumer Needs. In Proc. of CHI.

Digital Library

[48]

Arvind Narayanan, Arunesh Mathur, Marshini Chetty, and Mihir Kshirsagar. 2020. Dark Patterns: Past, Present, and Future. ACM Queue, Vol. 18, 2 (2020).

Digital Library

[49]

Harper Neidig. 2019. Senators spar with Google exec over use of `persuasive technology'. https://thehill.com/policy/technology/450261-senators-spar-with-google-exec-over-its-influence-on-users.

[50]

Don Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition .Basic Books.

Digital Library

[51]

Midas Nouwens, Ilaria Liccardi, Michael Veale, David Karger, and Lalana Kagal. 2020. Dark Patterns after the GDPR: Scraping Consent Pop-Ups and Demonstrating Their Influence. In Proc. of CHI.

Digital Library

[52]

Anshul Vikram Pandey, Katharina Rall, Margaret L. Satterthwaite, Oded Nov, and Enrico Bertini. 2015. How Deceptive Are Deceptive Visualizations?: An Empirical Analysis of Common Distortion Techniques. In Proc. of CHI.

Digital Library

[53]

Luana Pascu. 2019. US Senate to End Deceptive Practices and Dark Patterns on Online Platforms. https://hotforsecurity.bitdefender.com/blog/us-senate-to-end-deceptive-practices-and-dark-patterns-on-online-platforms-21062.html.

[54]

Andrew Perrin and Erica Turner. 2019. Smartphones help blacks, Hispanics bridge some -- but not all -- digital gaps with whites. Pew Research Center. (2019). https://www.pewresearch.org/fact-tank/2019/08/20/smartphones-help-blacks-hispanics-bridge-some-but-not-all-digital-gaps-with-whites/.

[55]

Victor Le Pochat, Tom Van Goethem, Samaneh Tajalizadehkhoob, Maciej Korczy'ski, and Wouter Joosen. 2019. Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulation. In Proc of NDSS.

[56]

Iskander Sanchez-Rola, Matteo Dell'Amico, Platon Kotzias, Davide Balzarotti, Leyla Bilge, Pierre-Antoine Vervier, and Igor Santos. 2019. Can I Opt Out Yet?: GDPR and the Global Illusion of Cookie Control. In Proc. of AsiaCCS.

Digital Library

[57]

Peter Story, Sebastian Zimmeck, and Norman Sadeh. 2018. Which Apps have Privacy Policies? An analysis of over one million Google Play Store apps. In Proc. of Annual Privacy Forum.

[58]

Richard H. Thaler. 2018. Nudge, not Sludge. Science, Vol. 361, 6401 (Aug. 2018).

[59]

Richard H. Thaler and Cass R. Sunstein. 2008. Nudge: Improving Decisions About Health, Wealth, and Happiness .Yale University Press.

[60]

Martino Trevisan, Stefano Traverso, Eleonora Bassi, and Marco Mellia. 01 Apr. 2019. 4 Years of EU Cookie Law: Results and Lessons Learned. Proceedings on Privacy Enhancing Technologies, Vol. 2019, 2 ( 01 Apr. 2019), 126--145. https://doi.org/10.2478/popets-2019-0023

[61]

Christine Utz, Martin Degeling, Sascha Fahl, Florian Schaub, and Thorsten Holz. 2019. (Un)informed Consent: Studying GDPR Consent Notices in the Field. In Proc. of CCS.

Digital Library

[62]

Giridhari Venkatadri, Elena Lucherini, Piotr Sapiezy'nski, and Alan Mislove. 2019. Investigating sources of PII used in Facebook's targeted advertising. In Proc. of PETS.

[63]

Ari Ezra Waldman. 2020. Cognitive biases, dark patterns, and the 'privacy paradox'. Current Opinion in Psychology, Vol. 31 (Feb. 2020), 105--109.

[64]

Jose P. Zagal, Staffan Bjork, and Chris Lewis. 2006. Dark Patterns in the Design of Games. In Proc. of Foundations of Digital Games (FDG '06).

[65]

Sebastian Zimmeck, Peter Story, Daniel Smullen, Abhilasha Ravichander, Ziqi Wang, Joel Reidenberg, N. Cameron Russell, and Norman Sadeh. 01 Jul. 2019. MAPS: Scaling Privacy Compliance Analysis to a Million Apps. Proceedings on Privacy Enhancing Technologies, Vol. 2019, 3 ( 01 Jul. 2019), 66--86. https://doi.org/10.2478/popets-2019-0037

Cited By

Kelly DRubin V(2024)Identifying Dark Patterns in User Account Disabling Interfaces: Content Analysis ResultsSocial Media + Society10.1177/2056305123122426910:1Online publication date: 27-Jan-2024
https://doi.org/10.1177/20563051231224269
Schäfer RSahabi SBrocker ABorchers J(2024)Growing Up With Dark Patterns: How Children Perceive Malicious User Interface DesignsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685358(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685358
Aung KSoubutts ESingh A(2024)"What a stupid way to do business": Towards an Understanding of Older Adults' Perceptions of Deceptive Patterns and Ways to Develop ResistanceProceedings of the ACM on Human-Computer Interaction10.1145/36771138:CHI PLAY(1-31)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677113
Show More Cited By

Index Terms

A Comparative Study of Dark Patterns Across Web and Mobile Modalities
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
2. Social and professional topics
  1. Computing / technology policy
    1. Commerce policy
      1. Consumer products policy

Recommendations

Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites

Dark patterns are user interface design choices that benefit an online service by coercing, steering, or deceiving users into making unintended and potentially harmful decisions. We present automated techniques that enable experts to identify dark ...
Understanding Dark Patterns in Home IoT Devices
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Internet-of-Things (IoT) devices are ubiquitous, but little attention has been paid to how they may incorporate dark patterns despite consumer protections and privacy concerns arising from their unique access to intimate spaces and always-on ...
Towards the Identification of Dark Patterns: An Analysis Based on End-User Reactions
IndiaHCI '20: Proceedings of the 11th Indian Conference on Human-Computer Interaction

A dark pattern is a user interface that purposefully deceives users for the benefit of the business by influencing their decision making process. The objectives of this research paper are three-fold. The first objective is to determine the difference in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue CSCW2

CSCW2

October 2021

5376 pages

EISSN:2573-0142

DOI:10.1145/3493286

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 October 2021

Published in PACMHCI Volume 5, Issue CSCW2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
4,345
Total Downloads

Downloads (Last 12 months)1,886
Downloads (Last 6 weeks)229

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kelly DRubin V(2024)Identifying Dark Patterns in User Account Disabling Interfaces: Content Analysis ResultsSocial Media + Society10.1177/2056305123122426910:1Online publication date: 27-Jan-2024
https://doi.org/10.1177/20563051231224269
Schäfer RSahabi SBrocker ABorchers J(2024)Growing Up With Dark Patterns: How Children Perceive Malicious User Interface DesignsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685358(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685358
Aung KSoubutts ESingh A(2024)"What a stupid way to do business": Towards an Understanding of Older Adults' Perceptions of Deceptive Patterns and Ways to Develop ResistanceProceedings of the ACM on Human-Computer Interaction10.1145/36771138:CHI PLAY(1-31)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677113
Hadan HSgandurra SZhang-Kennedy LNacke L(2024)Culture Clash: When Deceptive Design Meets Diverse Player ExpectationsCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678866(272-275)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678866
Hadan HZhang-Kennedy LNacke L(2024)Computer-based Deceptive Game Design in Commercial Virtual Reality Games: A Preliminary InvestigationCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678820(109-123)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678820
Sánchez Chamorro LToebosch RLallemand C(2024)Manipulative Design and Older Adults: Co-Creating Magic Machines to Understand Experiences of Online ManipulationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661513(668-684)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661513
Sanchez Chamorro LLallemand CGray C(2024)"My Mother Told Me These Things are Always Fake" - Understanding Teenagers' Experiences with Manipulative DesignsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660704(1469-1482)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660704
Zhang-Kennedy LKeleher MValiquette M(2024)Navigating the Gray: Design Practitioners' Perceptions Toward the Implementation of Privacy Dark PatternsProceedings of the ACM on Human-Computer Interaction10.1145/36373748:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637374
Lu YZhang CYang YYao YLi T(2024)From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UXProceedings of the ACM on Human-Computer Interaction10.1145/36373368:CSCW1(1-41)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637336
Seaborn KItagaki TWatanabe MWang YGeng PFujii TMandai YKojima MYoshida S(2024)Deceptive, Disruptive, No Big Deal: Japanese People React to Simulated Dark Commercial PatternsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651099(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651099
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents