Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

'Don't make assumptions about me!': Understanding Children's Perception of Datafication Online

Published: 11 November 2022 Publication History

Abstract

Datafication, which is the process in which children's actions online are pervasively recorded, tracked, aggregated, analysed, and exploited by online services in multiple ways that include behavioural engineering, and monetisation, is becoming increasing common in the online world today. However, we know little about how children feel about such practices and how they perceive datafication. Through online interviews with 48 children aged 7-13 from UK schools, we examined how children perceive datafication practices, especially how such practices could make inference on them. We identified three key knowledge gaps in children's perceptions, including their lack of recognition of who were involved in the data processing and how, data being transmitted across platforms, and their data ownership. Through situating our findings under a critical algorithmic literacy framework, our findings provided some immediate indications regarding how we could better support children in the datafied society through more transparency and autonomy-supportive designs, as well as the need for a fundamental shift of the current data governance structure.

References

[1]
1998. Children's Online Privacy Protection Rule ("COPPA"). https://www.ftc.gov/enforcement/rules/rulemaking-regulatory-reform-proceedings/childrens-online-privacy-protection-rule
[2]
2020. Age appropriate design: a code of practice for online services. https://ico.org.uk/for-organisations/guide-to-data-protection/key-data-protection-themes/age-appropriate-design-a-code-of-practice-for-online-services/
[3]
2020. Guidance for Regulation of Artificial Intelligence Applications. https://www.whitehouse.gov/wp-content/uploads/2020/11/M-21-06.pdf
[4]
2020. What is automated individual decision-making and profiling? https://ico.org.uk/for-organisations/guide-to-data-protection/guide-to-the-general-data-protection-regulation-gdpr/automated-decision-making-and-profiling/what-is-automated-individual-decision-making-and-profiling/
[5]
2021. Ethical Web And Data Architectures. https://www.oxfordmartin.ox.ac.uk/ethical-web-and-data-architectures/
[6]
2021. Proposal for a REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL LAYING DOWN HARMONISED RULES ON ARTIFICIAL INTELLIGENCE (ARTIFICIAL INTELLIGENCE ACT) AND AMENDING CERTAIN UNION LEGISLATIVE ACTS. https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX:52021PC0206
[7]
Amelia Acker and Leanne Bowler. 2017. What is your Data Silhouette? Raising teen awareness of their data traces in social media. In Proceedings of the 8th International Conference on Social Media & Society. 1--5.
[8]
Ezequiel Aleman, Larysa Nadolny, Alejandro Ferreira, Bruno Gabetti, Guillermo Ortíz, and Martín Zanoniani. 2021. Screening Bot: a Playground for Critical Algorithmic Literacy Engagement with Youth. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play. 198--202.
[9]
Alex Barco, Chiara de Jong, Jochen Peter, Rinaldo Kühne, and Caroline L. van Straten. 2020. Robot Morphology and Children's Perception of Social Robots: An Exploratory Study. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI '20). Association for Computing Machinery, New York, NY, USA, 125--127. https://doi.org/10.1145/3371382.3378348
[10]
Richard M Billow. 1981. Observing spontaneous metaphor in children. Journal of Experimental Child Psychology 31, 3 (1981), 430--445.
[11]
Leanne Bowler, Amelia Acker, Wei Jeng, and Yu Chi. 2017. "It lives all around us": Aspects of data literacy in teen's lives. Proceedings of the association for information science and technology 54, 1 (2017), 27--35.
[12]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.
[13]
Moritz Büchi, Eduard Fosch-Villaronga, Christoph Lutz, Aurelia Tamò-Larrieux, and Shruthi Velidi. 2021. Making sense of algorithmic profiling: user perceptions on Facebook. Information, Communication & Society (2021), 1--17.
[14]
Moritz Büchi, Eduard Fosch-Villaronga, Christoph Lutz, Aurelia Tamò-Larrieux, Shruthi Velidi, and Salome Viljoen. 2020. The chilling effects of algorithmic profiling: Mapping the issues. Computer law & security review 36 (2020), 105367.
[15]
Lynne Cameron. 1996. Discourse context and the development of metaphor in children. Current Issues in Language & Society 3, 1 (1996), 49--64.
[16]
European Commision. 2021. General Data Protection Regulation (GDPR). https://gdpr-info.eu/
[17]
European Commission. 2016. The European Digital Competence Framework for Citizens.
[18]
Nick Couldry and Ulises A Mejias. 2019. The costs of connection. Stanford University Press.
[19]
Fiery Cushman. 2013. Action, outcome, and value: A dual-system framework for morality. Personality and social psychology review 17, 3 (2013), 273--292.
[20]
Sayamindu Dasgupta and Benjamin Mako Hill. 2017. Scratch community blocks: Supporting children as data scientists. In Proceedings of the 2017 CHI conference on human factors in computing systems. 3620--3631.
[21]
Sayamindu Dasgupta and Benjamin Mako Hill. 2020. Designing for Critical Algorithmic Literacies. arXiv preprint arXiv:2008.01719 (2020).
[22]
Stefania Druga and Amy J Ko. 2021. How Do Children's Perceptions of Machine Intelligence Change When Training and Coding Smart Programs?. In Interaction Design and Children (Athens, Greece) (IDC '21). Association for Computing Machinery, New York, NY, USA, 49--61. https://doi.org/10.1145/3459990.3460712
[23]
Stefania Druga, Sarah T Vu, Eesh Likhith, and Tammy Qiu. 2019. Inclusive AI literacy for kids around the world. In Proceedings of FabLearn 2019. 104--111.
[24]
Stefania Druga, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2018. How smart are the smart toys? Children and parents' agent interaction and intelligence attribution. In Proceedings of the 17th ACM Conference on Interaction Design and Children. 231--240.
[25]
Catherine D'Ignazio and Rahul Bhargava. 2015. Approaches to building big data literacy. In Proceedings of the Bloomberg data for good exchange conference.
[26]
UK Council for Internet Safety. 2020. Education for a Connected World -- 2020 edition. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/896323/UKCIS_Education_for_a_Connected_World_.pdf
[27]
5 Rights Foundation. 2021. Playful by Design: Free play in a digital world. https://digitalfuturescommission.org.uk/wp-content/uploads/2021/11/A-Vision-of-Free-Play-in-a-Digital-World.pdf
[28]
Google. 2021. Be Internet Legends. https://beinternetlegends.withgoogle.com/en_ie
[29]
HM Government. 2020. Online Harms White Paper.
[30]
Wendy S Grolnick, Edward L Deci, and Richard M Ryan. 1997. Internalization within the family: The self-determination theory perspective. Parenting and children's internalization of values: A handbook of contemporary theory (1997), 135--161.
[31]
Samantha Hautea, Sayamindu Dasgupta, and Benjamin Mako Hill. 2017. Youth perspectives on critical data literacies. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 919--930.
[32]
Clint Andrew Heinze, Janet Haase, and Helen Higgins. 2010. An action research report from a multi-year approach to teaching artificial intelligence at the k-6 level. In First AAAI Symposium on Educational Advances in Artificial Intelligence.
[33]
Alexis Hiniker, Sharon S Heung, Sungsoo Ray Hong, and Julie A Kientz. 2018. Coco's Videos: An Empirical Investigation of Video-Player Design Features and Children's Media Use. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 254.
[34]
ICO. 2021. Designing data transparency for children. https://ico.org.uk/media/2620177/designing-data-transparency-for-children.pdf
[35]
DQ Institute. 2021. Digital Intellegence Framework. https://www.dqinstitute.org/global-standards/
[36]
Engin Isin and Evelyn Ruppert. 2020. Being digital citizens. Rowman & Littlefield Publishers.
[37]
Yasmin Kafai, Chris Proctor, and Debora Lui. 2020. From theory bias to theory dialogue: embracing cognitive, situated, and critical framings of computational thinking in K-12 CS education. ACM Inroads 11, 1 (2020), 44--53.
[38]
Peter H Kahn, Batya Friedman, Deanne R Perez-Granados, and Nathan G Freier. 2006. Robotic pets in the lives of preschool children. Interaction Studies 7, 3 (2006), 405--436.
[39]
Gabriella Kazai, Iskander Yusof, and Daoud Clarke. 2016. Personalised news and blog recommendations based on user location, Facebook and Twitter user profiling. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 1129--1132.
[40]
Baroness Kidron, Alexandra Evans, and Jenny Afia. 2018. Disrupted Chldhood. (2018).
[41]
Jacqueline M. Kory-Westlund and Cynthia Breazeal. 2019. Assessing Children's Perceptions and Acceptance of a Social Robot. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (Boise, ID, USA) (IDC '19). Association for Computing Machinery, New York, NY, USA, 38--50. https://doi.org/10.1145/3311927.3323143
[42]
Priya Kumar, Shalmali Milind Naik, Utkarsha Ramesh Devkar, Marshini Chetty, Tamara L. Clegg, and Jessica Vitak. 2017. 'No Telling Passcodes Out Because They're Private': Understanding Children's Mental Models of Privacy and Security Online. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 64 (dec 2017), 21 pages. https://doi.org/10.1145/3134699
[43]
Priya Kumar, Shalmali Milind naik, Utkarsha Ramesh Devkar, Marshini Chetty, Tamara L. Clegg, and Jessica Vitak. 2018. No Telling Passcodes Out Because They're Private?: Understanding Children's Mental Models of Privacy and Security Online. In Proceedings of ACM Human-Computer Interaction (CSCW '18 Online First). ACM.
[44]
Priya Kumar, Jessica Vitak, Marshini Chetty, Tamara L Clegg, Jonathan Yang, Brenna McNally, and Elizabeth Bonsignore. 2018. Co-designing online privacy-related games and stories with children. In Proceedings of the 17th ACM Conference on Interaction Design and Children. ACM, 67--79.
[45]
Lego. 2021. Captain Safety. https://www.lego.com/en-gb/life/digital-safety
[46]
David Leslie. 2019. Understanding artificial intelligence ethics and safety: A guide for the responsible design and implementation of AI systems in the public sector. https://doi.org/10.5281/zenodo.3240529
[47]
Sonia Livingstone. 2018. Children: a special case for privacy? Intermedia 46, 2 (2018), 18--23.
[48]
Sonia Livingstone, Mariya Stoilova, and Rishita Nandagiri. 2019. Children's data and privacy online. Technology 58, 2 (2019), 157--65.
[49]
Duri Long and Brian Magerko. 2020. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--16.
[50]
Kai Lukoff, Ulrik Lyngs, Himanshu Zade, J Vera Liao, James Choi, Kaiyue Fan, Sean A Munson, and Alexis Hiniker. 2021. How the Design of YouTube Influences User Sense of Agency. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--17.
[51]
Deborah Lupton and Ben Williamson. 2017. The datafied child: The dataveillance of children and implications for their rights. New Media & Society 19, 5 (2017), 780--794.
[52]
Ulrik Lyngs, Kai Lukoff, Petr Slovak, Reuben Binns, Adam Slack, Michael Inzlicht, Max Van Kleek, and Nigel Shadbolt. 2019. Self-control in cyberspace: Applying dual systems theory to a review of digital self-control tools. In proceedings of the 2019 CHI conference on human factors in computing systems. 1--18.
[53]
Shawna Malvini Redden and Amy K Way. 2017. "Adults don't understand': exploring how teens use dialectical frameworks to navigate webs of tensions in online life. Journal of Applied Communication Research 45, 1 (2017), 21--41.
[54]
Giovanna Mascheroni. 2020. Datafied childhoods: Contextualising datafication in everyday life. Current Sociology 68, 6 (2020), 798--813.
[55]
Ariadna Matamoros-Fernández. 2017. Platformed racism: The mediation and circulation of an Australian race-based controversy on Twitter, Facebook and YouTube. Information, Communication & Society 20, 6 (2017), 930--946.
[56]
Brenna McNally, Priya Kumar, Chelsea Hordatt, Matthew Louis Mauriello, Shalmali Naik, Leyla Norooz, Alazandra Shorter, Evan Golub, and Allison Druin. 2018. Co-designing Mobile Online Safety Applications with Children. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 523.
[57]
Ulises A Mejias and Nick Couldry. 2019. Datafication. Internet Policy Review 8, 4 (2019).
[58]
Gaspar Isaac Melsión, Ilaria Torre, Eva Vidal, and Iolanda Leite. 2021. Using Explainability to Help Children Understand Gender Bias in AI. In Interaction Design and Children (Athens, Greece) (IDC '21). Association for Computing Machinery, New York, NY, USA, 87--99. https://doi.org/10.1145/3459990.3460719
[59]
David Mioduser and Sharona T Levy. 2010. Making sense by building sense: Kindergarten children's construction and understanding of adaptive robot behaviors. International Journal of Computers for Mathematical Learning 15, 2 (2010), 99--127.
[60]
Lilian Mitrou, Miltiadis Kandias, Vasilis Stavrou, and Dimitris Gritzalis. 2014. Social media profiling: A Panopticon or Omniopticon tool?. In Proc. of the 6th Conference of the Surveillance Studies Network. Barcelona, Spain.
[61]
House of Lords House of Commons; Joint Committee on the Draft Online Safety Bill. 2021. Draft Online Safety Bill. https://www.gov.uk/government/publications/draft-online-safety-bill
[62]
Ofcom. 2021. Children and parents: media use and attitudes report 2020/21. https://www.ofcom.org.uk/__data/assets/pdf_file/0025/217825/children-and-parents-media-use-and-attitudes-report-2020--21.pdf
[63]
Ofcom.org. [n. d.]. children and parents: media use and attitudes report 2019. https://www.ofcom.org.uk/__data/assets/pdf_file/0023/190616/children-media-use-attitudes-2019-report.pdf
[64]
Ofcom.org. [n. d.]. Ofcom Children's Media Lives: Life in Lockdown. https://www.ofcom.org.uk/__data/assets/pdf_file/0024/200976/cml-life-in-lockdown-report.pdf
[65]
Joint Committee on the Draft Online Safety Bill. 2021. Draft Online Safety Bill. https://committees.parliament.uk/publications/8206/documents/84092/default/
[66]
Luci Pangrazio and Lourdes Cardozo-Gaibisso. 2021. "Your Data Can Go to Anyone": The Challenges of Developing Critical Data Literacies in Children. In Critical digital literacies: Boundary-crossing practices. Brill, 35--51.
[67]
Luci Pangrazio and Neil Selwyn. 2017. 'My Data, My Bad...' Young People's Personal Data Understandings and (Counter) Practices. In Proceedings of the 8th International Conference on Social Media & Society. 1--5.
[68]
Ashwini Rao, Florian Schaub, and Norman Sadeh. 2015. What do they know about me? Contents and concerns of online behavioral profiles. arXiv preprint arXiv:1506.01675 (2015).
[69]
Mitchel Resnick, Robbie Berg, and Michael Eisenberg. 2000. Beyond black boxes: Bringing transparency and aesthetics back to scientific investigation. The Journal of the Learning Sciences 9, 1 (2000), 7--30.
[70]
Bernhard Rieder. 2017. Scrutinizing an algorithmic technique: The Bayes classifier as interested reading of reality. Information, Communication & Society 20, 1 (2017), 100--117.
[71]
Meredith L Rowe, Seyda Özçaliskan, and Susan Goldin-Meadow. 2008. Learning words by hand: Gesture's role in predicting vocabulary development. First language 28, 2 (2008), 182--199.
[72]
Marijn Sax. 2016. Big data: Finders keepers, losers weepers? Ethics and Information Technology 18, 1 (2016), 25--31.
[73]
Kavya Sharma, Xinhui Zhan, Fiona Fui-Hoon Nah, Keng Siau, and Maggie X Cheng. 2021. Impact of digital nudging on information security behavior: an experimental study on framing and priming in cybersecurity. Organizational Cybersecurity Journal: Practice, Process and People (2021).
[74]
Mariya Stoilova, Sonia Livingstone, and Rishita Nandagiri. 2020. Digital by default: Children's capacity to understand and manage online data and privacy. Media and Communication (2020).
[75]
THORN. 2021. Responding to Online Threats: Minors' Perspectives on Disclosing, Reporting, and Blocking. https://info.thorn.org/hubfs/Research/Responding%20to%20Online%20Threats_2021-Full-Report.pdf
[76]
Kjerstin Thorson, Kelley Cotter, Mel Medeiros, and Chankyung Pak. 2021. Algorithmic inference, political interest, and exposure to news and politics on Facebook. Information, Communication & Society 24, 2 (2021), 183--200.
[77]
UNESCO. 2019. Digital Kids: Asia-Pacific competence framework. https://www.gcedclearinghouse.org/sites/default/files/resources/190165eng.pdf
[78]
Sandra Wachter. 2020. Affinity Profiling and Discrimination by Association in Online Behavioral Advertising. Berkeley Tech. LJ 35 (2020), 367.
[79]
Jacqueline M Kory Westlund and Cynthia Breazeal. 2016. Transparency, teleoperation, and children's understanding of social robots. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 625--626.
[80]
Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. A is for artificial intelligence: the impact of artificial intelligence activities on young children's perceptions of robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--11.
[81]
Karen Yeung. 2020. Recommendation of the council on artificial intelligence (oecd). International Legal Materials 59, 1 (2020), 27--34.
[82]
YouTube. 2021. Terms of Service. https://kids.youtube.com/t/terms
[83]
Brahim Zarouali, Koen Ponnet, Michel Walrave, and Karolien Poels. 2017. "Do you like cookies?" Adolescents' skeptical processing of retargeted Facebook-ads and the moderating role of privacy concern and a textual debriefing. Computers in Human Behavior 69 (2017), 157--165.
[84]
Jun Zhao, Ge Wang, Carys Dally, Petr Slovak, Julian Edbrooke-Childs, Max Van Kleek, and Nigel Shadbolt. 2019. I make up a silly name' Understanding Children's Perception of Privacy Risks Online. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.
[85]
Jun Zhao, Ge Wang, Carys Dally, Petr Slovak, Julian Edbrooke-Childs, Max Van Kleek, and Nigel Shadbolt. 2019. "I Make up a Silly Name': Understanding Children's Perception of Privacy Risks Online. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300336
[86]
Shoshana Zuboff. 2019. The age of surveillance capitalism: The fight for a human future at the new frontier of power: Barack Obama's books of 2019. Profile books.

Cited By

View all
  • (2024)Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading ActivitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870358:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
  • (2024)BreathPro: Monitoring Breathing Mode during Running with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596078:2(1-25)Online publication date: 15-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 6, Issue CSCW2
CSCW
November 2022
8205 pages
EISSN:2573-0142
DOI:10.1145/3571154
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2022
Published in PACMHCI Volume 6, Issue CSCW2

Permissions

Request permissions for this article.

Check for updates

Badges

  • Honorable Mention

Author Tags

  1. children
  2. data inference
  3. datafication
  4. online platforms

Qualifiers

  • Research-article

Funding Sources

  • EPSRC Impact Acceleration Account Award

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)353
  • Downloads (Last 6 weeks)36
Reflects downloads up to 21 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading ActivitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870358:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
  • (2024)BreathPro: Monitoring Breathing Mode during Running with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596078:2(1-25)Online publication date: 15-May-2024
  • (2024)ICY Interfaces: Exploration of Ice’s Ephemeral Features for Digital Game User ExperienceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660725(2107-2124)Online publication date: 1-Jul-2024
  • (2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
  • (2024)F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice InteractionProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661860(127-140)Online publication date: 3-Jun-2024
  • (2024)EarSlideProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435158:1(1-29)Online publication date: 6-Mar-2024
  • (2024)LiquImagerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435098:1(1-29)Online publication date: 6-Mar-2024
  • (2024)Combating Islamophobia: Compromise, Community, and Harmony in Mitigating Harmful Online ContentACM Transactions on Social Computing10.1145/36415107:1(1-32)Online publication date: 27-Apr-2024
  • (2024)Monotonicity and the Precision of Program AnalysisProceedings of the ACM on Programming Languages10.1145/36328978:POPL(1629-1662)Online publication date: 5-Jan-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media