extended-abstract

MOSafely: Building an Open-Source HCAI Community to Make the Internet a Safer Place for Youth

Authors:

Xavier V Caddle,

Gianluca Stringhini,

Munmun De Choudhury,

Pamela J. WisniewskiAuthors Info & Claims

CSCW '21 Companion: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing

Pages 315 - 318

https://doi.org/10.1145/3462204.3481731

Published: 23 October 2021 Publication History

Abstract

The goal of this one-day workshop is to build an active community of researchers, practitioners, and policy-makers who are jointly committed to leveraging human-centered artificial intelligence (HCAI) to make the internet a safer place for youth. This community will be founded on the principles of open innovation and human dignity to address some of the most salient safety issues of modern-day internet, including online harassment, sexual solicitation, and the mental health of vulnerable internet users, particularly adolescents and young adults. We will partner with Mozilla Research Foundation to launch a new open project named “MOSafely.org,” which will serve as a platform for code library, research, and data contributions that support the mission of internet safety. During the workshop, we will discuss: 1) the types of contributions and technical standards needed to advance the state-of-the art in online risk detection, 2) the practical, legal, and ethical challenges that we will face, and 3) ways in which we can overcome these challenges through the use of HCAI to create a sustainable community. An end goal of creating the MOSafely community is to offer evidence-based, customizable, robust, and low-cost technologies that are accessible to the public for youth protection.

References

[1]

Zainab Agha, Neeraj Chatlani, Afsaneh Razi, and Pamela Wisniewski. 2020. Towards Conducting Responsible Research with Teens and Parents regarding Online Risks. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.

Digital Library

[2]

Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins, 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion 58(2020), 82–115.

Digital Library

[3]

Karla Badillo-Urquiola, Zachary Shea, Zainab Agha, Irina Lediaeva, and Pamela Wisniewski. 2021. Conducting Risky Research with Teens: Co-Designing for the Ethical Treatment and Protection of Adolescents. Proc. ACM Hum.-Comput. Interact. 4, CSCW3, Article 231 (Jan. 2021), 46 pages. https://doi.org/10.1145/3432930

Digital Library

[4]

Eric PS Baumer. 2017. Toward human-centered algorithm design. Big Data & Society 4, 2 (2017), 2053951717718854. https://doi.org/10.1177/2053951717718854 arXiv:https://doi.org/10.1177/2053951717718854

[5]

Ian Cairns. 2020. Introducing a new and improved Twitter API. Retrieved February 10, 2021 from https://blog.twitter.com/developer/en_us/topics/tools/2020/introducing_new_twitter_api.html

[6]

Stevie Chancellor, Michael L Birnbaum, Eric D Caine, Vincent MB Silenzio, and Munmun De Choudhury. 2019. A taxonomy of ethical tensions in inferring mental health states from social media. In Proceedings of the conference on fairness, accountability, and transparency. 79–88.

Digital Library

[7]

Despoina Chatzakou, Nicolas Kourtellis, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Athena Vakali. 2017. Mean birds: Detecting aggression and bullying on twitter. In Proceedings of the 2017 ACM on web science conference. 13–22.

Digital Library

[8]

Ying Chen, Yilu Zhou, Sencun Zhu, and Heng Xu. 2012. Detecting offensive language in social media to protect adolescent online safety. In 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing. IEEE, 71–80.

Digital Library

[9]

Munmun De Choudhury, Scott Counts, Eric J Horvitz, and Aaron Hoff. 2014. Characterizing and predicting postpartum depression from shared facebook data. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 626–638.

Digital Library

[10]

Munmun De Choudhury, Michael Gamon, Scott Counts, and Eric Horvitz. 2013. Predicting depression via social media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 7.

[11]

Munmun De Choudhury, Emre Kiciman, Mark Dredze, Glen Coppersmith, and Mrinal Kumar. 2016. Discovering shifts to suicidal ideation from mental health content in social media. In Proceedings of the 2016 CHI conference on human factors in computing systems. 2098–2110.

Digital Library

[12]

Rebecca Fiebrink and Marco Gillies. 2018. Introduction to the Special Issue on Human-Centered Machine Learning. ACM Trans. Interact. Intell. Syst. 8, 2 (June 2018), 7:1–7:7. https://doi.org/10.1145/3205942

Digital Library

[13]

Heidi Hartikainen, Afsaneh Razi, and Pamela Wisniewski. 2021. Safe Sexting: The Advice and Support Adolescents Receive from Peers regarding Online Sexual Risks. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1(2021), 1–31.

Digital Library

[14]

Seunghyun Kim, Afsaneh Razi, Gianluca Stringhini, Pamela J Wisniewski, and Munmun De Choudhury. 2021. You Don’t Know How I Feel: Insider-Outsider Perspective Gaps in Cyberbullying Risk Detection. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 15. 290–302.

[15]

Chen Ling, Utkucan Balcı, Jeremy Blackburn, and Gianluca Stringhini. 2021. A first look at zoombombing. In IEEE Symposium on Security and Privacy.

[16]

Enrico Mariconti, Guillermo Suarez-Tangil, Jeremy Blackburn, Emiliano De Cristofaro, Nicolas Kourtellis, Ilias Leontiadis, Jordi Luque Serrano, and Gianluca Stringhini. 2019. ” You Know What to Do” Proactive Detection of YouTube Videos Targeted by Coordinated Hate Attacks. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–21.

[17]

Desmond U Patton, William R Frey, Kyle A McGregor, Fei-Tzin Lee, Kathleen McKeown, and Emanuel Moss. 2020. Contextual Analysis of Social Media: The Promise and Challenge of Eliciting Context in Social Media Posts with Natural Language Processing. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. 337–342.

Digital Library

[18]

Afsaneh Razi, Zainab Agha, Neeraj Chatlani, and Pamela Wisniewski. 2020. Privacy Challenges for Adolescents as a Vulnerable Population. In Networked Privacy Workshop of the 2020 CHI Conference on Human Factors in Computing Systems.

[19]

Afsaneh Razi, Karla Badillo-Urquiola, and Pamela J Wisniewski. 2020. Let’s Talk about Sext: How Adolescents Seek Support and Advice about Their Online Sexual Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[20]

Afsaneh Razi, Seunghyun Kim, Munmun De Choudhury, and Pamela Wisniewski. 2019. Ethical considerations for adolescent online risk detection AI systems. In Good Systems: Ethical AI for CSCW (The 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing).

[21]

Naomi Shiffman. 2021. Social Media, Social Life. Teens Reveal Their Experiences. Retrieved February 18, 2021 from https://help.crowdtangle.com/en/articles/4558716-understanding-and-citing-crowdtangle-data

[22]

Muhammad Uzair Tariq, Afsaneh Razi, Karla Badillo-Urquiola, and Pamela Wisniewski. 2019. A Review of the Gaps and Opportunities of Nudity and Skin Detection Algorithmic Research for the Purpose of Combating Adolescent Sexting Behaviors. In Human-Computer Interaction. Design Practice in Contemporary Societies(Lecture Notes in Computer Science), Masaaki Kurosu(Ed.). Springer International Publishing, Cham, 90–108. https://doi.org/10.1007/978-3-030-22636-7_6

Digital Library

[23]

Yuping Wang, Fatemeh Tamahsbi, Jeremy Blackburn, Barry Bradlyn, Emiliano De Cristofaro, David Magerman, Savvas Zannettou, and Gianluca Stringhini. 2021. Understanding the Use of Fauxtography on Social Media. In AAAI International Conference on Web and Social Media (ICWSM).

[24]

Pamela Wisniewski, Arup Kumar Ghosh, Heng Xu, Mary Beth Rosson, and John M. Carroll. 2017. Parental Control vs. Teen Self-Regulation: Is There a Middle Ground for Mobile Online Safety?. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW ’17). Association for Computing Machinery, New York, NY, USA, 51–69. https://doi.org/10.1145/2998181.2998352

Digital Library

[25]

Pamela Wisniewski, Haiyan Jia, Na Wang, Saijing Zheng, Heng Xu, Mary Beth Rosson, and John M. Carroll. 2015. Resilience Mitigates the Negative Effects of Adolescent Internet Addiction and Online Risk Exposure. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 4029–4038. https://doi.org/10.1145/2702123.2702240

Digital Library

[26]

Pamela Wisniewski, Heng Xu, Mary Beth Rosson, Daniel F. Perkins, and John M. Carroll. 2016. Dear Diary: Teens Reflect on Their Weekly Online Risk Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 3919–3930. https://doi.org/10.1145/2858036.2858317

Digital Library

[27]

Savvas Zannettou, Tristan Caulfield, Emiliano De Cristofaro, Michael Sirivianos, Gianluca Stringhini, and Jeremy Blackburn. 2019. Disinformation warfare: Understanding state-sponsored trolls on Twitter and their influence on the web. In Companion proceedings of the 2019 world wide web conference. 218–226.

Digital Library

Cited By

Alsoubai ARazi AAgha ZAli SStringhini GDe Choudhury MWisniewski P(2024)Profiling the Offline and Online Risk Experiences of Youth to Develop Targeted Interventions for Online SafetyProceedings of the ACM on Human-Computer Interaction10.1145/36373918:CSCW1(1-37)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637391
Razi AAlsoubai AKim SAli SStringhini GDe Choudhury MWisniewski P(2023)Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of YouthProceedings of the ACM on Human-Computer Interaction10.1145/35795227:CSCW1(1-29)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579522
Capel TBrereton M(2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580959
Show More Cited By

Recommendations

A Social Ecological Approach to Empowering Foster Youth to be Safer Online
CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

Foster teens are some of the most vulnerable youth who are subject to serious online risks, such as sex trafficking. My 2017 IDC literature review paper highlighted the need to develop effective sociotechnical interventions to empower foster youth ...
Family factors in Internet addiction among Chinese youth: A review of English- and Chinese-language studies
Highlights
- This is the first review of family correlates of Internet addiction among Chinese adolescents.
- Internet addiction is endemic among Chinese youth and increasingly prevalent.
- Families of youth with Internet addiction experience ...
Abstract
Approximately 513 million Chinese citizens used the Internet in 2011, with adolescents reporting comparatively high levels of use. Although numerous studies (reviewed herein) indicate that Internet Addiction/Pathological Internet Use (IA/PIU) is ...
From Ignoring Strangers’ Solicitations to Mutual Sexting with Friends: Understanding Youth’s Online Sexual Risks in Instagram Private Conversations
CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing

Online sexual risks pose a serious and frequent threat to adolescents’ online safety. While significant work is done within the HCI community to understand teens’ sexual experiences through public posts, we extend their research by qualitatively ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '21 Companion: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing

October 2021

370 pages

ISBN:9781450384797

DOI:10.1145/3462204

Editors:
Jeremy Birnholtz
Northwestern University, USA
,
Luigina Ciolfi
University College Cork, Ireland
,
Sharon Ding
Fudan University, China
,
Susan Fussell
Cornell University, USA
,
Andrés Monroy-Hernández
Snap, Inc., USA
,
Sean Munson
University of Washington, USA
,
Irina Shklovski
University of Copenhagen, Denmark
,
Mor Naaman
Cornell Tech, USA

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2021

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

CSCW '21

Sponsor:

SIGCHI

CSCW '21: Computer Supported Cooperative Work and Social Computing

October 23 - 27, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)5

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alsoubai ARazi AAgha ZAli SStringhini GDe Choudhury MWisniewski P(2024)Profiling the Offline and Online Risk Experiences of Youth to Develop Targeted Interventions for Online SafetyProceedings of the ACM on Human-Computer Interaction10.1145/36373918:CSCW1(1-37)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637391
Razi AAlsoubai AKim SAli SStringhini GDe Choudhury MWisniewski P(2023)Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of YouthProceedings of the ACM on Human-Computer Interaction10.1145/35795227:CSCW1(1-29)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579522
Capel TBrereton M(2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580959
Caddle XNaher NMiller ZBadillo-Urquiola KWisniewski P(2022)Duty to RespondProceedings of the ACM on Human-Computer Interaction10.1145/35675567:GROUP(1-35)Online publication date: 29-Dec-2022
https://dl.acm.org/doi/10.1145/3567556

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents