research-article

Artificial Intelligence and Inclusion: : Formerly Gang-Involved Youth as Domain Experts for Analyzing Unstructured Twitter Data

Authors: William R. Frey, Desmond U. Patton, Michael B. Gaskell, Kyle A. McGregorAuthors Info & Claims

Social Science Computer Review, Volume 38, Issue 1

Pages 42 - 56

https://doi.org/10.1177/0894439318788314

Published: 01 February 2020 Publication History

Abstract

Mining social media data for studying the human condition has created new and unique challenges. When analyzing social media data from marginalized communities, algorithms lack the ability to accurately interpret off-line context, which may lead to dangerous assumptions about and implications for marginalized communities. To combat this challenge, we hired formerly gang-involved young people as domain experts for contextualizing social media data in order to create inclusive, community-informed algorithms. Utilizing data from the Gang Intervention and Computer Science Project—a comprehensive analysis of Twitter data from gang-involved youth in Chicago—we describe the process of involving formerly gang-involved young people in developing a new part-of-speech tagger and content classifier for a prototype natural language processing system that detects aggression and loss in Twitter data. We argue that involving young people as domain experts leads to more robust understandings of context, including localized language, culture, and events. These insights could change how data scientists approach the development of corpora and algorithms that affect people in marginalized communities and who to involve in that process. We offer a contextually driven interdisciplinary approach between social work and data science that integrates domain insights into the training of qualitative annotators and the production of algorithms for positive social impact.

References

[1]

Atkinson R. and Flint J. (2001). Accessing hidden and hard-to-reach populations: Snowball research strategies. Social Research Update, 33, 1–4.

[2]

American Civil Liberties Union. (n.d.). Retrieved March 25, 2018, from https://www.aclu.org/issues/racial-justice/race-and-criminal-justice

[3]

Anderson E. (1999). Code of the street (pp. 107–141). New York, NY: Norton.

[4]

Barlow D. E. and Barlow M. H. (2002). Racial profiling: A survey of African American police officers. Police Quarterly, 5, 334–358.

[5]

Blevins T., Kwiatkowski R., Macbeth J., McKeown K., Patton D., and Rambow O. (2016). Automatically processing Tweets from gang-involved youth: Towards detecting loss and aggression. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers (pp. 2196–2206). Osaka, Japan.

[6]

Brunson R. K. and Miller J. (2006). Young black men and urban policing in the United States. British Journal of Criminology, 46, 613–640.

[7]

Carter W. M. Jr. (2014). Thirteenth amendment and constitutional change. New York University Review of Law & Social Change, 38, 583.

[8]

Che D., Safran M., and Peng Z. (2013). From big data to big data mining: Challenges, issues, and opportunities. In Hong B., Meng X., Chen L., Winiwarter W., and Song W. (Eds.), International conference on database systems for advanced applications (pp. 1–15). Berlin, Heidelberg: Springer.

[9]

Christians C. G. and Chen S.-L. S. (2004). Introduction: Technological environments and the evolution of social research methods. In Johns M. D., Chen S. L. S., and Hall G. J. (Eds.), Online social research. Methods, issues, & ethics (pp. 15–23). New York, NY: Peter Lang.

[10]

Citizens Crime Commission of New York City Researching Inequity in Society Ecologically Team. (2017). E-responder: A brief about preventing real world violence using digital intervention. Retrieved March 29, 2018, from http://www.nycrimecommission.org/pdfs/e-responder-brief-1.pdf

[11]

Constine J. (2017, November 27). Facebook rolls out AI to detect suicidal posts before they’re reported. Retrieved November 29, 2017, from https://techcrunch.com/2017/11/27/facebook-ai-suicide-prevention/

[12]

Decuyper A. (2016). On the research for big data uses for public good purposes. Opportunities and challenges. Réseaux Sociaux et Territoires, 30, 305–314.

[13]

Doshi-Velez F., Kortz M., Budish R., Bavitz C., Gershman S., and O’Brien D.…Wood A. (2017). Accountability of AI under the law: The role of explanation. arXiv preprint arXiv: 1711.01134.

[14]

Gandomi A. and Haider M. (2015). Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management, 35, 137–144.

Digital Library

[15]

Goffman A. (2015). On the run: Fugitive life in an American city. London, England: Picador.

[16]

Hackman R. (2015, April 23). Is the online surveillance of black teenagers the new stop-and-frisk? Retrieved February 15, 2016, from http://www.theguardian.com/us-news/2015/apr/23/online-surveillance-black-teenagers-new-stop-and-frisk

[17]

International Association of Chiefs of Police. (2015). 2015 Social media survey results. Retrieved from http://www.socialmedia.org/Portals/1/documents/FULL%202015%20Social%20Media%20Survey%20Results.pdf

[18]

Khan N., Yaqoob I., Hashem I. A. T., Inayat Z., Mahmoud Ali W. K., and Alam M.…Gani A. (2014). Big data: Survey, technologies, opportunities, and challenges. The Scientific World Journal, 2014, 1–18.

[19]

Labrinidis A. and Jagadish H. V. (2012). Challenges and opportunities with big data. Proceedings of the VLDB Endowment, 5, 2032–2033.

[20]

Lane J. (2016). The digital street: An ethnographic study of networked street life in Harlem. American Behavioral Scientist, 60, 43–58.

[21]

Manning C. D., Surdeanu M., Bauer J., Finkel J. R., Bethard S., and McClosky D. (2014). The Stanford CoreNLP natural language processing toolkit. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations (pp. 55–60). Retrieved from http://www.anthology.aclweb.org/P/P14/P14-5010.pdf

[22]

Meehan A. J. and Ponder M. C. (2002). Race and place: The ecology of racial profiling African American motorists. Justice Quarterly, 19, 399–430.

[23]

Owuputi O., O’Connor B., Dyer C., Gimpel K., Schneider N., and Smith N. A. (2013). Improved part-of-speech tagging for online conversational text with word clusters. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 380–391). Stroudsburg, PA: Association for Computational Linguistics. Retrieved from http://aclweb.org/anthology/N/N13/N13-1000.pdf

[24]

Patton D. U., Brunton D. W., Dixon A., Miller R. J., Leonard P., and Hackman R. (2017). Stop and frisk online: Theorizing everyday racism in digital policing in the use of social media for identification of criminal conduct and associations. Social Media + Society, 3, 1–10.

[25]

Patton D. U., Eschmann R. D., and Butler D. A. (2013). Internet banging: New trends in social media, gang violence, masculinity and hip hop. Computers in Human Behavior, 29, A54–A59. doi:10.1016/j.chb.2012.12.035

[26]

Patton D. U., Eschmann R. D., Elsaesser C., and Bocanegra E. (2016). Sticks, stones and Facebook accounts: What violence outreach workers know about social media and urban-based gang violence in Chicago. Computers in Human Behavior, 65, 591–600.

Digital Library

[27]

Patton D. U., McKeown K., Rambow O., and Macbeth J. (2016). Using natural language processing and qualitative analysis to intervene in gang violence: A collaboration between social work researchers and data scientists. Bloomberg Data for Good Exchange Conference, (pp. 1–5).

[28]

Quan-Haase A. and McCay-Peet L. (2017). Building interdisciplinary social media research teams: Benefits, challenges, and policy frameworks. In Sloan L. and Quan-Haase A. (Eds.), Handbook of social media research methods (pp. 41–56). London, England: Sage.

[29]

Rizkallah J. (2017, October 12). The big (unstructured) data problem. Retrieved November 16, 2017, from https://www.forbes.com/sites/forbestechcouncil/2017/06/05/the-big-unstructured-data-problem/#1bdc09dc493a

[30]

Seitz J. (2016, January 11). Automatically finding weapons in social media images part 1. Retrieved November 16, 2017, from https://www.bellingcat.com/resources/2016/01/11/automatically-finding-weapons-in-social-media-images-part-1/

[31]

Suthaharan S. (2014). Big data classification: Problems and challenges in network intrusion prediction with machine learning. ACM SIGMETRICS Performance Evaluation Review, 41, 70–73.

Digital Library

[32]

Talluri S. (2016). Big data using cloud technologies. Global Journal of Computer Science and Technology, 16. Retrieved from https://computerresearch.org/index.php/computer/article/view/1395

Author Biographies

Author Biographies

William R. Frey is a doctoral student, qualitative researcher, and digital ethnographer in the SAFElab at Columbia University’s School of Social Work. He holds an MSW from University of Michigan’s School of Social Work.

Desmond U. Patton is an associate professor and director of the SAFElab at Columbia University’s School of Social Work and a fellow at the Berkman Klein Center for Internet and Society at Harvard University. He is an expert in social media communication and youth violence.

Michael B. Gaskell is a postdoctoral research scientist in the SAFElab at Columbia University’s School of Social Work. He holds a PhD in clinical psychology from Xavier University.

Kyle A. McGregor is an assistant professor in the Department of Child and Adolescent Psychology and Department of Population Health at New York University’s Langone Health. He is also the director of Pediatric Mental Health Ethics.

Cited By

Yoo DWoo HPendse SLu NBirnbaum MAbowd GDe Choudhury M(2024)Missed Opportunities for Human-Centered AI Research: Understanding Stakeholder Collaboration in Mental Health AI ResearchProceedings of the ACM on Human-Computer Interaction10.1145/36373728:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637372
Yoo DWoo HNguyen VBirnbaum MKruzan KKim JAbowd GDe Choudhury M(2024)Patient Perspectives on AI-Driven Predictions of Schizophrenia Relapses: Understanding Concerns and Opportunities for Self-Care and TreatmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642369(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642369
Yfantidou SSermpezis PVakali ABaeza-Yates R(2023)Uncovering Bias in Personal InformaticsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109147:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610914
Show More Cited By

Index Terms

Artificial Intelligence and Inclusion: Formerly Gang-Involved Youth as Domain Experts for Analyzing Unstructured Twitter Data

Index terms have been assigned to the content through auto-classification.

Recommendations

Sticks, stones and Facebook accounts

Recent research has identified a relatively new trend among youth (1224) living in violent urban neighborhoods. These youth use social networking sites like Facebook, Twitter and Instagram to brag about violence, make threats, recruit gang members and ...
Ethical Considerations in the Application of Artificial Intelligence to Monitor Social Media for COVID-19 Data
Abstract
The COVID-19 pandemic and its related policies (e.g., stay at home and social distancing orders) have increased people’s use of digital technology, such as social media. Researchers have, in turn, utilized artificial intelligence to analyze social ...
Ethical Artificial Intelligence in Telerehabilitation of Neurodevelopmental Disorders: A Position Paper
Computational Science and Its Applications – ICCSA 2023 Workshops
Abstract
Neurodevelopmental disorders are a cluster of mental disorders with neurobiological origins that occur during the development of children and lead to cognitive deficits with possible behavioral and emotional consequences. Intensive and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Social Science Computer Review Volume 38, Issue 1

Feb 2020

105 pages

ISSN:0894-4393

Issue’s Table of Contents

© The Author(s) 2018.

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 February 2020

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yoo DWoo HPendse SLu NBirnbaum MAbowd GDe Choudhury M(2024)Missed Opportunities for Human-Centered AI Research: Understanding Stakeholder Collaboration in Mental Health AI ResearchProceedings of the ACM on Human-Computer Interaction10.1145/36373728:CSCW1(1-24)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637372
Yoo DWoo HNguyen VBirnbaum MKruzan KKim JAbowd GDe Choudhury M(2024)Patient Perspectives on AI-Driven Predictions of Schizophrenia Relapses: Understanding Concerns and Opportunities for Self-Care and TreatmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642369(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642369
Yfantidou SSermpezis PVakali ABaeza-Yates R(2023)Uncovering Bias in Personal InformaticsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109147:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610914
Groves LPeppin AStrait ABrennan J(2023)Going public: the role of public participation approaches in commercial AI labsProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594071(1162-1173)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3593013.3594071
Cruz SRedding AChau CLu CPersche JHester JJacobs M(2023)EquityWare: Co-Designing Wearables With And For Low Income Communities In The U.S.Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580980(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580980
Png M(2022)At the Tensions of South and North: Critical Roles of Global South Stakeholders in AI GovernanceProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533200(1434-1445)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3533200
Jung JSteinberger TKing JAckerman M(2022)How Domain Experts Work with Data: Situating Data Science in the Practices and Settings of CraftworkProceedings of the ACM on Human-Computer Interaction10.1145/35129056:CSCW1(1-29)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512905
Long DBlunt TMagerko B(2021)Co-Designing AI Literacy Exhibits for Informal Learning SpacesProceedings of the ACM on Human-Computer Interaction10.1145/34760345:CSCW2(1-35)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476034
Suresh HGuttag J(2021)A Framework for Understanding Sources of Harm throughout the Machine Learning Life CycleProceedings of the 1st ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3465416.3483305(1-9)Online publication date: 5-Oct-2021
https://dl.acm.org/doi/10.1145/3465416.3483305
Bullock JYoung MWang YGiest SGrimmelikhuijsen S(2020)Artificial intelligence, bureaucratic form, and discretion in public serviceInformation Polity10.3233/IP-20022325:4(491-506)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.3233/IP-200223

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents