Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3287560.3287587acmconferencesArticle/Chapter ViewAbstractPublication PagesfacctConference Proceedingsconference-collections
research-article

A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media

Published: 29 January 2019 Publication History

Abstract

Powered by machine learning techniques, social media provides an unobtrusive lens into individual behaviors, emotions, and psychological states. Recent research has successfully employed social media data to predict mental health states of individuals, ranging from the presence and severity of mental disorders like depression to the risk of suicide. These algorithmic inferences hold great potential in supporting early detection and treatment of mental disorders and in the design of interventions. At the same time, the outcomes of this research can pose great risks to individuals, such as issues of incorrect, opaque algorithmic predictions, involvement of bad or unaccountable actors, and potential biases from intentional or inadvertent misuse of insights. Amplifying these tensions, there are also divergent and sometimes inconsistent methodological gaps and under-explored ethics and privacy dimensions. This paper presents a taxonomy of these concerns and ethical challenges, drawing from existing literature, and poses questions to be resolved as this research gains traction. We identify three areas of tension: ethics committees and the gap of social media research; questions of validity, data, and machine learning; and implications of this research for key stakeholders. We conclude with calls to action to begin resolving these interdisciplinary dilemmas.

References

[1]
American Psychiatric Association et al. 2013. Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub.
[2]
John W. Ayers, Theodore L. Caputi, Camille Nebeker, and Mark Dredze. 2018. Don't quote me: reverse identification of research participants in social media studies. npj Digital Medicine, 1, 1, 30.
[3]
Mitja D Back, Juliane M Stopfer, Simine Vazire, Sam Gaddis, Stefan C Schmukle, Boris Egloff, and Samuel D Gosling. 2010. Facebook profiles reflect actual personality, not self-idealization. Psychological science, 21, 3, 372--374.
[4]
Joshua Barrie. 2014. People are freaking out over this new anti-suicide twitter app. (Nov. 2014). https:/www.businessinsider.com/people-freaking-out-over-samaritans-twitter-app-2014-11.
[5]
Adrian Benton, Glen Coppersmith, and Mark Dredze. 2017. Ethical research protocols for social media health research. In Proceedings of the First ACL Workshop on Ethics in Natural Language Processing, 94--102.
[6]
Michael L Birnbaum, Sindhu Kiranmai Ernala, Asra F Rizvi, Munmun De Choudhury, and John M Kane. 2017. A collaborative approach to identifying social media markers of schizophrenia by employing machine learning and clinical appraisals. Journal of medical Internet research, 19, 8.
[7]
Johan Bollen, Huina Mao, and Alberto Pepe. 2011. Modeling public mood and emotion: twitter sentiment and socio-economic phenomena. In ICWSM.
[8]
Boyd, danah and Kate Crawford. 2012. Critical questions for big data: provocations for a cultural, technological, and scholarly phenomenon. Information, communication & society, 15, 5, 662--679.
[9]
Amy Bruckman. 2002. Studying the amateur artist: a perspective on disguising data collected in human subjects research on the internet. Ethics and Information Technology, 4, 3, 217--231.
[10]
Jenna Burrell. 2016. How the machine 'thinks': understanding opacity in machine learning algorithms. Big Data & Society, 3, 1, 2053951715622512.
[11]
Rafael A Calvo, David N Milne, M Sazzad Hussain, and Helen Christensen. 2017. Natural language processing in mental health applications using non-clinical texts. Natural Language Engineering, 23, 5, 649--685.
[12]
Katherine Carpenter and David Dittrich. 2011. Bridging the distance: removing the technology buffer and seeking consistent ethical analysis in computer security research. In 1st International Digital Ethics Symposium. Loyola University Chicago Center for Digital Ethics and Policy.
[13]
Stevie Chancellor, Zhiyuan Lin, Erica L Goodman, Stephanie Zerwas, and Munmun De Choudhury. 2016. Quantifying and predicting mental illness severity in online pro-eating disorder communities. In CSCW. ACM.
[14]
Stevie Chancellor, Tanushree Mitra, and Munmun De Choudhury. 2016. Recovery amid pro-anorexia: analysis of recovery in social media. In CHI. ACM.
[15]
Qijin Cheng, Tim Mh H Li, Chi-Leung Leung Kwok, Tingshao Zhu, and Paul Sf F Yip. 2017. Assessing suicide risk and emotional distress in Chinese social media: A text mining and machine learning study. Journal of Medical Internet Research, 19, 7, (July 2017), 1--10. ISSN: 14388871.
[16]
Cindy Chung and James W Pennebaker. 2007. The psychological functions of function words. Social communication, 1, 343--359.
[17]
Mike Conway. 2014. Ethical issues in using twitter for public health surveillance and research: Developing a taxonomy of ethical concepts from the research literature. Journal of Medical Internet Research, 16, 12.
[18]
Mike Conway and Daniel O'Connor. 2016. Social media, big data, and mental health: current advances and ethical implications. Current opinion in psychology, 9, 77--82.
[19]
Glen Coppersmith, Mark Dredze, and Craig Harman. 2014. Quantifying Mental Health Signals in Twitter. In CLPsych, 51--60.
[20]
Glen Coppersmith, Mark Dredze, Craig Harman, and Kristy Hollingshead. 2015. From adhd to sad: analyzing the language of mental health on twitter through self-reported diagnoses. In CLPsych.
[21]
Glen Coppersmith, Craig Harman, and Mark H Dredze. 2014. Measuring post traumatic stress disorder in Twitter. In ICWSM.
[22]
Glen Coppersmith, Kim Ngo, Ryan Leary, and Anthony Wood. 2016. Exploratory analysis of social media prior to a suicide attempt. In CLPsych.
[23]
Patrick Corrigan. 2004. How stigma interferes with mental health care. American psychologist, 59, 7, 614.
[24]
Amit Datta, Anupam Datta, Jael Makagon, Deirdre K Mulligan, and Michael Carl Tschantz. 2018. Discrimination in online advertising: a multidisciplinary inquiry. In Conference on Fairness, Accountability and Transparency, 20--34.
[25]
Munmun De Choudhury. 2015. Anorexia on tumblr: a characterization study. In DH. ACM, 43--50.
[26]
Munmun De Choudhury, Scott Counts, and Eric Horvitz. 2013. Predicting postpartum changes in emotion and behavior via social media. In CHI. ACM.
[27]
Munmun De Choudhury, Scott Counts, Eric J Horvitz, and Aaron Hoff. 2014. Characterizing and predicting postpartum depression from shared facebook data. In CSCW. ACM, 626--638.
[28]
Munmun De Choudhury, Michael Gamon, Scott Counts, and Eric Horvitz. 2013. Predicting depression via social media. In ICWSM.
[29]
Munmun De Choudhury and Emre Kiciman. 2017. The language of social support in social media and its effect on suicidal ideation risk. In ICWSM.
[30]
Munmun De Choudhury, Emre Kiciman, Mark Dredze, Glen Coppersmith, and Mrinal Kumar. 2016. Discovering shifts to suicidal ideation from mental health content in social media. In CHI. ACM, 2098--2110.
[31]
Peter Sheridan Dodds, Kameron Decker Harris, Isabel M Kloumann, Catherine A Bliss, and Christopher M Danforth. 2011. Temporal patterns of happiness and information in a global social network: hedonometrics and twitter. PloS one, 6, 12.
[32]
Ezekiel J Emanuel, David Wendler, and Christine Grady. 2000. What makes clinical research ethical? Jama, 283, 20, 2701--2711.
[33]
Gunther Eysenbach. 2009. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. Journal of medical Internet research, 11, 1.
[34]
Casey Fiesler and Nicholas Proferes. 2018. "participant" perceptions of twitter research ethics. Social Media + Society, 4, 1.
[35]
Tarleton Gillespie and Nick Seaver. 2016. Critical algorithm studies: a reading list. Social Media Collective.
[36]
Jeremy Ginsberg, Matthew H Mohebbi, Rajan S Patel, Lynnette Brammer, Mark S Smolinski, and Larry Brilliant. 2009. Detecting influenza epidemics using search engine query data. Nature, 457, 7232, 1012.
[37]
George Gkotsis, Anika Oellrich, Sumithra Velupillai, Maria Liakata, Tim JP Hubbard, Richard JB Dobson, and Rina Dutta. 2017. Characterisation of mental health conditions in social media using informed deep learning. Scientific reports, 7, 45141.
[38]
Scott A Golder and Michael W Macy. 2011. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science, 333, 6051, 1878--1881.
[39]
Li Guan, Bibo Hao, Qijin Cheng, Paul SF F Yip, and Tingshao Zhu. 2015. Identifying Chinese Microblog Users With High Suicide Probability Using Internet-Based Profile and Linguistic Features: Classification Model. JMIR Mental Health.
[40]
Eszter Hargittai. 2015. Is Bigger Always Better? Potential Biases of Big Data Derived from Social Network Sites. The ANNALS of the American Academy of Political and Social Science, May, 63--76.
[41]
Department of Health and Human Services. 2018. Vulnerable populations. (2018). https:/www.hhs.gov/ohrp/regulations-and-policy/guidance/vulnerable-populations/index.html.
[42]
Brent Hecht et al. 2018. It's time to do something: mitigating the negative impacts of computing through a change to the peer review process. (Mar. 2018). https://acm-fca.org/2018/03/29/negativeimpacts/.
[43]
Jake M Hofman, Amit Sharma, and Duncan J Watts. 2017. Prediction and explanation in social systems. Science, 355, 6324, 486--488.
[44]
Christopher Homan, Ravdeep Johar, Tong Liu, Megan Lytle, Vincent Silenzio, and Cecilia Ovesdotter Alm. 2014. Toward macro-insights for suicide prevention: analyzing fine-grained distress at scale. In CLPsych, 107--117.
[45]
Eric Horvitz and Deirdre Mulligan. 2015. Data, privacy, and the greater good. Science, 349, 6245, 253--255.
[46]
Xiaolei Huang, Lei Zhang, David Chiu, Tianli Liu, Xin Li, and Tingshao Zhu. 2014. Detecting Suicidal Ideation in Chinese Microblogs with Psychological Lexicons. IEEE UIC-ATC-ScalCom, 2014, 844--849.
[47]
James M Hudson and Amy Bruckman. 2004. "go away": participant objections to being studied and the ethics of chatroom research. The Information Society, 20, 2, 127--139.
[48]
2018. International compilation of human research standards. (2018). https:/www.hhs.gov/ohrp/international/compilation-human-research-standards/index.html.
[49]
Zunaira Jamil, Diana Inkpen, Prasadith Buddhitha, and Kenton White. 2017. Monitoring tweets for depression to detect at-risk users. In CLPsych, 32--40.
[50]
Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2017. Human decisions and machine predictions. The quarterly journal of economics, 133, 1, 237--293.
[51]
Adam Kramer. 2010. An unobtrusive behavioral model of gross national happiness. In CHI. ACM, 287--290.
[52]
Adam Kramer, Jamie E Guillory, and Jeffrey T Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences.
[53]
David Lazer, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. The Parable of Google Flu: Traps in Big Data Analysis. Science, 343, 6167, 1203--1205.
[54]
Dave Lee. 2014. Samaritans pulls 'suicide watch' radar app. (Nov. 2014). http://www.bbc.com/news/technology-29962199.
[55]
Huijie Lin, Jia Jia, Quan Guo, Yuanyuan Xue, Qi Li, Jie Huang, Lianhong Cai, and Ling Feng. 2014. User-level psychological stress detection from social media using deep neural network. In MM (MM '14). New York, NY, USA.
[56]
Lydia Manikonda and Munmun De Choudhury. 2017. Modeling and understanding visual attributes of mental health disclosures in social media. In CHI.
[57]
National Institute of Mental Health. 2018. Eating disorders. (2018). https:/www.nimh.nih.gov/health/statistics/eating-disorders.shtml.
[58]
Jacob Metcalf and Kate Crawford. 2016. Where are human subjects in Big Data research? The emerging ethics divide. Big Data & Society, 3, 1, 205395171665021.
[59]
Jude Mikal, Samantha Hurst, and Mike Conway. 2016. Ethical issues in using twitter for population-level depression monitoring: a qualitative study. BMC medical ethics, 17, 1, 22.
[60]
Margaret Mitchell, Kristy Hollingshead, and Glen Coppersmith. 2015. Quantifying the language of schizophrenia in social media. In CLPsych, 11--20.
[61]
Wendy Moncur. 2013. The emotional wellbeing of researchers: considerations for practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1883--1890.
[62]
Dan Muriello, Lizzy Donahue, Danny Ben-David, Umut Ozertem, and Reshef Shilon. 2018. Under the hood: suicide prevention tools powered by ai. (Feb. 2018). https://code.fb.com/ml-applications/under-the-hood-suicide-prevention-tools-powered-by-ai/.
[63]
Tetsuaki Nakamura, Kay Kubo, Yasuyuki Usuda, and Eiji Aramaki. 2014. Defining patients with depressive disorder by using textual information. AAAI.
[64]
Helen Nissenbaum. 2004. Privacy as contextual integrity. Wash. L. Rev., 79, 119.
[65]
Christopher Norval and Tristan Henderson. 2017. Contextual consent: ethical mining of social media for health research. In Proceedings of the WSDM 2017 Workshop on Mining Online Health Reports.
[66]
Alexandra Olteanu, Carlos Castillo, Fernando Diaz, and Emre Kiciman. 2016. Social data: biases, methodological pitfalls, and ethical boundaries.
[67]
World Health Organization. 2017. Depression and other common mental disorders: global health estimates.
[68]
Sungkyu Park, Sang Won Lee, Jinah Kwak, Meeyoung Cha, and Bumseok Jeong. 2013. Activities on facebook reveal the depressive state of users. Journal of medical Internet research, 15, 10.
[69]
Michael J Paul and Mark Dredze. 2017. Social monitoring for public health. Synthesis Lectures on Information Concepts, Retrieval, and Services, 9, 5, 1--183.
[70]
Michael J Paul and Mark Dredze. 2011. You are what you tweet: analyzing twitter for public health. In ICWSM. Vol. 20, 265--272.
[71]
James W Pennebaker. 1997. Writing about emotional experiences as a therapeutic process. Psychological science, 8, 3, 162--166.
[72]
National Commission for the Protection of Human Subjects of Biomedicaland Behavioral Research. 1978. The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. Superintendent of Documents.
[73]
Andrew G Reece and Christopher M Danforth. 2017. Instagram photos reveal predictive markers of depression. EPJ Data Science, 6, 1, 15.
[74]
Philip Resnik, Anderson Garron, and Rebecca Resnik. 2013. Using topic modeling to improve prediction of neuroticism and depression in college students. EMNLP, October, 1348--1353.
[75]
Guy Rosen. 2017. Getting our community help in real time. (Nov. 2017). https://newsroom.fb.com/news/2017/11/getting-our-community-help-in-real-time/.
[76]
Adam Sadilek, Henry A Kautz, and Vincent Silenzio. 2012. Modeling spread of disease from social interactions. In ICWSM, 322--329.
[77]
Koustuv Saha, Larry Chan, Kaya De Barbara, Gregory D Abowd, and Munmun De Choudhury. 2017. Inferring mood instability on social media by leveraging ecological momentary assessments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1, 3, 95.
[78]
H Andrew Schwartz, Johannes Eichstaedt, Margaret L Kern, Gregory Park, Maarten Sap, David Stillwell, Michal Kosinski, and Lyle Ungar. 2014. Towards assessing changes in degree of depression through facebook. In CLPsych.
[79]
H Andrew Schwartz et al. 2013. Characterizing geographic variation in well-being using tweets. In ICWSM, 583--591.
[80]
H Andrew Schwartz et al. 2013. Personality, gender, and age in the language of social media: the open-vocabulary approach. PloS one, 8, 9, e73791.
[81]
Judy Hanwen Shen and Frank Rudzicz. 2017. Detecting anxiety through reddit. In CLPsych, 58--65.
[82]
T Simms, C Ramstedt, M Rich, M Richards, T Martinez, and C Giraud-Carrier. 2017. Detecting Cognitive Distortions Through Machine Learning Text Analytics. ICHI.
[83]
2018. Summary of the hipaa security rule. (2018). https:/www.hhs.gov/hipaa/for-professionals/security/laws-regulations/index.html.
[84]
Sho Tsugawa, Yusuke Kikuchi, Fumio Kishino, Kosuke Nakajima, Yuichi Itoh, and Hiroyuki Ohsaki. 2015. Recognizing depression from twitter activity. In CHI. ACM, 3187--3196.
[85]
Effy Vayena, Marcel Salathé, Lawrence C Madoff, and John S Brownstein. 2015. Ethical challenges of big data in public health. PLoS computational biology, 11, 2, e1003904.
[86]
James Vincent. 2017. Facebook is using ai to spot users with suicidal thoughts and send them help. (Nov. 2017). https:/www.theverge.com/2017/11/28/16709224/facebook-suicidal-thoughts-ai-help.
[87]
Tao Wang, Markus Brede, Antonella Ianni, and Emmanouil Mentzakis. 2017. Detecting and Characterizing Eating-Disorder Communities on Social Media. In WSDM. ACM, New York, NY, USA, 91--100.
[88]
Xinyu Wang, Chunhong Zhang, Yang Ji, Li Sun, Leijia Wu, and Zhana Bao. 2013. A depression detection model based on sentiment analysis in micro-blog social network. In PAKDD. Vol. 7867 LNAI, 201--213.
[89]
Yilin Wang, Jiliang Tang, Jundong Li, Baoxin Li, Yali Wan, Clayton Mellina, Neil O'Hare, and Yi Chang. 2017. Understanding and discovering deliberate self-harm content in social media. In WWW, 93--102.
[90]
Brooke Foucault Welles. 2014. On minorities and outliers: The case for making Big Data small. Big Data & Society, 1, 1, 205395171454061.
[91]
Akkapon Wongkoblap, Miguel A Vadillo, and Vasa Curcin. 2017. Researching mental health disorders in the era of social media: systematic review. Journal of Medical Internet Research, 19, 6.
[92]
Michael Zimmer. 2018. Addressing Conceptual Gaps in Big Data Research Ethics: An Application of Contextual Integrity. Social Media + Society, 4, 2.
[93]
Michael Zimmer. 2010. "but the data is already public": on the ethics of research in facebook. Ethics and information technology, 12, 4, 313--325.
[94]
Michael Zimmer and Nicholas John Proferes. 2014. A topology of twitter research: disciplines, methods, and ethics. Aslib Journal of Information Management, 66, 3, 250--261.

Cited By

View all
  • (2024)Harnessing AI for Political EngagementSustainable Development, Humanities, and Social Sciences for Society 5.010.4018/979-8-3693-7989-9.ch008(143-160)Online publication date: 18-Oct-2024
  • (2024)Digital Government and AISustainable Development, Humanities, and Social Sciences for Society 5.010.4018/979-8-3693-7989-9.ch007(125-142)Online publication date: 18-Oct-2024
  • (2024)Navigating the Ethical ComplexitiesReviving and Re-Writing Ethics in Social Research For Commoning the Community10.4018/978-1-6684-8526-2.ch009(139-158)Online publication date: 5-Mar-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
FAT* '19: Proceedings of the Conference on Fairness, Accountability, and Transparency
January 2019
388 pages
ISBN:9781450361255
DOI:10.1145/3287560
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. algorithms
  2. ethics
  3. machine learning
  4. mental health
  5. social media

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

FAT* '19
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)416
  • Downloads (Last 6 weeks)48
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Harnessing AI for Political EngagementSustainable Development, Humanities, and Social Sciences for Society 5.010.4018/979-8-3693-7989-9.ch008(143-160)Online publication date: 18-Oct-2024
  • (2024)Digital Government and AISustainable Development, Humanities, and Social Sciences for Society 5.010.4018/979-8-3693-7989-9.ch007(125-142)Online publication date: 18-Oct-2024
  • (2024)Navigating the Ethical ComplexitiesReviving and Re-Writing Ethics in Social Research For Commoning the Community10.4018/978-1-6684-8526-2.ch009(139-158)Online publication date: 5-Mar-2024
  • (2024)AI for Analyzing Mental Health Disorders Among Social Media Users: Quarter-Century Narrative Review of Progress and ChallengesJournal of Medical Internet Research10.2196/5922526(e59225)Online publication date: 15-Nov-2024
  • (2024)Missed Opportunities for Human-Centered AI Research: Understanding Stakeholder Collaboration in Mental Health AI ResearchProceedings of the ACM on Human-Computer Interaction10.1145/36373728:CSCW1(1-24)Online publication date: 26-Apr-2024
  • (2024)Emotion AI Use in U.S. Mental Healthcare: Potentially Unjust and Techno-SolutionistProceedings of the ACM on Human-Computer Interaction10.1145/36373248:CSCW1(1-46)Online publication date: 26-Apr-2024
  • (2024)Building, Shifting, & Employing Power: A Taxonomy of Responses From Below to Algorithmic HarmProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658958(1093-1106)Online publication date: 3-Jun-2024
  • (2024)Data Agency Theory: A Precise Theory of Justice for AI ApplicationsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658930(631-641)Online publication date: 3-Jun-2024
  • (2024)Societal-Scale Human-AI Interaction Design? How Hospitals and Companies are Integrating Pervasive Sensing into Mental HealthcareProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642793(1-16)Online publication date: 11-May-2024
  • (2024)Patient Perspectives on AI-Driven Predictions of Schizophrenia Relapses: Understanding Concerns and Opportunities for Self-Care and TreatmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642369(1-20)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media