research-article

Community Engagement Triage: Lightweight Prompts for Systematic Reviews

Authors:

Luca Maria Aiello,

Daniele QuerciaAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 1, Issue CSCW

Article No.: 39, Pages 1 - 22

https://doi.org/10.1145/3134674

Published: 06 December 2017 Publication History

Abstract

Among platform designers there is still little actionable knowledge about how to foster community engagement, and new community platforms are likely to fail. Much research has documented effects that could inform better designs, however there is a lack of practical methods to review particular concerns. We design a lightweight method for systematic reviews of community engagement scenarios, based on a catalogue of 59 techniques, presented in the form of method cards, and co-developed with community engagement experts. We validate it in problem-solving workshops with organisers, and find that a full review is feasible in under 15 minutes, that it provides effective prompts and important guidance, and can successfully support process innovation. Finally, we validate it for use in summative evaluations of online communities. In a large-scale observational study of 1 million Flickr users, application of the method reveals the surprising impact of a major site redesign: it successfully increased content engagement, but at the expense of social interactions.

References

[1]

Charles Abraham and Susan Michie. 2008. A taxonomy of behavior change techniques used in interventions. Health psychology, Vol. 27, 3 (2008), 379.

[2]

Luca Maria Aiello. 2015. Group Types in Social Media. User Community Discovery, bibfieldeditorGeorgios Paliouras, Symeon Papadopoulos, Dimitrios Vogiatzis, and Yiannis Kompatsiaris (Eds.). Springer International Publishing, Chapter 5, 97--134.

[3]

Maria Antikainen, Marko M"akip"a"a, and Mikko Ahonen. 2010. Motivating and supporting collaboration in open innovation. European Journal of Innovation Management Vol. 13, 1 (2010), 100--119.

[4]

Jaime Arguello, Brian S Butler, Elisabeth Joyce, Robert Kraut, Kimberly S Ling, Carolyn Rosé, and Xiaoqing Wang. 2006. Talk to me: foundations for successful individual-group interactions in online communities. In Proc. SIGCHI '06. ACM, 959--968.

Digital Library

[5]

Albert-László Barabási and Réka Albert. 1999. Emergence of scaling in random networks. science, Vol. 286, 5439 (1999), 509--512.

[6]

Jonathan Bishop. 2007. Increasing participation in online communities: A framework for human-computer interaction. Computers in human behavior Vol. 23, 4 (2007), 1881--1893.

Digital Library

[7]

Martin Boeker, Werner Vach, and Edith Motschall. 2013. Google Scholar as replacement for systematic literature searches. BMC medical research methodology Vol. 13, 1 (2013), 1.

[8]

Wichor M Bramer, Dean Giustini, Bianca MR Kramer, and PF Anderson. 2013. The comparative recall of Google Scholar versus in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews. Systematic reviews, Vol. 2, 1 (2013), 1.

[9]

E Gil Clary, Mark Snyder, Robert D Ridge, John Copeland, Arthur A Stukas, Julie Haugen, and Peter Miene. 1998. Understanding and assessing the motivations of volunteers: a functional approach. Journal of personality and social psychology, Vol. 74, 6 (1998), 1516.

[10]

Dan Cosley, Dan Frankowski, Sara Kiesler, Loren Terveen, and John Riedl. 2005. How oversight improves member-maintained communities Proc. SIGCHI '05. ACM, 11--20.

Digital Library

[11]

Nicolas Ducheneaut, Nicholas Yee, Eric Nickell, and Robert J Moore. 2007. The life and death of online gaming communities: a look at guilds in world of warcraft Proc. SIGCHI '07. ACM, 839--848.

Digital Library

[12]

Andrea Forte and Cliff Lampe. 2013. Defining, understanding, and supporting open collaboration lessons from the literature. American Behavioral Scientist Vol. 57, 5 (2013), 535--547.

[13]

Gartner. 2012. Organizations That Integrate Communities Into Customer Support Can Realize Cost Reductions of Up to 50 Percent. (2012). http://www.gartner.com/newsroom/id/1929014

[14]

Jean-Franccois Gehanno, Laetitia Rollin, and Stefan Darmoni. 2013. Is the coverage of Google Scholar enough to be used alone for systematic reviews. BMC medical informatics and decision making, Vol. 13, 1 (2013), 1.

[15]

Mordechai Muki Haklay. 2016. Why is participation inequality important? European Handbook of Crowdsourced Geographic Information (2016), 35--44.

[16]

Hahrie Han. 2014. How organizations develop activists: Civic associations and leadership in the 21st century. Oxford University Press, USA.

[17]

Caroline Haythornthwaite. 2007. Social networks and online community. The Oxford handbook of Internet psychology (2007), 121--137.

[18]

Quy Huy and Andrew Shipilov. 2015. The Key to Social Media Success Within Organizations. (2015). http://sloanreview.mit.edu/article/the-key-to-social-media-success-within-organizations/

[19]

IDEO. 2003. method cards: 51 ways to inspire design. Palo Alto (2003).

[20]

Gerjo Kok, Nell H Gottlieb, Gjalt-Jorn Y Peters, Patricia Dolan Mullen, Guy S Parcel, Robert AC Ruiter, María E Fernández, Christine Markham, and L Kay Bartholomew. 2015. A taxonomy of behaviour change methods: an intervention mapping approach. Health psychology review (2015), 1--16.

[21]

Julia Kramer, Shanna R Daly, Seda Yilmaz, and Colleen M Seifert. 2014. A case-study analysis of design heuristics in an upper-level cross-disciplinary design course. (2014).

[22]

Robert Kraut, Sara Kiesler, Bonka Boneva, Jonathon Cummings, Vicki Helgeson, and Anne Crawford. 2002. Internet paradox revisited. Journal of social issues Vol. 58, 1 (2002), 49--74.

[23]

Robert E Kraut. 2003. Applying social psychological theory to the problems of group work. HCI models, theories and frameworks: Toward a multidisciplinary science (2003), 325--356.

[24]

Robert E Kraut, Paul Resnick, Sara Kiesler, Moira Burke, Yan Chen, Niki Kittur, Joseph Konstan, Yuqing Ren, and John Riedl. 2012. Building successful online communities: Evidence-based social design. MIT Press.

Digital Library

[25]

Karel Kreijns, Paul A Kirschner, and Wim Jochems. 2003. Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research. Computers in human behavior Vol. 19, 3 (2003), 335--353.

[26]

Cliff Lampe, Rick Wash, Alcides Velasquez, and Elif Ozkaya. 2010. Motivations to participate in online communities. Proc. SIGCHI '10. ACM, 1927--1936.

Digital Library

[27]

Roz Lasker and Elisa Weiss. 2003. Broadening participation in community problem solving: a multidisciplinary model to support collaborative practice and research. Journal of Urban Health Vol. 80, 1 (2003).

[28]

Charlene Li. 2015. Why No One Uses the Corporate Social Network. (2015). https://hbr.org/2015/04/why-no-one-uses-the-corporate-social-network

[29]

Chris Luebkeman. 2009. Drivers of change. Appropriate Technology Vol. 36, 4 (2009), 67.

[30]

Lynne C Manzo and Douglas D Perkins. 2006. Finding common ground: The importance of place attachment to community participation and planning. Journal of planning literature Vol. 20, 4 (2006), 335--350.

[31]

Cameron Marlow. 2004. Audience, structure and authority in the weblog community International Communication Association Conference, Vol. Vol. 27.

[32]

Susan Michie, Michelle Richardson, Marie Johnston, Charles Abraham, Jill Francis, Wendy Hardeman, Martin Eccles, James Cane, and Caroline Wood. 2013. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques. Annals of Behavioral Medicine Vol. 46, 1 (2013).

[33]

Susan Michie, Maartje M van Stralen, and Robert West. 2011. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implementation Science Vol. 6, 1 (2011), 1.

[34]

Michael Muller. 2012. Lurking as personal trait or situational disposition: lurking and contributing in enterprise social media. In Proc. CSCW '12. ACM.

Digital Library

[35]

Michael Muller, N Sadat Shami, David R Millen, and Jonathan Feinberg. 2010. We are all lurkers: consuming behaviors among authors and readers in an enterprise file-sharing service. In Proc. GROUP '10. ACM.

Digital Library

[36]

MyLife. 2013. Top 10 Failed Social Media Sites. (2013). https://www.mylife.com/blog/uncategorized/failed-social-media-sites/

[37]

Oded Nov. 2007. What motivates Wikipedians? Commun. ACM Vol. 50, 11 (2007), 60--64.

Digital Library

[38]

Jennifer Preece and Ben Shneiderman. 2009. The reader-to-leader framework: Motivating technology-mediated social participation. AIS Transactions on HCI Vol. 1, 1 (2009), 13--32.

[39]

Paul G Schervish and John J Havens. 1997. Social participation and charitable giving: a multivariate analysis. Voluntas: International Journal of Voluntary and Nonprofit Organizations, Vol. 8, 3 (1997), 235--260.

[40]

P Wesley Schultz, Stuart Oskamp, and Tina Mainieri. 1995. Who recycles and when? A review of personal and situational factors. Journal of environmental psychology Vol. 15, 2 (1995), 105--121.

[41]

John Wilson. 2000. Volunteering. Annual review of sociology (2000), 215--240.

[42]

Christiane Wölfel and Timothy Merritt. 2013. Method card design dimensions: a survey of card-based design tools IFIP Conference on Human-Computer Interaction. Springer, 479--486.

[43]

Kath Wright, Su Golder, and Rocio Rodriguez-Lopez. 2014. Citation searching: a systematic review case study of multiple risk behaviour interventions. BMC medical research methodology Vol. 14, 1 (2014), 1.

Cited By

Constantinides MBogucka EQuercia DKallio STahaei M(2024)RAI Guidelines: Method for Generating Responsible AI Guidelines Grounded in Regulations and Usable by (Non-)Technical RolesProceedings of the ACM on Human-Computer Interaction10.1145/36869278:CSCW2(1-28)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686927
Stamato LProttoy HHiggins EScheifele LHamidi F(2024)Message in a Bottle: Investigating Bioart Installations as a Transdisciplinary Means of Community EngagementProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642339(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642339
Ceccarini CBogucka ESen IConstantinides MPrandi CQuercia D(2022)Visualizing Internal Sustainability Efforts in Big CompaniesIEEE Computer Graphics and Applications10.1109/MCG.2022.316306342:3(87-98)Online publication date: 1-May-2022
https://doi.org/10.1109/MCG.2022.3163063
Show More Cited By

Index Terms

Community Engagement Triage: Lightweight Prompts for Systematic Reviews
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing design and evaluation methods
    2. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Community Acknowledgment: Engaging Community Members in Volunteer Acknowledgment
GROUP

Volunteers in non-profit groups are a valuable workforce that contributes to economic development and supports people in need in the U.S. However, many non-profit groups face challenges including engaging and sustaining volunteer participation, as well ...
Department Programs to Encourage and Support Service Learning and Community Engagement
ITiCSE '15: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education

Service Learning (SL) is an established practice in which course objectives are met by having students engage in activities with individuals and/or organizations within the community in a way that is mutually beneficial to both the student and the ...
Understanding community participation and engagement in open source software Projects: A systematic mapping study
Abstract
In the Open Source Software (OSS) paradigm, developers along with users form a community for an OSS project as they share an interest in using/developing the project. Active community engagement is essential for an OSS project to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 1, Issue CSCW

November 2017

2095 pages

EISSN:2573-0142

DOI:10.1145/3171581

Editors:
Clifford Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Snap Inc.
,
Wolfgang Stuerzlinger
Simon Fraser University

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2017

Published in PACMHCI Volume 1, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
282
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Constantinides MBogucka EQuercia DKallio STahaei M(2024)RAI Guidelines: Method for Generating Responsible AI Guidelines Grounded in Regulations and Usable by (Non-)Technical RolesProceedings of the ACM on Human-Computer Interaction10.1145/36869278:CSCW2(1-28)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686927
Stamato LProttoy HHiggins EScheifele LHamidi F(2024)Message in a Bottle: Investigating Bioart Installations as a Transdisciplinary Means of Community EngagementProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642339(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642339
Ceccarini CBogucka ESen IConstantinides MPrandi CQuercia D(2022)Visualizing Internal Sustainability Efforts in Big CompaniesIEEE Computer Graphics and Applications10.1109/MCG.2022.316306342:3(87-98)Online publication date: 1-May-2022
https://doi.org/10.1109/MCG.2022.3163063
Deri SRappaz JAiello LQuercia D(2018)Coloring in the LinksProceedings of the ACM on Human-Computer Interaction10.1145/32743122:CSCW(1-18)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.1145/3274312

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents