research-article

'/Command' and Conquer: Analysing Discussion in a Citizen Science Game

Authors:

Markus Luczak-Roesch,

Nigel Shadbolt,

Wendy HallAuthors Info & Claims

WebSci '15: Proceedings of the ACM Web Science Conference

Article No.: 26, Pages 1 - 10

https://doi.org/10.1145/2786451.2786455

Published: 28 June 2015 Publication History

Abstract

Citizen science is changing the process of scientific knowledge discovery. Successful projects rely on an active and able collection of volunteers. In order to attract, and sustain citizen scientists, designers are faced with the task of transforming complex scientific tasks into something accessible, interesting, and hopefully, engaging. In this paper, we examine the citizen science game EyeWire. Our analysis draws up a dataset of over 4,000,000 completed game and 885,000 chat entries, made by over 90,000 players. The analysis provides a detailed understanding of how features of the system facilitate player interaction and communication alongside completing the gamified scientific task. Based on the analysis we describe a set of behavioural characteristics which identify different types of players within the EyeWire platform.

References

[1]

Adamic, L. A., Zhang, J., Bakshy, E., and Ackerman, M. S. Knowledge sharing and yahoo answers: everyone knows something. In Proceedings of the 17th international conference on World Wide Web, WWW '08 (2008), 665--674.

Digital Library

[2]

Agichtein, E., Lawrence, S., and Gravano, L. Learning search engine specific query transformations for question answering. In Proceedings of the 10th International Conference on World Wide Web, WWW '01, ACM (New York, NY, USA, 2001), 169--178.

Digital Library

[3]

Anderson, D. P., Cobb, J., Korpela, E., Lebofsky, M., and Werthimer, D. SETIHome: An Experiment in Public-resource Computing. Communications of the ACM 45, 11 (2002), 56--61.

Digital Library

[4]

Antin, J., and Churchill, E. F. Badges in social media: A social psychological perspective. In CHI 2011 Gamification Workshop Proceedings (2011).

[5]

Blei, D. M., Ng, A. Y., and Jordan, M. I. Latent dirichlet allocation. J. Mach. Learn. Res. 3 (Mar. 2003), 993--1022.

[6]

Borbora, Z., and Srivastava, J. User behavior modelling approach for churn prediction in online games. In Privacy, Security, Risk and Trust (PASSAT), 2012 International Conference on and 2012 International Confernece on Social Computing (SocialCom) (Sept 2012), 51--60.

Digital Library

[7]

Bowser, A., Hansen, D., and Preece, J. Gamifying citizen science: Lessons and future directions. In Designing gamification: Creating gameful and playful experiences workshop, CHI 2013, ACM (2013).

[8]

Burke, M., Marlow, C., and Lento, T. Feed me: Motivating newcomer contribution in social network sites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09 (2009), 945--954.

Digital Library

[9]

Cardamone, C., Schawinski, K., Sarzi, M., Bamford, S. P., Bennert, N., Urry, C., Lintott, C., Keel, W. C., Parejko, J., Nichol, R. C., et al. Galaxy Zoo Green Peas: discovery of a class of compact extremely star-forming galaxies. Monthly Notices of the Royal Astronomical Society 399, 3 (2009), 1191--1205.

[10]

Cardamone, C. N. The story of the peas: Writing a scientific paper. http://blog.galaxyzoo.org/2009/07/02/the-story-of-the-peas-writing-a-scientific-paper, 2009.

[11]

Cooper, C. Zen in the art of citizen science: Apps for collective discovery and the 1 percent rule of the web. http://blogs.scientificamerican.com/guest-blog/2013/09/11/zen-in-the-art-of-citizen-science-apps-for-collective-discovery-and-the-1-rule-of-the-web/, 2013.

[12]

Cordero, P., Lucks, J. B., and Das, R. An RNA Mapping Database for curating RNA structure mapping experiments. Bioinformatics 28, 22 (2012), 3006--3008.

Digital Library

[13]

Danescu-Niculescu-Mizil, C., West, R., Jurafsky, D., Leskovec, J., and Potts, C. No country for old members: user lifecycle and linguistic change in online communities. In WWW, D. Schwabe, V. A. F. Almeida, H. Glaser, R. A. Baeza-Yates, and S. B. Moon, Eds., International World Wide Web Conferences (2013), 307--318.

Digital Library

[14]

Dave, K. S., Vaingankar, V., Kolar, S., and Varma, V. Timespent based models for predicting user retention. In Proceedings of the 22Nd International Conference on World Wide Web, WWW '13, International World Wide Web Conferences Steering Committee (Republic and Canton of Geneva, Switzerland, 2013), 331--342.

Digital Library

[15]

Deterding, S., Sicart, M., Nacke, L., O'Hara, K., and Dixon, D. Gamification. Using Game-design Elements in Non-gaming Contexts. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (2011), 2425--2428.

Digital Library

[16]

Dror, G., Pelleg, D., Rokhlenko, O., and Szpektor, I. Churn prediction in new users of yahoo! answers. In Proceedings of the 21st International Conference Companion on World Wide Web, WWW '12 Companion (2012), 829--834.

Digital Library

[17]

Garcia, D., Mavrodiev, P., and Schweitzer, F. Social resilience in online communities: The autopsy of friendster. In Proceedings of the First ACM Conference on Online Social Networks, COSN '13 (2013), 39--50.

Digital Library

[18]

Glenn, N. D. Cohort analysis. Beverly Hills; London: Sage Publications, 1977. Bibliography: p. 70--72.

[19]

Godfrey, E., Aubrey, T., Crosthwaite, C., and King, R. Who leaves and when do they go? retention and attrition in engineering education. In Frontiers in Education Conference (FIE), 2010 IEEE (Oct 2010), F3E--1--F3E--6.

[20]

Griffiths, T., Steyvers, M., et al. Prediction and semantic association. Advances in neural information processing systems (2003), 11--18.

[21]

Kawrykow, A., Roumanis, G., Kam, A., Kwak, D., Leung, C., Wu, C., Zarour, E., Sarmenta, L., Blanchette, M., Waldispühl, J., et al. Phylo: a citizen science approach for improving multiple sequence alignment. PloS one 7, 3 (2012), e31362.

[22]

Kearns, M. Experiments in social computation. Commun. ACM 55, 10 (Oct. 2012), 56--67.

Digital Library

[23]

Khatib, F., Cooper, S., Tyka, M. D., Xu, K., Makedon, I., Popović, Z., Baker, D., and Players, F. Algorithm discovery by protein folding game players. Proceedings of the National Academy of Sciences 108, 47 (2011), 18949--18953.

[24]

Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., Purcaro, M., Balkam, M., Robinson, A., Behabadi, B. F., et al. Space-time wiring specificity supports direction selectivity in the retina. Nature 509, 7500 (2014), 331--336.

[25]

Kittur, A., and Kraut, R. E. Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work, ACM (2008), 37--46.

Digital Library

[26]

Lintott, C. J., et al. Galaxy zoo:'hanny's voorwerp', a quasar light echo? Monthly Notices of the Royal Astronomical Society 399, 1 (2009), 129--140.

[27]

Luczak-Rösch, M., Tinati, R., Simperl, E., Kleek, M. V., Shadbolt, N., and Simpson, R. Why won't aliens talk to us? content and community dynamics in online citizen science. In Eighth International AAAI Conference on Weblogs and Social Media (2014).

[28]

McGonigal, J. Reality Is Broken: Why Games Make Us Better and How They Can Change the World. Penguin Group US, 2011.

Digital Library

[29]

Raddick, M. J., Bracey, G., Gay, P. L., Lintott, C. J., Murray, P., Schawinski, K., Szalay, A. S., and Vandenberg, J. Galaxy zoo: Exploring the motivations of citizen science volunteers. Astronomy Education Review 9 (2010), 010103.

[30]

Reeves, B., and Read, J. L. Total Engagement: How Games and Virtual Worlds Are Changing the Way People Work and Businesses Compete. Harvard Business Press, 2013.

[31]

Richter, Y., Yom-Tov, E., and Slonim, N. Predicting customer churn in mobile networks through analysis of social groups. In SDM (2010), 732--741.

[32]

Seaborn, K., and Fels, D. I. Gamification in theory and action: A survey. International Journal of Human-Computer Studies 74, 0 (2015), 14--31.

Digital Library

[33]

Tinati, R., Luczak-Roesch, M., Simperl, E., and Shadbolt, N. Motivations of citizen scientists: A quantitative investigation of forum participation. In Proceedings of the 2014 ACM Conference on Web Science, ACM (2014), 295--296.

Digital Library

[34]

Torkjazi, M., Rejaie, R., and Willinger, W. Hot today, gone tomorrow: On the migration of myspace users. In Proceedings of the 2Nd ACM Workshop on Online Social Networks, WOSN '09 (2009), 43--48.

Digital Library

[35]

von Ahn, L., and Dabbish, L. Designing games with a purpose. Commun. ACM 51, 8 (Aug. 2008), 58--67.

Digital Library

[36]

Wang, G., Gill, K., Mohanlal, M., Zheng, H., and Zhao, B. Y. Wisdom in the social crowd: An analysis of quora. In Proceedings of the 22Nd International Conference on World Wide Web, WWW '13, International World Wide Web Conferences Steering Committee (Republic and Canton of Geneva, Switzerland, 2013), 1341--1352.

Digital Library

Cited By

Das RKeep BWashington PRiedel-Kruse I(2019)Scientific Discovery Games for Biomedical ResearchAnnual Review of Biomedical Data Science10.1146/annurev-biodatasci-072018-0211392:1(253-279)Online publication date: 20-Jul-2019
https://doi.org/10.1146/annurev-biodatasci-072018-021139
Reeves NSimperl E(2019)Efficient, but Effective?Proceedings of the ACM on Human-Computer Interaction10.1145/33592793:CSCW(1-35)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359279
Wallner GKriglstein SDrachen A(2019)Tweeting your Destiny: Profiling Users in the Twitter Landscape around an Online Game2019 IEEE Conference on Games (CoG)10.1109/CIG.2019.8848079(1-8)Online publication date: Aug-2019
https://doi.org/10.1109/CIG.2019.8848079
Show More Cited By

Index Terms

'/Command' and Conquer: Analysing Discussion in a Citizen Science Game
1. Human-centered computing

Recommendations

Is Virtual Citizen Science A Game?

The use of game elements within virtual citizen science is increasingly common, promising to bring increased user activity, motivation, and engagement to large-scale scientific projects. However, there is an ongoing debate about whether or not gamifying ...
Why MMORPG players do what they do: relating motivations to action categories

This paper presents an analysis of relations between player motivation and behaviour in a Massively Multiplayer Online Role-Playing Game (MMORPG). Player motivation is measured in terms of percentile ranks of motivational components for MMORPG players ...
Do games attract or sustain engagement in citizen science?: a study of volunteer motivations
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Increasingly, games are being incorporated into online citizen science (CS) projects as a way of crowdsourcing data; yet the influence of gamification on volunteer motivations and engagement in CS projects is still unknown. In an interview study with 8 ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WebSci '15: Proceedings of the ACM Web Science Conference

June 2015

366 pages

ISBN:9781450336727

DOI:10.1145/2786451

Conference Chair:
David De Roure,
Program Chairs:
Pete Burnap,
Susan Halford

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WebSci '15

Sponsor:

SIGWEB

WebSci '15: ACM Web Science Conference

June 28 - July 1, 2015

Oxford, United Kingdom

Acceptance Rates

Overall Acceptance Rate 245 of 933 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
192
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Das RKeep BWashington PRiedel-Kruse I(2019)Scientific Discovery Games for Biomedical ResearchAnnual Review of Biomedical Data Science10.1146/annurev-biodatasci-072018-0211392:1(253-279)Online publication date: 20-Jul-2019
https://doi.org/10.1146/annurev-biodatasci-072018-021139
Reeves NSimperl E(2019)Efficient, but Effective?Proceedings of the ACM on Human-Computer Interaction10.1145/33592793:CSCW(1-35)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359279
Wallner GKriglstein SDrachen A(2019)Tweeting your Destiny: Profiling Users in the Twitter Landscape around an Online Game2019 IEEE Conference on Games (CoG)10.1109/CIG.2019.8848079(1-8)Online publication date: Aug-2019
https://doi.org/10.1109/CIG.2019.8848079
Reeves NTinati RZerr SVan Kleek MSimperl ELee CPoltrock SBarkhuus LBorges MKellogg W(2017)From Crowd to CommunityProceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998302(2137-2152)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998302
Tinati RLuczak-Roesch MSimperl EHall W(2017)An investigation of player motivations in Eyewire, a gamified citizen science projectComputers in Human Behavior10.1016/j.chb.2016.12.07473:C(527-540)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1016/j.chb.2016.12.074
Tinati RLuczak-Roesch MSimperl EHall WNejdl WHall WParigi PStaab S(2016)Because science is awesomeProceedings of the 8th ACM Conference on Web Science10.1145/2908131.2908151(45-54)Online publication date: 22-May-2016
https://dl.acm.org/doi/10.1145/2908131.2908151

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten