Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1460563.1460572acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Harnessing the wisdom of crowds in wikipedia: quality through coordination

Published: 08 November 2008 Publication History

Abstract

Wikipedia's success is often attributed to the large numbers of contributors who improve the accuracy, completeness and clarity of articles while reducing bias. However, because of the coordination needed to write an article collaboratively, adding contributors is costly. We examined how the number of editors in Wikipedia and the coordination methods they use affect article quality. We distinguish between explicit coordination, in which editors plan the article through communication, and implicit coordination, in which a subset of editors structure the work by doing the majority of it. Adding more editors to an article improved article quality only when they used appropriate coordination techniques and was harmful when they did not. Implicit coordination through concentrating the work was more helpful when many editors contributed, but explicit coordination through communication was not. Both types of coordination improved quality more when an article was in a formative stage. These results demonstrate the critical importance of coordination in effectively harnessing the "wisdom of the crowd" in online production environments.

References

[1]
Aiken, L. and West, S. Multiple regression: Testing and interpreting interactions. Sage, CA (1991).
[2]
Atkinson, A. B. On the measurement of inequality. Journal of Economic Theory, 2 (1970), 244--263.
[3]
Berg, J. E., Forsythe, R., & Rietz, T. A. The Iowa electronic market. In Blackwell Encyclopedic Dictionary of Finance, Blackwell, Oxford UK (1997).
[4]
Benkler, Y. Coase's penguin, or Linux and the nature of the firm. Yale Law Journal, 112 (2002), 367--445.
[5]
Brooks, F. P. The mythical man month. Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA (1975).
[6]
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. Applied multiple regression/correlation analysis for the behavioral sciences. Lawrence Erlbaum Associates, Mahwah, New Jersey (2003).
[7]
Galton, F. Vox populi. Nature, 75 (1907), 7.
[8]
Giles, G. Internet encyclopaedias go head to head. Nature, 438 (2005), 900--901.
[9]
Hadoop Project. http://lucene.apache.org/hadoop/.
[10]
Heckman, J. Sample selection bias as a specification error. Econometrica, 47, 1 (1979), 153--162.
[11]
Hill, G. W. Group versus individual performance. Are n + 1 heads better than one? Psychological Bulletin, 91 (1982), 517--539.
[12]
Hinsz, V. B., Tindale, R. S., & Vollrath, D. A. The emerging conceptualization of groups as information processors. Psychological Bulletin, 121, 1 (1997), 43--64.
[13]
http://en.wikipedia.org/wiki/Category:Wikipedia_1.0_assessments
[14]
http://en.wikipedia.org/wiki/Wikipedia:Stub
[15]
http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team/Assessment
[16]
http://en.wikipedia.org/wiki/Wikipedia:WIAFA
[17]
Kanefsky, B., Barlow, N.G., & Gulick, V.C. Can Distributed Volunteers Accomplish Massive Data Analysis Tasks? Lunar and Planetary Science (2001).
[18]
Katz, R., & Tushman, M. Communication patterns, project performance, and task characteristics: An empirical evaluation and integration in an R&D setting. Organizational Behavior and Human Decision Processes, 23, (1979) 139--162.
[19]
Kittur, A., Suh, B., Chi, E., & Pendleton, B. A. He says, she says: Conflict and coordination in Wikipedia. CHI 2007, ACM Press (2007), 453--462.
[20]
Kittur, A., Chi, E., & Suh, B. Crowdsourcing user studies with Mechanical Turk. CHI 2008, ACM Press (2008).
[21]
Kittur, A., Chi, E., Pendleton, B. A., Suh, B., & Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. Alt.CHI, 2007, San Jose, CA (2007).
[22]
Laughlin, P. R., VanderStoep, S. W., & Hollingshead, A. B. Collective versus individual induction: Recognition of truth, rejection of error, and collective information processing. Journal of Personality and Social Psychology, 61, 1 (1991), 50--67.
[23]
Leavitt, H. Some effects of certain communication patterns on group performance. Journal of Abnormal and Social Psychology, 46 (1951), 38--50.
[24]
Malone, T. W. Modeling coordination in organizations and markets. Management Science, 33, 10 (1987), 1317--1332.
[25]
March, J. G., & Simon, H. A. Organizations. New York: Wiley (1958).
[26]
Mockus, A., Fielding, R. T., & Herbsleb, J. D. Two case studies of open source software development: Apache and mozilla. ACM Transactions on Software Engineering and Methodology, 11, 3 (2002), 309--346.
[27]
Priedhorsky, R., Chen, J., Lam, S., Panciera, K., Terveen, L., & Riedl, J. Creating, destroying, and restoring value in Wikipedia. Proc GROUP 2007, ACM Press (2007), 259--268.
[28]
Rouse, W.B., Cannon-Bowers, J. A., & Salas, E. The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics, 22 (1992) 1296--1308.
[29]
Shepperd, J. A. Productivity loss in performance groups: A motivation analysis. Psychological Bulletin, 113, 1 (1993), 67--81.
[30]
Steiner, I. D. Group process and productivity. New York: Academic Press (1972).
[31]
Stvilia, B., Twidale, M. B., Smith, L. C., & Gasser, L. Assessing information quality of a community-based encyclopedia. In Proc. ICIQ (2005), 442--454.
[32]
Surowiecki, J. The wisdom of crowds. New York: Doubleday (2005).
[33]
Thompson, J. Organizations in action. New York: McGraw-Hill (1967).
[34]
Tushman, M. Work characteristics and subunit communication structure: A contingency analysis. Administrative Science Quarterly, 24, (1979), 82--98.
[35]
Van de Ven, A. H., Delbecq, A. L., & Koenig, R., Jr. Determinants of coordination modes within organizations. American Sociological Review, 41 (1967), 322--338.
[36]
Viégas, F. B., Wattenberg M., & Dave, K. Studying cooperation and conflict between authors with history flow visualizations. CHI 2004, ACM Press (2004), 575--582.
[37]
Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. Talk before you type: Coordination in Wikipedia. HICSS (2007).
[38]
Viégas, F. B., Wattenberg, M., & McKeon, M. M. The hidden order of Wikipedia. In HCII (2007).
[39]
Wilkinson, D. M., & Huberman, B. A. Assessing the value of cooperation in Wikipedia. First Monday, 12, 4 (2007).
[40]
Wittenbaum, G. W., Vaughan, S. I., & Stasser, G. Coordination in task-performing groups. In Theory and research on small groups, Plenum Press, NY (1998).

Cited By

View all
  • (2024)Life Histories of Taboo Knowledge ArtifactsProceedings of the ACM on Human-Computer Interaction10.1145/36870448:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)Value Tensions in OpenStreetMap: Openness, Membership, and Policy in Online CommunitiesProceedings of the ACM on Human-Computer Interaction10.1145/36869198:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)Designing for Care in the Wikipedia CommunityProceedings of the Participatory Design Conference 2024: Full Papers - Volume 110.1145/3666094.3666112(75-85)Online publication date: 11-Aug-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work
November 2008
752 pages
ISBN:9781605580074
DOI:10.1145/1460563
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. collaboration
  2. collective intelligence
  3. coordination
  4. distributed cognition
  5. social computing
  6. wiki
  7. wikipedia

Qualifiers

  • Research-article

Conference

CSCW08
Sponsor:
CSCW08: Computer Supported Cooperative Work
November 8 - 12, 2008
CA, San Diego, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)121
  • Downloads (Last 6 weeks)13
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Life Histories of Taboo Knowledge ArtifactsProceedings of the ACM on Human-Computer Interaction10.1145/36870448:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)Value Tensions in OpenStreetMap: Openness, Membership, and Policy in Online CommunitiesProceedings of the ACM on Human-Computer Interaction10.1145/36869198:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)Designing for Care in the Wikipedia CommunityProceedings of the Participatory Design Conference 2024: Full Papers - Volume 110.1145/3666094.3666112(75-85)Online publication date: 11-Aug-2024
  • (2024)An Efficient Approach to Store and Access Wikipedia's Revision History for Large-Scale AnalysisProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675150(309-315)Online publication date: 10-Sep-2024
  • (2024)Novelty Begets Popularity, But Curbs Participation - A Macroscopic View of the Python Open-Source EcosystemProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3608142(1-11)Online publication date: 20-May-2024
  • (2024)IntroductionInvestigating Wikipedia10.1075/scl.121.int(1-10)Online publication date: 25-Oct-2024
  • (2024)Chapter 8. Disagreements and conflicts in Wikipedia talk pagesInvestigating Wikipedia10.1075/scl.121.08pou(205-234)Online publication date: 25-Oct-2024
  • (2024)A step forward in tracing and documenting dataset provenanceNature Machine Intelligence10.1038/s42256-024-00884-w6:8(848-849)Online publication date: 30-Aug-2024
  • (2024)How article category in Wikipedia determines the heterogeneity of its editorsScientific Reports10.1038/s41598-023-50448-y14:1Online publication date: 7-Jan-2024
  • (2024)Mediating effects of NLP-based parameters on the readability of crowdsourced wikipedia articlesApplied Intelligence10.1007/s10489-024-05399-w54:5(4370-4391)Online publication date: 26-Mar-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media