research-article

Peer-production system or collaborative ontology engineering effort: what is Wikidata?

Authors:

Claudia Müller-Birn,

Benjamin Karran,

Janette Lehmann,

Markus Luczak-RöschAuthors Info & Claims

OpenSym '15: Proceedings of the 11th International Symposium on Open Collaboration

Article No.: 20, Pages 1 - 10

https://doi.org/10.1145/2788993.2789836

Published: 19 August 2015 Publication History

Abstract

Wikidata promises to reduce factual inconsistencies across all Wikipedia language versions. It will enable dynamic data reuse and complex fact queries within the world's largest knowledge database. Studies of the existing participation patterns that emerge in Wikidata are only just beginning. What delineates most of the contributions in the system has not yet been investigated. Is it an inheritance from the Wikipedia peer-production system or the proximity of tasks in Wikidata that have been studied in collaborative ontology engineering? As a first step to answering this question, we performed a cluster analysis of participants' content editing activities. This allowed us to blend our results with typical roles found in peer-production and collaborative ontology engineering projects. Our results suggest very specialised contributions from a majority of users. Only a minority, which is the most active group, participate all over the project. These users are particularly responsible for developing the conceptual knowledge of Wikidata. We show the alignment of existing algorithmic participation patterns with these human patterns of participation. In summary, our results suggest that Wikidata rather supports peer-production activities caused by its current focus on data collection. We hope that our study informs future analyses and developments and, as a result, allows us to build better tools to support contributors in peer-production-based ontology engineering.

References

[1]

O. Arazy et al. Functional Roles and Career Paths in Wikipedia. In Proc. CSCW 2015.

Digital Library

[2]

A. Ben-Hur et al. A Stability Based Method for Discovering Structure in Clustered Data. Pacific Symposium on Biocomputing, 7(6):6--17, 2002.

[3]

K. Bollacker et al. Freebase: A Shared Database of Structured General Human Knowledge. In Proc. AAAI 2007.

Digital Library

[4]

F. Bry et al. Semantic wikis: Approaches, applications, and perspectives. In T. Eiter and T. Krennwallner, editors, Reasoning Web. Semantic Technologies for Advanced Query Answering, pages 329--369. Springer, 2012.

[5]

S. L. Bryant et al. Becoming Wikipedian: Transformation of Participation in a Collaborative Online Encyclopedia. In Proc. GROUP 2005.

Digital Library

[6]

B. Butler et al. Don't look now, but we've created a bureaucracy: the nature and roles of policies and rules in wikipedia. In Proc. CHI 2008.

Digital Library

[7]

D. Cosley et al. How oversight improves member-maintained communities. In Proc. CHI 2005.

Digital Library

[8]

F. Erxleben et al. Introducing Wikidata to the Linked Data Web. In Proc. ISWC, 2014.

Digital Library

[9]

S. Falconer et al. An Analysis of Collaborative Patterns in Large-scale Ontology Development Projects. In Proc. K-CAP 2011.

Digital Library

[10]

R. S. Geiger and A. Halfaker. Using Edit Session to Measure Participation in Wikipedia. In Proc. CSCW 2013.

Digital Library

[11]

R. S. Geiger and A. Halfaker. When the Levee Breaks: Without Bots, What Happens to Wikipedia's Quality Control Processes? In Proc. OpenSym 2013.

Digital Library

[12]

Y. Gil and V. Ratnakar. Knowledge Capture in the Wild: A Perspective from Semantic Wiki Communities. In Proc. K-CAP 2013.

Digital Library

[13]

T. Gruber. Ontology. In L. Liu and M. T. Özsu, editors, Encyclopedia of Database Systems, pages 1963--1965. Springer US, 2009.

[14]

A. Kittur et al. He says, she says: conflict and coordination in Wikipedia. In Proc. CHI 2007.

Digital Library

[15]

T. Kriplean et al. Articulations of wikiwork: uncovering valued work in wikipedia through barnstars. In Proc. CSCW 2008.

Digital Library

[16]

M. Krötzsch et al. Semantic Wikipedia. Journal of Web Semantics, 5(4):251--261, 2007.

Digital Library

[17]

J. Lave and E. Wenger. Situated Learning: Legitimate Peripheral Participation (Learning in Doing: Social, Cognitive & Computational Perspectives). Cambridge University Press, 1991.

[18]

J. Liu and S. Ram. Who does what: Collaboration patterns in the wikipedia and their impact on article quality. ACM Transactions on Management Information Systems (TMIS), 2(2):11, 2011.

Digital Library

[19]

M. Meilă. Comparing clusterings---an information based distance. Journal of Multivariate Analysis, 98(5):873--895, 2007.

Digital Library

[20]

A. Mockus et al. A case study of open source software development: the Apache server. In Proc. ICSE 2000.

Digital Library

[21]

C. Müller-Birn et al. Work-to-rule: the emergence of algorithmic governance in Wikipedia. In Proc. C&T 2013.

Digital Library

[22]

K. Nakakoji et al. Evolution patterns of open-source software systems and communities. In Proc. IWPSE 2002.

Digital Library

[23]

F. Ortega and J. M. G. Barahona. Quantitative analysis of the wikipedia community of users. In Proc. WikiSym 2007.

Digital Library

[24]

J. Preece and B. Shneiderman. The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation. AIS Transactions on Human-Computer Interaction, 1(1):13--32, 2009.

[25]

G. Robles, J. M. Gonzalez-Barahona, and I. Herraiz. Evolution of the core team of developers in libre software projects. Technical report, Universidad Rey Juan Carlos (Spain), 2005.

[26]

E. Simperl and M. Luczak-Rösch. Collaborative ontology engineering: a survey. The Knowledge Engineering Review, 29(01):101--131, 2013.

[27]

M. Strohmaier et al. How Ontologies Are Made: Studying the Hidden Social Dynamics Behind Collaborative Ontology Engineering Projects. Web Semantics: Science, Services and Agents on the World Wide Web, 2013.

Digital Library

[28]

T. Tudorache et al. Supporting collaborative ontology development in protégé. In Proc. ISWC 2008.

Digital Library

[29]

T. Tudorache et al. Using Semantic Web in ICD-11: Three Years Down the Road. In Proc. ISWC 2013.

Digital Library

[30]

D. Vrandečić and M. Krötzsch. Wikidata: A Free Collaborative Knowledgebase. Communications of the ACM, 57(10):78--85, 2014.

Digital Library

[31]

H. T. Welser et al. Finding social roles in Wikipedia. In Proc. iConference 2011.

Digital Library

[32]

E. Wenger. Communities of Practice: Learning as a social system. System Thinker, 9(5):2--3, 1998.

[33]

Y. Ye and K. Kishida. Toward an understanding of the motivation Open Source Software developers. In Proc. ICSE 2003.

Digital Library

Cited By

Prinster GSmith CTan CKeegan B(2024)Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community on RedditProceedings of the ACM on Human-Computer Interaction10.1145/36373108:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637310
Zhang BAnderson JSarkar DSoden R(2024)A Quantitative Approach to Identifying Emergent Editor Roles in Open Street MapProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641963(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641963
París JEspada JMartínez JCrespo R(2024)Search Box System to Improve User Interaction in Knowledge Graph Searches: A Solution for Users Without Expert SkillsIEEE Systems, Man, and Cybernetics Magazine10.1109/MSMC.2023.330448910:1(53-61)Online publication date: Jan-2024
https://doi.org/10.1109/MSMC.2023.3304489
Show More Cited By

Index Terms

Peer-production system or collaborative ontology engineering effort: what is Wikidata?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Web-based interaction

Recommendations

What Does an Ontology Engineering Community Look Like? A Systematic Analysis of the schema.org Community
The Semantic Web
Abstract
We present a systematic analysis of participation and interactions within the community behind schema.org, one of the largest and most relevant ontology engineering projects in recent times. Previous work conducted in this space has focused on ...
Emergent Routines in Peer-Production: Examining the Temporal Evolution of Wikipedia's Work Sequences
Special Issue on Negotiating Truth and Trust in Socio-Technical Systems and Regular Paper

Current theories struggle to explain how participants in peer-production self-organize to produce high-quality knowledge in the absence of formal coordination mechanisms. The literature traditionally holds that norms, policies, and roles make ...
Applicability of Sequence Analysis Methods in Analyzing Peer-Production Systems: A Case Study in Wikidata
Social Informatics
Abstract
Building a shared understanding of a specific area of interest is of increasing importance in today’s information-centric world. A shared understanding of a domain can be realized by building a structured knowledge base about it collaboratively. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OpenSym '15: Proceedings of the 11th International Symposium on Open Collaboration

August 2015

144 pages

ISBN:9781450336666

DOI:10.1145/2788993

General Chair:
Dirk Riehle
Friedrich-Alexander University Erlangen-Nürnberg

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German research foundation (DFG)

Conference

OpenSym '15

OpenSym '15: The 11th International Symposium on Open Collaboration

August 19 - 21, 2015

California, San Francisco

Acceptance Rates

Overall Acceptance Rate 108 of 195 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
347
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)3

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Prinster GSmith CTan CKeegan B(2024)Community Archetypes: An Empirical Framework for Guiding Research Methodologies to Reflect User Experiences of Sense of Virtual Community on RedditProceedings of the ACM on Human-Computer Interaction10.1145/36373108:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637310
Zhang BAnderson JSarkar DSoden R(2024)A Quantitative Approach to Identifying Emergent Editor Roles in Open Street MapProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641963(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641963
París JEspada JMartínez JCrespo R(2024)Search Box System to Improve User Interaction in Knowledge Graph Searches: A Solution for Users Without Expert SkillsIEEE Systems, Man, and Cybernetics Magazine10.1109/MSMC.2023.330448910:1(53-61)Online publication date: Jan-2024
https://doi.org/10.1109/MSMC.2023.3304489
Weathington KBrubaker J(2023)Queer Identities, Normative Databases: Challenges to Capturing Queerness On WikidataProceedings of the ACM on Human-Computer Interaction10.1145/35795177:CSCW1(1-26)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579517
Evenstein Sigalov SNachmias R(2023)Investigating the potential of the semantic web for education: Exploring Wikidata as a learning platformEducation and Information Technologies10.1007/s10639-023-11664-128:10(12565-12614)Online publication date: 13-Mar-2023
https://doi.org/10.1007/s10639-023-11664-1
Zhang CHoutti MSmith CKong RTerveen L(2022)Working for the Invisible Machines or Pumping Information into an Empty Void? An Exploration of Wikidata Contributors' MotivationsProceedings of the ACM on Human-Computer Interaction10.1145/35129826:CSCW1(1-21)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512982
Abián DMeroño-Peñuela ASimperl E(2022)An Analysis of Content Gaps Versus User Needs in the Wikidata Knowledge GraphThe Semantic Web – ISWC 202210.1007/978-3-031-19433-7_21(354-374)Online publication date: 16-Oct-2022
https://doi.org/10.1007/978-3-031-19433-7_21
Samuel J(2021)WDProp: Web Application to Analyse Multilingual Aspects of Wikidata PropertiesProceedings of the 17th International Symposium on Open Collaboration10.1145/3479986.3479996(1-12)Online publication date: 15-Sep-2021
https://dl.acm.org/doi/10.1145/3479986.3479996
Piao GHuang W(2021)Learning to Predict the Departure Dynamics of Wikidata EditorsThe Semantic Web – ISWC 202110.1007/978-3-030-88361-4_3(39-55)Online publication date: 30-Sep-2021
https://doi.org/10.1007/978-3-030-88361-4_3
AlGhamdi KShi MSimperl E(2021)Learning to Recommend Items to Wikidata EditorsThe Semantic Web – ISWC 202110.1007/978-3-030-88361-4_10(163-181)Online publication date: 30-Sep-2021
https://doi.org/10.1007/978-3-030-88361-4_10
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents