Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2396761.2398580acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
short-paper

Discovering conditional inclusion dependencies

Published: 29 October 2012 Publication History

Abstract

Data dependencies are used to improve the quality of a database schema, to optimize queries, and to ensure consistency in a database. Conditional dependencies have been introduced to analyze and improve data quality. A conditional dependency is a dependency with a limited scope defined by conditions over one or more attributes. Only the matching part of the instance must adhere to the dependency. In this paper we focus on conditional inclusion dependencies (CINDs).We generalize the definition of CINDs, distinguishing covering and completeness conditions. We present a new use case for such CINDs showing their value for solving complex data quality tasks. Further, we propose efficient algorithms that identify covering and completeness conditions conforming to given quality thresholds. Our algorithms choose not only the condition values but also the condition attributes automatically. Finally, we show that our approach efficiently provides meaningful and helpful results for our use case.

References

[1]
R. Agrawal and R. Srikant. Fast algorithms for mining association rules in large databases. In Proc. of the Int. Conference on Very Large Databases (VLDB), 1994.
[2]
J. Bauckmann, Z. Abedjan, U. Leser, H. Müller, and F. Naumann. Covering or complete? discovering conditional inclusion dependencies. Technical Report 62, Hasso-Plattner-Institute Potsdam, Germany, 2012.
[3]
C. Bizer, J. Lehmann, G. Kobilarov, S. Auer, C. Becker, R. Cyganiak, and S. Hellmann. Dbpedia - a crystallization point for the web of data. J. Web Sem., 7(3):154--165, 2009.
[4]
P. Bohannon, W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for data cleaning. In Proc. of the Int. Conference on Data Engineering (ICDE), 2007.
[5]
L. Bravo, W. Fan, and S. Ma. Extending dependencies with conditions. In Proc. of the Int. Conference on Very Large Databases (VLDB), 2007.
[6]
W. Chen, W. Fan, and S. Ma. Analyses and validation of conditional dependencies with built-in predicates. In Database and Expert Systems Applications, 2009.
[7]
F. Chiang and R. J. Miller. Discovering data quality rules. Proc. of the VLDB Endowment, 1:1166--1177, 2008.
[8]
O. Curé. Conditional inclusion dependencies for data cleansing: Discovery and violation detection issues. In Proc. of the Int. Workshop on Quality in Databases (QDB), 2009.
[9]
W. Fan. Dependencies revisited for improving data quality. In Proc. of the Symposium on Principles of Database Systems (PODS), 2008.
[10]
W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for capturing data inconsistencies. ACM Transactions on Database Systems (TODS), 33(2):1--48, 2008.
[11]
W. Fan, F. Geerts, J. Li, and M. Xiong. Discovering conditional functional dependencies. IEEE Transactions on Knowledge and Data Engineering (TKDE), 23(4):683--698, 2011.
[12]
L. Golab, H. Karloff, F. Korn, D. Srivastava, and B. Yu. On generating near-optimal tableaux for conditional functional dependencies. Proc. of the VLDB Endowment, 1:376--390, 2008.
[13]
L. Golab, F. Korn, and D. Srivastava. Efficient and effective analysis of data quality using pattern tableaux. IEEE Data Engineering Bulletin, 34(3):26--33, 2011.
[14]
H. Halpin, P. Hayes, J. P. McCusker, D. McGuinness, and H. S. Thompson. When owl:sameas isn't the same: An analysis of identity in linked data. In Proc. of the Int. Semantic Web Conference (ISWC), 2010.
[15]
Y. Huhtala, J. Kaerkkaeinen, P. Porkka, and H. Toivonen. TANE: an efficient algorithm for discovering functional and approximate dependencies. The Computer Journal, 42(2):100--111, 1999.
[16]
F. D. Marchi, S. Lopes, and J.-M. Petit. Unary and n-ary inclusion dependency discovery in relational databases. J. Intell. Inf. Syst., 32:53--73, 2009.
[17]
H. Müller, U. Leser, and J.-C. Freytag. Mining for patterns in contradictory data. In Proc. of the SIGMOD Int. Workshop on Information Quality for Information Systems (IQIS), 2004.

Cited By

View all
  • (2024)Minimal coverage of generalized typed inclusion dependencies in databasesModeling and Analysis of Information Systems10.18255/1818-1015-2024-1-78-8931:1(78-89)Online publication date: 28-Mar-2024
  • (2023)Generalization of typed include dependencies with null values in databasesModeling and Analysis of Information Systems10.18255/1818-1015-2023-3-192-20130:3(192-201)Online publication date: 17-Sep-2023
  • (2023)Efficient Biclique Counting in Large Bipartite GraphsProceedings of the ACM on Management of Data10.1145/35889321:1(1-26)Online publication date: 30-May-2023
  • Show More Cited By

Index Terms

  1. Discovering conditional inclusion dependencies

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge management
    October 2012
    2840 pages
    ISBN:9781450311564
    DOI:10.1145/2396761
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. association rule mining
    2. cind
    3. link discovery

    Qualifiers

    • Short-paper

    Conference

    CIKM'12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 24 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Minimal coverage of generalized typed inclusion dependencies in databasesModeling and Analysis of Information Systems10.18255/1818-1015-2024-1-78-8931:1(78-89)Online publication date: 28-Mar-2024
    • (2023)Generalization of typed include dependencies with null values in databasesModeling and Analysis of Information Systems10.18255/1818-1015-2023-3-192-20130:3(192-201)Online publication date: 17-Sep-2023
    • (2023)Efficient Biclique Counting in Large Bipartite GraphsProceedings of the ACM on Management of Data10.1145/35889321:1(1-26)Online publication date: 30-May-2023
    • (2023)Maximal Defective Clique EnumerationProceedings of the ACM on Management of Data10.1145/35889311:1(1-26)Online publication date: 30-May-2023
    • (2023)Effective and Efficient PageRank-based Positioning for Graph VisualizationProceedings of the ACM on Management of Data10.1145/35889301:1(1-27)Online publication date: 30-May-2023
    • (2023)Discovering Similarity Inclusion DependenciesProceedings of the ACM on Management of Data10.1145/35889291:1(1-24)Online publication date: 30-May-2023
    • (2023)Efficiently Computing Join Orders with Heuristic SearchProceedings of the ACM on Management of Data10.1145/35889271:1(1-26)Online publication date: 30-May-2023
    • (2023)DBPA: A Benchmark for Transactional Database Performance AnomaliesProceedings of the ACM on Management of Data10.1145/35889261:1(1-26)Online publication date: 30-May-2023
    • (2023)Matching Roles from Temporal Data: Why Joe Biden is not only President, but also Commander-in-ChiefProceedings of the ACM on Management of Data10.1145/35889191:1(1-26)Online publication date: 30-May-2023
    • (2023)Sublinear-Space Streaming Algorithms for Estimating Graph Parameters on Sparse GraphsAlgorithms and Data Structures10.1007/978-3-031-38906-1_17(247-261)Online publication date: 28-Jul-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media