research-article

Just-in-time data integration in action

Editors: Elisa Bertino, Paolo Atzeni, Kian Lee Tan, Yi Chen, Y. C. Tay Authors:

Martin Hentschel,

Renée J. MillerAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 3, Issue 1-2

Pages 1621 - 1624

https://doi.org/10.14778/1920841.1921055

Published: 01 September 2010 Publication History

Abstract

Today's data integration systems must be flexible enough to support the typical iterative and incremental process of integration, and may need to scale to hundreds of data sources. In this work we present a novel data integration system that offers great flexibility and scalability. Our approach to data integration is unique in that it executes mapping rules at query runtime using annotations. On top, we have built the People People People application. It allows users to search for people, display information about people, and browse through a network of related people, where the data is integrated from local and remote data sources. The demo presents all features of our underlying data integration engine through a set of motivating scenarios.

References

[1]

S. Abiteboul, J. McHugh, M. Rys, V. Vassalos, and J. L. Wiener. Incremental Maintenance for Materialized Views over Semistructured Data. In VLDB Conf., pages 38--49, 1998.

Digital Library

[2]

B. Alexe, W. C. Tan, and Y. Velegrakis. STBenchmark: towards a benchmark for mapping systems. PVLDB, 1(1):230--244, 2008.

Digital Library

[3]

R. Avnur and J. M. Hellerstein. Eddies: Continuously Adaptive Query Processing. In ACM SIGMOD Conf., pages 261--272, 2000.

Digital Library

[4]

S. Chawathe et al. The TSIMMIS Project: Integration of Heterogeneous Information Sources. In Proc. of the 100th Anniversary Meeting of the Information Processing Society of Japan(IPSJ), pages 7--18, Tokyo, Japan, Oct. 1994.

[5]

P. DeRose, W. Shen, F. Chen, A. Doan, and R. Ramakrishnan. Building Structured Web Community Portals: A Top-Down, Compositional, and Incremental Approach. In VLDB, pages 399--410, 2007.

Digital Library

[6]

P. DeRose, W. Shen, F. Chen, Y. Lee, D. Burdick, A. Doan, and R. Ramakrishnan. DBLife: A Community Information Management Platform for the Database Research Community. In CIDR, pages 169--172, 2007.

[7]

A. Gupta and I. S. Mumick. Maintenance of Materialized Views: Problems, Techniques, and Applications. IEEE Data Eng. Bull., 18(2):3--18, 1995.

[8]

L. M. Haas, D. Kossmann, E. L. Wimmers, and J. Yang. Optimizing Queries across Diverse Data Sources. In VLDB Conf., pages 276--285, 1997.

Digital Library

[9]

L. M. Haas, R. J. Miller, M. Hentschel, and D. Kossmann. A First Step Towards Integration Independence. In NTII, 2010.

[10]

M. Hentschel et al. Scalable Data Integration by Mapping Data to Queries. Technical Report 633, ETH Zurich, Systems Group, Dept. of Computer Science, 2009.

[11]

M. A. Hernández, R. J. Miller, and L. M. Haas. Clio: A Semi-Automatic Tool For Schema Mapping. In ACM SIGMOD Conf., page 607, 2001.

Digital Library

[12]

Z. G. Ives, D. Florescu, M. Friedman, A. Levy, and D. S. Weld. An adaptive query execution system for data integration. In ACM SIGMOD Conf., pages 299--310, 1999.

Digital Library

[13]

A. Y. Levy, A. Rajaraman, and J. J. Ordille. Querying Heterogeneous Information Sources Using Source Descriptions. In VLDB Conf., pages 251--262, 1996.

Digital Library

[14]

M. Ley. DBLP - Some Lessons Learned. PVLDB, 2(2):1493--1500, 2009.

Digital Library

[15]

V. Raman and J. M. Hellerstein. Potter's Wheel: An Interactive Data Cleaning System. In VLDB Conf., pages 381--390, 2001.

Digital Library

[16]

J. Widom. Integrating Heterogeneous Databases: Lazy or Eager? ACM Computing Surv., 28(4es):article 91, 1996.

Digital Library

[17]

G. Wiederhold. Mediators in the Architecture of Future Information Systems. IEEE Computer, 25(3):38--49, 1992.

Digital Library

[18]

Y. Zhuge, H. Garcia-Molina, J. Hammer, and J. Widom. View Maintenance in a Warehousing Environment. In ACM SIGMOD Conf., pages 316--327, 1995.

Digital Library

Cited By

Adamou Ad'Aquin MAllocca CMotta E(2017)Supporting virtual integration of Linked Data with just-in-time query recompilationProceedings of the 13th International Conference on Semantic Systems10.1145/3132218.3132227(112-119)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.1145/3132218.3132227
Vasilyeva EThiele MBornhövd CLehner WBoncz PNeumann T(2013)Leveraging flexible data management with graph databasesFirst International Workshop on Graph Data Management Experiences and Systems10.1145/2484425.2484437(1-6)Online publication date: 23-Jun-2013
https://dl.acm.org/doi/10.1145/2484425.2484437
Pinkel C(2013)Interactive Pay as You Go Relational-to-Ontology MappingProceedings of the 12th International Semantic Web Conference - Part II10.1007/978-3-642-41338-4_31(456-464)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41338-4_31
Show More Cited By

Just-in-time data integration in action
1. Information systems
  1. Data management systems
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory

Recommendations

On-demand big data integration

Scientific research requires access, analysis, and sharing of data that is distributed across various heterogeneous data sources at the scale of the Internet. An eager extract, transform, and load (ETL) process constructs an integrated data repository ...
Data Integration on Multiple Data Sets
BIBM '08: Proceedings of the 2008 IEEE International Conference on Bioinformatics and Biomedicine

A critical issue in dealing with voluminous records is that of data integration. Integration of data from two data bases has been studied well. For example, FEBRL is an excellent system for integrating two databases. Not much work has been conducted to ...
Portlets in Action

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 3, Issue 1-2

September 2010

1658 pages

ISSN:2150-8097

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 September 2010

Published in PVLDB Volume 3, Issue 1-2

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
208
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Adamou Ad'Aquin MAllocca CMotta E(2017)Supporting virtual integration of Linked Data with just-in-time query recompilationProceedings of the 13th International Conference on Semantic Systems10.1145/3132218.3132227(112-119)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.1145/3132218.3132227
Vasilyeva EThiele MBornhövd CLehner WBoncz PNeumann T(2013)Leveraging flexible data management with graph databasesFirst International Workshop on Graph Data Management Experiences and Systems10.1145/2484425.2484437(1-6)Online publication date: 23-Jun-2013
https://dl.acm.org/doi/10.1145/2484425.2484437
Pinkel C(2013)Interactive Pay as You Go Relational-to-Ontology MappingProceedings of the 12th International Semantic Web Conference - Part II10.1007/978-3-642-41338-4_31(456-464)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41338-4_31
Mendell MNasgaard HBouillet EHirzel MGedik B(2012)Extending a general-purpose streaming system for XMLProceedings of the 15th International Conference on Extending Database Technology10.1145/2247596.2247659(534-539)Online publication date: 27-Mar-2012
https://dl.acm.org/doi/10.1145/2247596.2247659
Morton KBunker RMackinlay JMorton RStolte CCandan KChen YSnodgrass RGravano LFuxman A(2012)Dynamic workload driven data integration in tableauProceedings of the 2012 ACM SIGMOD International Conference on Management of Data10.1145/2213836.2213961(807-816)Online publication date: 20-May-2012
https://dl.acm.org/doi/10.1145/2213836.2213961

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents