Article

Mapping conceptual to logical models for ETL processes

Author:

Alkis SimitsisAuthors Info & Claims

DOLAP '05: Proceedings of the 8th ACM international workshop on Data warehousing and OLAP

Pages 67 - 76

https://doi.org/10.1145/1097002.1097014

Published: 04 November 2005 Publication History

Abstract

Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. In previous line of research, we have presented a conceptual and a logical model for ETL processes. In this paper, we describe the mapping of the conceptual to the logical model. First, we identify how a conceptual entity is mapped to a logical entity. Next, we determine the execution order in the logical workflow using information adapted from the conceptual model. Finally, we provide a methodology for the transition from the conceptual to the logical model.

References

[1]

Ballard, C. Data Modeling Techniques for Data Warehousing. SG24-2238-00, IBM Red Book, ISBN 0738402451, 1998.

Digital Library

[2]

Boehnlein, M., Ulbrich-vom Ende, A. Deriving the Initial Data Warehouse Structures from the Conceptual Data Models of the Underlying Operational Information Systems. DOLAP, 1999.

Digital Library

[3]

Golfarelli, M., Rizzi, S. Methodological Framework for Data Warehouse Design. DOLAP, 1998.

Digital Library

[4]

Hahn, K., Sapia, C., Blaschka, M. Automatically Generating OLAP Schemata from Conceptual Graphical Models. DOLAP, 2000.

Digital Library

[5]

Kimball, R., et al. The Data Warehouse Lifecycle Toolkit. John Wiley & Sons, 1998.

Digital Library

[6]

Luján-Mora, S., Vassiliadis, P., Trujillo, J. Data Mapping Diagrams for Data Warehouse Design with UML. ER, 2004.

[7]

Moody, D.L., Kortink, M.A.R. From Enterprise Models to Dimensional Models: a Methodology for Data Warehouse and Data Mart Design. DMDW, 2000.

[8]

Peralta, V. Data Warehouse Logical Design from Multi-dimensional Conceptual Schemas. CLEI, 2003.

[9]

Phipps, C., Davis, K. Automating Data Warehouse Conceptual Schema Design and Evaluation. DMDW, 2002.

[10]

Simitsis, A. Mapping Conceptual to Logical Models for ETL Processes. Extended version. Available at: www.dbnet.ece.ntua.gr/asimi/publications/Simi05_TR.pdf

[11]

Simitsis, A., Vassiliadis, P. A Methodology for the Conceptual Modeling of ETL Processes. DSE, 2003.

[12]

Simitsis, A., Vassiliadis, P., Sellis, T. Optimizing ETL Processes in Data Warehouse Environments. ICDE, 2005.

Digital Library

[13]

Trujillo J., Lujan-Mora, S. A UML Based Approach for Modeling ETL Processes in Data Warehouses. ER, 2003.

[14]

Vassiliadis, P., Simitsis, A., Georgantas, P., Terrovitis, M., Skiadopoulos, S. A Generic and Customizable Framework for the Design of ETL Scenarios. Information Systems Journal, 30(7), 2005.

Digital Library

[15]

Vassiliadis, P., Simitsis, A., Skiadopoulos, S. Conceptual Modeling for ETL Processes. DOLAP, 2002.

Digital Library

[16]

Zaniolo, C. LDL++ Tutorial. UCLA. Available at: http://pike.cs.ucla.edu/ldl/, December 1998.

Cited By

Brzeski MRoman A(2023)Measuring Similarity Between ETL Processes Using Graph Edit DistanceSchedae Informaticae10.4467/20838476SI.23.001.1932332(9-25)Online publication date: 2023
https://doi.org/10.4467/20838476SI.23.001.19323
Sun Y(2022)Research and implementation of an efficient incremental synchronization method based on Timestamp2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)10.1109/CNIOT55862.2022.00035(158-162)Online publication date: May-2022
https://doi.org/10.1109/CNIOT55862.2022.00035
Wang SSun XGeng JHan YZhang CZhang W(2020)The Key Techniques of Constructing the Database of Treatment Measures for Hidden Troubles in Electric Power SystemE3S Web of Conferences10.1051/e3sconf/202018501027185(01027)Online publication date: 1-Sep-2020
https://doi.org/10.1051/e3sconf/202018501027
Show More Cited By

Index Terms

Mapping conceptual to logical models for ETL processes
1. Information systems
  1. Data management systems
    1. Database design and models
      1. Data model extensions

Recommendations

Defining ETL worfklows using BPMN and BPEL
DOLAP '09: Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP

Decisional systems are crucial for enterprise improvement. They allow the consolidation of heterogeneous data from distributed enterprise data stores into strategic indicators. An essential component of this data consolidation is the Extract, Transform, ...
Designing ETL processes using semantic web technologies
DOLAP '06: Proceedings of the 9th ACM international workshop on Data warehousing and OLAP

One of the most important tasks performed in the early stages of a data warehouse project is the analysis of the structure and content of the existing data sources and their intentional mapping to a common data model. Establishing the appropriate ...
Conceptual modeling for ETL processes
DOLAP '02: Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP

Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. In this paper, we focus on the problem of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DOLAP '05: Proceedings of the 8th ACM international workshop on Data warehousing and OLAP

November 2005

122 pages

ISBN:1595931627

DOI:10.1145/1097002

General Chair:
Il-Yeol Song
Drexel University
,
Program Chair:
Juan Trujillo
University of Alicante

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM05

Sponsor:

CIKM05: Conference on Information and Knowledge Management

November 4 - 5, 2005

Bremen, Germany

Acceptance Rates

Overall Acceptance Rate 29 of 79 submissions, 37%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
2,388
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Brzeski MRoman A(2023)Measuring Similarity Between ETL Processes Using Graph Edit DistanceSchedae Informaticae10.4467/20838476SI.23.001.1932332(9-25)Online publication date: 2023
https://doi.org/10.4467/20838476SI.23.001.19323
Sun Y(2022)Research and implementation of an efficient incremental synchronization method based on Timestamp2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)10.1109/CNIOT55862.2022.00035(158-162)Online publication date: May-2022
https://doi.org/10.1109/CNIOT55862.2022.00035
Wang SSun XGeng JHan YZhang CZhang W(2020)The Key Techniques of Constructing the Database of Treatment Measures for Hidden Troubles in Electric Power SystemE3S Web of Conferences10.1051/e3sconf/202018501027185(01027)Online publication date: 1-Sep-2020
https://doi.org/10.1051/e3sconf/202018501027
Petrović MTurajlić NVučković MBabarogić SAničić N(2019)Development of ETL Processes Using the Domain-Specific Modeling ApproachEmerging Perspectives in Big Data Warehousing10.4018/978-1-5225-5516-2.ch010(225-278)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-5516-2.ch010
Sitanggang ITrisminingsih RFuady FKhotimah H(2018)Extract, Transform, Load Module in SOLAP for Indonesia Agricultural Commodity2018 International Conference on Sustainable Information Engineering and Technology (SIET)10.1109/SIET.2018.8693152(101-105)Online publication date: Nov-2018
https://doi.org/10.1109/SIET.2018.8693152
Yu GLiu JDu JHu MSugumaran V(2018)An Integrated Approach for Massive Sequential Data Processing in Civil Infrastructure Operation and MaintenanceIEEE Access10.1109/ACCESS.2018.28160016(19739-19751)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2816001
Petrović MVuăźKović MTurajlić NBabarogić SAniăźIć NMarjanović Z(2017)Automating ETL processes using the domain-specific modeling approachInformation Systems and e-Business Management10.1007/s10257-016-0325-815:2(425-460)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1007/s10257-016-0325-8
Zekri AMassaâbi MLayouni OAkaichi J(2017)Trajectory ETL ModelingIntelligent Interactive Multimedia Systems and Services 201710.1007/978-3-319-59480-4_38(380-389)Online publication date: 28-May-2017
https://doi.org/10.1007/978-3-319-59480-4_38
Bala MBoussaid OAlimazighi Z(2016)Extracting-Transforming-Loading Modeling Approach for Big Data AnalyticsInternational Journal of Decision Support System Technology10.4018/IJDSST.20161001048:4(50-69)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.4018/IJDSST.2016100104
Aljawarneh I(2016)Design of a data warehouse model for decision support at higher educationInformation Development10.1177/026666691562110532:5(1691-1706)Online publication date: 8-Jul-2016
https://doi.org/10.1177/0266666915621105
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents