Abstract
We address several common problems in the field of Business Intelligence, Data Warehousing and Decision Support Systems: the complexity to manage, track and understand data lineage and system component dependencies in long series of data transformation chains. The paper presents practical methods to calculate meaningful data transformation and component dependency paths, based on program parsing, heuristic impact analysis, probabilistic rules and semantic technologies. Case studies are employed to explain further data aggregation and visualization of the results to address different planning and decision support problems for various user profiles like business users, managers, data stewards, system analysts, designers and developers.
Chapter PDF
Similar content being viewed by others
Keywords
References
Cook, D.: Gold parsing system (2010), http://www.goldparser.org
Cui, Y., Widom, J., Wiener, J.L.: Tracing the lineage of view data in a warehousing environment. ACM Transactions on Database Systems (TODS) 25(2), 179–227 (2000)
Cui, Y., Widom, J.: Lineage tracing for general data warehouse transformations. The VLDB Journal—The International Journal on Very Large Data Bases 12(1), 41–58 (2003)
de Santana, A.S., de Carvalho Moura, A.M.: Metadata to support transformations and data & metadata lineage in a warehousing environment. In: Kambayashi, Y., Mohania, M., Wöß, W. (eds.) DaWaK 2004. LNCS, vol. 3181, pp. 249–258. Springer, Heidelberg (2004)
Fan, H., Poulovassilis, A.: Using AutoMed metadata in data warehousing environments. In: Proceedings of the 6th ACM International Workshop on Data Warehousing and OLAP, pp. 86–93. ACM (November 2003)
Giorgini, P., Rizzi, S., Garzetti, M.: GRAnD: A goal-oriented approach to requirement analysis in data warehouses. Decision Support Systems 45(1), 4–21 (2008)
Luberg, A., Tammet, T., Järv, P.: Smart City: A Rule-based Tourist Recommendation System. In: Information and Communication Technologies in Tourism 2011, pp. 51–62. Springer Vienna (2011)
Missier, P., Belhajjame, K., Zhao, J., Roos, M., Goble, C.: Data Lineage Model for Taverna Workflows with Lightweight Annotation Requirements. In: Freire, J., Koop, D., Moreau, L. (eds.) IPAW 2008. LNCS, vol. 5272, pp. 17–30. Springer, Heidelberg (2008)
Priebe, T., Reisser, A., Hoang, D.T.A.: Reinventing the Wheel?! Why Harmonization and Reuse Fail in Complex Data Warehouse Environments and a Proposed Solution to the Problem (2011)
Ramesh, B., Jarke, M.: Toward reference models for requirements traceability. IEEE Transactions on Software Engineering 27(1), 58–93 (2001)
Reisser, A., Priebe, T.: Utilizing Semantic Web Technologies for Efficient Data Lineage and Impact Analyses in Data Warehouse Environments. In: Database and Expert Systems Application, DEXA 2009, pp. 59–63 (August 2009)
Skoutas, D., Simitsis, A.: Ontology-based conceptual design of ETL processes for both structured and semi-structured data. International Journal on Semantic Web and Information Systems (IJSWIS) 3(4), 1–24 (2007)
Tomingas, K., Kliimask, M., Tammet, T.: Mappings, Rules and Patterns in Template Based ETL Construction. In: The 11th International Baltic DB & IS2014 Conference (2014)
Tomingas, K., Kliimask, M., Tammet, T.: Data Integration Patterns for Data Warehouse Automation. In: The 18th East-European ADBIS 2014 Conference (2014)
Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP, pp. 14–21. ACM (November 2002)
Wang Baldonado, M.Q., Woodruff, A., Kuchinsky, A.: Guidelines for using multiple views in information visualization. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 110–119. ACM (May 2000)
MMX Metadata Framework, http://mmxframework.org
XDTL Data Transformation Language, http://xdtl.org
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Tomingas, K., Tammet, T., Kliimask, M. (2014). Rule-Based Impact Analysis for Enterprise Business Intelligence. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H., Sioutas, S., Makris, C. (eds) Artificial Intelligence Applications and Innovations. AIAI 2014. IFIP Advances in Information and Communication Technology, vol 437. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44722-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-662-44722-2_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44721-5
Online ISBN: 978-3-662-44722-2
eBook Packages: Computer ScienceComputer Science (R0)