Abstract
Recently, organisations operating in the context of Smart Cities are spending time and resources in turning large amounts of data, collected within heterogeneous sources, into actionable insights, using indicators as powerful tools for meaningful data aggregation and exploration. Data lakes, which follow a schema-on-read approach, allow for storing both structured and unstructured data and have been proposed as flexible repositories for enabling data exploration and analysis over heterogeneous data sources, regardless their structure. However, indicators are usually computed based on the centralisation of the data storage, according to a less flexible schema on write approach. Furthermore, domain experts, who know data stored within the data lake, are usually distinct from data analysts, who define indicators, and users, who exploit indicators to explore data in a personalised way. In this paper, we propose a semantics-based approach for enabling personalised data lake exploration through the conceptualisation of proper indicators. In particular, the approach is structured as follows: (i) at the bottom, heterogeneous data sources within a data lake are enriched with Semantic Models, defined by domain experts using domain ontologies, to provide a semantic data lake representation; (ii) in the middle, a Multi-Dimensional Ontology is used by analysts to define indicators and analysis dimensions, in terms of concepts within Semantic Models and formulas to aggregate them; (iii) at the top, Personalised Exploration Graphs are generated for different categories of users, whose profiles are defined in terms of a set of constraints that limit the indicators instances on which the users may rely to explore data. Benefits and limitations of the approach are discussed through an application in the Smart City domain.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
http://www.geonames.org/ (prefix: GEO).
- 3.
http://www.w3.org/ns/sosa (prefix: sosa).
- 4.
http://www.w3.org/2006/time (prefix: time).
- 5.
https://schema.org/ (prefix: schema).
- 6.
https://www.w3.org/TR/vocab-data-cube/ (prefix: qb).
- 7.
- 8.
For instance, Protégé (https://protege.stanford.edu/) and COMA tool (https://dbs.uni-leipzig.de/Research/coma.html).
- 9.
- 10.
- 11.
- 12.
References
Abelló, A., et al.: Using semantic web technologies for exploratory OLAP: a survey. IEEE Trans. Knowl. Data Eng. 27(2), 571–588 (2014)
Alserafi, A., Abelló, A., Romero, O., Calders, T.: Towards information profiling: data lake content metadata management. In: Proceedings of IEEE 16th International Conference on Data Mining Workshops (ICDMW 2016), Barcelona, Spain, pp. 178–185 (2016)
Beheshti, A., Benatallah, B., Nouri, R., Tabebordbar, A.: CoreKG: a knowledge lake service. PVLDB 11(12), 1942–1945 (2018)
Buoncristiano, M., Mecca, G., Quintarelli, E., Roveri, M., Santoro, D., Tanca, L.: Database challenges for exploratory computing. SIGMOD Rec. 44(2), 17–22 (2015)
Chauhan, S., Agarwal, N., Kar, A.: Addressing big data challenges in smart cities: a systematic literature review. Info 18(4), 73–90 (2016)
Diamantini, C., Potena, D., Storti, E., Zhang, H.: An ontology-based data exploration tool for key performance indicators. In: Proceedings of 22nd OTM Conference on Cooperative Information Systems (CoopIS 2014), Amantea, Italy, pp. 727–744 (2014)
Giudice, P.L., Musarella, L., Sofo, G., Ursino, D.: An approach to extracting complex knowledge patterns among concepts belonging to structured, semi-structured and unstructured sources in a data lake. Inf. Sci. 478, 606–626 (2019)
Hai, R., Geisler, S., Quix, C.: Constance: an intelligent data lake system. In: Proceedings of the 2016 International Conference on Management of Data (SIGMOD/PODS 2016), San Francisco, California, pp. 2097–2100 (2016)
Halevy, A.Y., et al.: Managing Google’s data lake: an overview of the GOODS system. IEEE Data Eng. Bull. 39(3), 5–14 (2016)
Kasrin, N., Qureshi, M., Steuer, S., Nicklas, D.: Semantic data management for experimental manufacturing technologies. Datenbank-Spektrum 18(1), 27–37 (2018)
Lytra, I., Vidal, M., Orlandi, F., Attard, J.: A big data architecture for managing oceans of data and maritime applications. In: Proceedings of International Conference on Engineering, Technology and Innovation (ICE/ITMC 2017), Madeira, Portugal, pp. 1216–1226 (2017)
Maccioni, A., Torlone, R.: KAYAK: a framework for just-in-time data preparation in a data lake. In: Krogstie, J., Reijers, H.A. (eds.) CAiSE 2018. LNCS, vol. 10816, pp. 474–489. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91563-0_29
Malysiak-Mrozek, B., Stabla, M., Mrozek, D.: Soft and declarative fishing of information in big data lake. IEEE Trans. Fuzzy Syst. 26(5), 2731–2747 (2018)
Mami, M.N., Graux, D., Scerri, S., Jabeen, H., Auer, S., Lehmann, J.: Squerall: virtual ontology-based access to heterogeneous and large data sources. In: Proceedings of 18th International Semantic Web Conference (ISWC 2019), Auckland, New Zealand (2019, in press)
Pomp, A., Paulus, A., Kirmse, A., Kraus, V., Meisen, T.: Applying semantics to reduce the time to analytics within complex heterogeneous infrastructures. Technologies 6(3), 86–114 (2018)
Skluzacek, T.J., Chard, K., Foster, I.: Klimatic: a virtual data lake for harvesting and distribution of geospatial data. In: Proceedings of 1st Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems (PDSW-DISCS 2016), Salt Lake City, Utah, pp. 31–36 (2016)
Walker, C., Alrehamy, H.: Personal data lake with data gravity pull. In: Proceedings of 2015 IEEE Fifth International Conference on Big Data and Cloud Computing (BDCLOUD 2015), Dalian, China, pp. 160–167 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Bagozi, A., Bianchini, D., De Antonellis, V., Garda, M., Melchiori, M. (2019). Personalised Exploration Graphs on Semantic Data Lakes. In: Panetto, H., Debruyne, C., Hepp, M., Lewis, D., Ardagna, C., Meersman, R. (eds) On the Move to Meaningful Internet Systems: OTM 2019 Conferences. OTM 2019. Lecture Notes in Computer Science(), vol 11877. Springer, Cham. https://doi.org/10.1007/978-3-030-33246-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-33246-4_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33245-7
Online ISBN: 978-3-030-33246-4
eBook Packages: Computer ScienceComputer Science (R0)