Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Integration of data and computing infrastructures for earth science: an image mosaicking use-case

  • Research Article
  • Published:
Earth Science Informatics Aims and scope Submit manuscript

Abstract

This paper addresses the emerging issue of integrating data sharing and computing e-infrastructures for multidisciplinary applications. In the recent years several solutions have been proposed to implement digital infrastructures for sharing and processing scientific data and observations. Spatial data infrastructures currently enable effective and efficient geo-information data sharing in many disciplinary communities, and innovative solutions are under development to support new open data and linked data paradigms. In parallel, High Performance Computing systems, computing grids and more recently cloud services, enable fast processing of big data. However, the integration of data and computing e-infrastructures is a raising issue in multidisciplinary research. In the context of the Global Earth Observation System of Systems (GEOSS) initiative, an innovative approach has been proposed. Taking into account that the heterogeneity of data and computing e-infrastructures and related technologies cannot be reduced beyond a certain extent, since it is due to the need of supporting use cases and scenarios from different scientific communities, a brokering solution has been designed and developed. A Business Process Broker (BPB) is a component which takes a formal description of a scientific business process, and translates it in an executable process which can be run on multiple and remote processing and workflow services. In doing this it solves all the interoperability issues in a (semi-)automated way. It allows lowering the entry barrier for both computing service providers and users, decoupling the specification of the scientific process from the underlying enabling infrastructures. The paper presents and discusses a BPB use-case from the European project IASON, implementing an Earth Observation application involving satellite image mosaicking, HPC computing services and spatial data e-infrastructures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. http://uneplive.unep.org/

  2. https://ec.europa.eu/research/infrastructures/index_en.cfm?pg=esfri

  3. http://www.nsf.gov/geo/earthcube/

  4. http://gcmd.nasa.gov/index.html

  5. http://www.gbif.org/

  6. https://www.wmo.int/pages/prog/www/WIS/overview_en.html

  7. http://his.cuahsi.org/

  8. http://www.iris.edu/hq/

  9. http://inspire.ec.europa.eu/

  10. https://www.fgdc.gov/nsdi/nsdi.html

  11. http://www.iso.org

  12. http://www.opengeospatial.org

  13. http://www.tdwg.org

  14. https://www.unidata.ucar.edu/software/thredds/current/tds/

  15. https://www.unavco.org/software/data-management/gsac/gsac.html

  16. http://www.earthobservations.org/

  17. http://www.uncertweb.org

  18. http://www.medinaproject.eu/

  19. http://www.jbpm.org/

  20. http://bpmn.sourceforge.net/

  21. http://docs.qgis.org/2.0/en/docs/user_manual/processing/toolbox.html

  22. https://grasswiki.osgeo.org/wiki/GRASS_Python_Scripting_Library

  23. http://cgis2ui01.mediogrid.utcluj.ro/wps/wps.py?service=wps&version=1.0.0&request=GetCapabilities

  24. http://eopower.grid.unep.ch:8080/gi-portal/

References

  • Alameh N (2003) Chaining geographic information Web services. Internet Comput, IEEE 7(5):22–29. doi:10.1109/MIC.2003.1232514

    Article  Google Scholar 

  • Allison L, Gurney R (2014) Belmont Forum E-Infrastructures and Data Management Collaborative Research Action. Retrieved March 2, 2016, from http://www.bfe-inf.org/sites/default/files/doc-repository/Interim%20Report%20-%20E-Infrastructures%20%26%20Data%20Management%20CRA%2C%20version%201.1.pdf

  • Bacu V, Mihon D, Stefanut D, Rodila D, Gorgan D (2013) Calibration of SWAT hydrological models in a distributed environment using the gSWAT application. Int J Adv Comput Sci Appl 66–74. doi:10.14569/SpecialIssue.2013.030308. EnviroGRIDS Special Issue on “Building a Regional Observation System in the Black Sea Catchment”

  • Balcik FB, Mihon D, Colceriu V, Allenbach K, Goksel C, Ozgur D, Giuliani G, Gorgan D (2013) Remotely Sensed Data Processing on Grids by Using GreenLand Web Based Platform. Int J Adv Comput Sci Appl (IJACSA) 58–65. doi:10.14569/SpecialIssue.2013.030307. EnviroGRIDS Special Issue on “Building a Regional Observation System in the Black Sea Catchment”

  • Belmont Forum E-Infrastructures and Data Management Steering Committee (2015) A Place to Stand: eInfrastructure and Data Management for Global Change Research. Retrieved March 2, 2016, from http://www.bfe-inf.org/sites/default/files/doc-repository/A_Place_to_Stand-Belmont_Forum_E-Infrastructures__Data_Management_CSIP.PDF

  • Bigagli L, Santoro M, Angelini V, Mazzetti P, Nativi S (2011) Service frameworks for modelling resources. UncertWeb Deliverable D2.2. Retrieved March 2, 2016, from http://cordis.europa.eu/docs/projects/cnect/8/248488/080/deliverables/001-UncertWebD22.pdf

  • Bigagli L, Santoro M, Mazzetti P, Nativi S (2015) Architecture of a process broker for interoperable geospatial modeling on the Web. Int J Geo-Inf(IJGI) 4(2):647–660. doi:10.3390/ijgi4020647

    Google Scholar 

  • Castronova AM, Goodall JL, Elag MM (2013) Models as web services using the Open Geospatial Consortium (OGC) Web Processing Service (WPS) standard. Environ Model Softw 41:72–83

    Article  Google Scholar 

  • Cau P, Manca S, Soru C, Muroni D, Gorgan D, Bacu V, Lehman A, Ray N, Giuliani G (2013) An Interoperable, GIS-oriented, Information and Support System for Water Resources Management. International Journal of Advanced Computer Science and Applications(IJACSA) EnviroGRIDS Special Issue on "Building a Regional Observation System in the Black Sea Catchment" 75-82. doi:10.14569/SpecialIssue.2013.030309

  • Cepicky J (2007) PyWPS 2.0.0: the presence and the future. Geoinformatics. Prague

  • Chang FJ (2005) Business process management systems: strategy and implementation. CRC Press. Retrieved from Microsoft Developer Network: https://msdn.microsoft.com/en-us/library/ff647958.aspx

  • Chen Z, Chen N, Yang C, Di L (2012) Cloud computing enabled Web processing service for earth observation data processing. Sel Top Appl Earth Obs Remote Sens 5(6):1637–1649

    Article  Google Scholar 

  • Craglia M, de Bie K, Jackson D, Pesaresi M, Remetey-Fülöpp G, Wang C, Annoni A, Bian L, Campbell F, Ehlers M, van Genderen J, Goodchild M, Guo H, Lewis A, Simpson R, Skidmore A, Woodgate P (2012) Digital Earth 2020: towards the vision for the next decade. Int J Digital Earth 5(1). doi:10.1080/17538947.2011.638500

  • De Win B, Piessens F, Joosen W, Verhanneman T (2002) On the importance of the separation-of-concerns principle in secure software engineering. ACSA Workshop on the Application of Engineering Principles to System Security Design - Final Report (pp. 1–10). Boston, MA, USA

  • Diaz L, Granell C, Huerta J, Gould M (2012) Web 2.0 broker: a standards-based service for spatio-temporal search of crowd-sourced information. Appl Geogr 35(1):448–459

    Article  Google Scholar 

  • Edwards C (2013) In search of dark data. Retrieved from Earthzine Fostering Earth Observation & Global Awareness: http://earthzine.org/2013/05/22/in-search-of-dark-data-2/

  • ESA (2013) Big Data from Space Event Report. ESRIN. Frascati: ESA. Retrieved from http://www.congrexprojects.com/docs/default-source/13c10_docs/13c10_event_report.pdf?sfvrsn=2

  • ESSI-Lab (2014) GI-cat Homepage. Retrieved from http://essi-lab.eu/do/view/GIcat/WebHome

  • European Commission (2010) The future of cloud computing. Retrieved from http://cordis.europa.eu/fp7/ict/ssai/docs/cloud-report-final.pdf

  • Evangelidis K, Ntouros K, Makridis S, Papatheodorou C (2014) Geospatial services in the Cloud. Comput Geosci 63:116–122

    Article  Google Scholar 

  • Foerster T, Schaeffer B, Brauner J, Jirka S (2009) Integrating OGC Web Processing Services into Geospatial Mass-Market Applications. Advanced Geographic Information Systems & Web Services, 2009. GEOWS ‘09. International Conference on 98–103. doi:10.1109/GEOWS.2009.19

  • GEO (2014) The GEOSS Common Infrastructure (GCI). Retrieved from https://www.earthobservations.org/geoss.php

  • GEO Secretariat (2014) IN-03-C1: Evolution and enhancement of the GEOSS Common Infrastructure (GCI). Retrieved from GEO 2012–2015 Work Plan: http://www.geosec.org/ts.php?id=137

  • GeoServer (2010) GeoServer User Manual. Retrieved from http://docs.geoserver.org/stable/en/user/index.html

  • Giuliani G, Ray N, Lehmann A (2011a) Grid-enabled spatial data infrastructure for environmental sciences: challenges and opportunities. Futur Gener Comput Syst 27(3):292–303

    Article  Google Scholar 

  • Giuliani G, Ray N, Schwarzer S, De Bono A, Peduzzi P, Dao H, Lehmann A (2011b) Sharing environmental data through GEOSS. Int J Appl Geospatial Res (IJAGR) 2(1):1–17. doi:10.4018/jagr.2011010101

    Article  Google Scholar 

  • Giuliani G, Nativi S, Lehmann A, Ray N (2012) WPS mediation: an approach to process geospatial data on different computing backends. Comput Geosci 47:20–33

    Article  Google Scholar 

  • Giuliani G, Rahman K, Ray N, Lehmann A (2013) OWS4SWAT: publishing and sharing SWAT outputs with OGC standards. Int J Adv Comput Sci Appl 3:90–98. doi:10.14569/SpecialIssue.2013.030311, EnviroGRIDS Special Issue on “Building a Regional Observation System in the Black Sea Catchment”

    Google Scholar 

  • Google Inc (2015) Google earth: explore, search and discovery. Retrieved from http://earth.google.com

  • Gordon PM, Sensen C (2007) A pilot study into the usability of a scientific workflow construction tool. University of Calgary. Retrieved from http://dspace.ucalgary.ca/handle/1880/46486

  • Gorgan D, Abbaspour K, Cau P, Bacu V, Mihon D, Giuliani G, Ray N, Lehmann A (2011) Grid based data processing tools and applications for black sea catchment basin. IEEE 6th International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 1, pp. 223-228. Prague. doi:10.1109/IDAACS.2011.6072745

  • Gorgan D, Giuliani G, Ray N, Anthony L, Cau P, Abbaspour K, Charvat K, Jonoski A (2013) Black Sea Catchment Observation System as a Portal for GEOSS Community. International Journal of Advanced Computer Science and Applications EnviroGRIDS Special Issue on “Building a Regional Observation System in the Black Sea Catchment", 3, 9-18. doi:10.14569/SpecialIssue.2013.030301. EnviroGRIDS Special Issue on “Building a Regional Observation System in the Black Sea Catchment

  • Granell C, Díaz L, Gould M (2009) Distributed geospatial processing services. InInformation Science Reference (pp. 1186–1193). Encyclopedia of Information Science and Technology

  • Green TR, Petre M (1996) Usability analysis of visual programming environments: a ‘Cognitive Dimensions’ framework. J Vis Lang Comput 7:131–174

    Article  Google Scholar 

  • Hasselbring W (1999) The role of standards for interoperating information systems. In K. Jakobs, Information Technology Standards and Standardization: A Global Perspective. Idea Group Inc (IGI)

  • Heimbigner D, McLeod D (1985) A federated architecture for information management. ACM Trans Inf Syst 3(3):253–278

    Article  Google Scholar 

  • IASON Consortium (2015) IASON Project Home Page. Retrieved from IASON Project: http://www.iason-fp7.eu/index.php/en

  • Kahin B, Abbate J (eds) (1995) Standards Policy for Information Infrastructure. MIT Press, Cambridge

  • Kiehle C, Greve K, Heier C (2006) Standardized geoprocessing - Taking Spatial Data Infrastructures one Step Further. 9th AGILE Conference on Geographic Information Science (pp 273–282). Visegrad, Hungary

  • Lecca G, Petitdidier M, Hluchy L, Ivanovic M, Kussul N, Ray N, Thieron V (2011) Grid computing technology for hydrological applications. J Hydrol 403:186–199

    Article  Google Scholar 

  • Lee C, Percival G (2009) The evolution of geospatial e-infrastructures. GIS Science 69–70. Retrieved March 2, 2016, from http://portal.opengeospatial.org/files/?artifact_id=35975

  • Lee C, Percivall G (2008) Standards-based computing capabilities for distributed geospatial applications. Computer 41(11):50–57

    Article  Google Scholar 

  • Lee CA, Gasster SD, Plaza A, Chang C-I, Huang B (2011) Recent developments in high performance computing for remote sensing: a review. IEEE J Sel Top Appl Earth Obs Remote Sens 4(3):508–527

    Article  Google Scholar 

  • Lehmann A, Giuliani G, Ray N, Rahman K, Abbaspour KC, Nativi S, Beniston M (2014) Reviewing innovative Earth observation solutions for filling science-policy gaps in hydrology. J Hydrol 518:267–277. doi:10.1016/j.jhydrol.2014.05.059

    Article  Google Scholar 

  • Longley PA, Goodchild MF, Maguire DJ, Rhind DW (2015) Geographic Information Science and Systems, 4th Edition. Wiley. http://as.wiley.com/WileyCDA/WileyTitle/productCd-EHEP003247.html

  • Mazzetti P, Nativi S, Angelini V, Verlato M, Fiorucci P (2009) A grid platform for the european civil protection e-infrastructure: the forest fires use scenario. Earth Sci Inf 2(1):53–62

    Article  Google Scholar 

  • Mihon D, Colceriu V, Bacu V, & Gorgan D (2013) Grid based processing of satellite images in GreenLand Platform. Int J Adv Comput Sci Appl (IJACSA), 41–49

  • Nativi S, Bigagli L (2009) Discovery, mediation, and access services for earth observation data. IEEE J Sel Top Appl Earth Obs Remote Sens 2:233–240

    Article  Google Scholar 

  • Nativi S, Craglia M, Pearlman J (2013a) Earth science infrastructures interoperability: the brokering approach. IEEE JSTARS 6(3):1118–1129. doi:10.1109/JSTARS.2013.2243113

    Google Scholar 

  • Nativi S, Mazzetti P, Geller G (2013b) Environmental model access and interoperability: the GEO model Web initiative. Environ Model Softw 39:214–228. doi:10.1016/j.envsoft.2012.03.007

    Article  Google Scholar 

  • Nativi S, Mazzetti P, Craglia M, Pirrone N (2014) The GEOSS solution for enabling data interoperability and integrative research. Environ Sci Pollut Res 21(6):4177–4192

    Article  Google Scholar 

  • Nativi S, Mazzetti P, Santoro M, Papeschi F, Craglia M, Ochiai O (2015) Big data challenges in building the global earth observation system of systems. Environ Model Softw 68:1–26

    Article  Google Scholar 

  • Object Management Group (2015) Business process model and notation. Retrieved from http://www.bpmn.org/

  • Open Geospatial Consortium (2007) OpenGIS Web Processing Service:87

  • Petitdidier M, Cossu R, Mazzetti P, Fox P, Schwichtenberg H, Som de Cerff W (2009) Grid in earth sciences. Earth Sci Inf 2:1–3

    Article  Google Scholar 

  • Qiu F, Ni F, Chastain B, Huang H, Zhao P, Han W, Di L (2012) GWASS: GRASS web application software system based on the GeoBrain web service. Comput Geosci 47:143–150. doi:10.1016/j.cageo.2012.01.023

    Article  Google Scholar 

  • Samadzadegan F, Saber M, Zahmatkesh H, Joze Ghazi Khanlou H (2013) An architecture for automated fire detection early warning system based on geoprocessing service composition. ISPRS - Int Arch Photogramm, Remote Sens Spat Inf Sci 1(3):351–355

    Article  Google Scholar 

  • Schäffer B, Baranski B, Foerster T (2010) Towards Spatial Data Infrastructures in the Clouds. Geospatial Think, Lect Notes Geoinform Cartogr 399–418. doi:10.1007/978-3-642-12326-9_21

  • Shao Y, Di L, Bai Y, Guo B, Gong J (2012) Geoprocessing on the Amazon cloud computing platform — AWS. Agro-Geoinformatics (Agro-Geoinformatics) 1–6

  • Simonis I, Echterhoff J (2008) GEOSS and the Sensor Web. GEOSS Sensor Web Workshop Report

  • Völter M, Kircher M, Zdun U (2013) Remoting patterns: foundations of enterprise, internet and realtime distributed object. Wiley, Middleware

    Google Scholar 

  • Zhao P, Foerster T, Yue P (2012) The geoprocessing Web. Comput Geosci 47:3–12. doi:10.1016/j.cageo.2012.04.021

    Article  Google Scholar 

Download references

Acknowledgments

The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 603534 (IASON), grant agreement no. 603500 (EOPOWER), and grant agreement no. 227640 (enviroGRIDS). We thank Jean-Philippe Richard, GRID-Geneva IT administrator, for help with the hosting of the application.

Author information

Authors and Affiliations

  1. Division of Florence, National Research Council of Italy, Institute of Atmospheric Pollution Research (CNR-IIA), Via Madonna del Piano 10, Sesto Fiorentino, 50019, FI, Italy

    Paolo Mazzetti, Roberto Roncella & Stefano Nativi

  2. Computer Science Department, Technical University of Cluj-Napoca, Str. G. Baritiu 28, 400027, Cluj-Napoca, Romania

    Danut Mihon, Victor Bacu & Dorian Gorgan

  3. Institute for Environmental Sciences, enviroSPACE Laboratory, University of Geneva, 66 Bd Carl-Vogt, CH-1205, Geneva, Switzerland

    Pierre Lacroix, Yaniss Guigoz, Nicolas Ray & Gregory Giuliani

  4. Global Resource Information Database – Geneva, International Environment House, 11 chemin des Anémones, CH-1219, Châtelaine, Switzerland

    Pierre Lacroix, Yaniss Guigoz, Nicolas Ray & Gregory Giuliani

Authors
  1. Paolo Mazzetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roberto Roncella
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danut Mihon
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Victor Bacu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pierre Lacroix
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yaniss Guigoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Nicolas Ray
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Gregory Giuliani
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Dorian Gorgan
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Stefano Nativi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Roberto Roncella.

Additional information

Communicated by: H. A. Babaie

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mazzetti, P., Roncella, R., Mihon, D. et al. Integration of data and computing infrastructures for earth science: an image mosaicking use-case. Earth Sci Inform 9, 325–342 (2016). https://doi.org/10.1007/s12145-016-0255-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12145-016-0255-5

Keywords

Search

Navigation