Nothing Special   »   [go: up one dir, main page]

You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (11)

Search Parameters:
Keywords = geospatial resource discovery

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
19 pages, 12042 KiB  
Article
HYPOSO Map Viewer: A Web-Based Atlas of Small-Scale Hydropower for Selected African and Latin American Countries
by Petras Punys, Linas Jurevičius and Andrius Balčiūnas
Water 2024, 16(9), 1276; https://doi.org/10.3390/w16091276 - 29 Apr 2024
Viewed by 1676
Abstract
In many countries, the advancement of hydropower resources has been hindered by economic factors and insufficient data on topography, streamflow, environmental sensitivity, power grid, and, most importantly, the location of potential hydropower sites. This challenge is particularly pronounced in certain African and Latin [...] Read more.
In many countries, the advancement of hydropower resources has been hindered by economic factors and insufficient data on topography, streamflow, environmental sensitivity, power grid, and, most importantly, the location of potential hydropower sites. This challenge is particularly pronounced in certain African and Latin American river systems. Developing web-based maps of hydropower resources based on geographic information systems and advanced mapping technologies can facilitate the initial assessment of hydropower sites. This is especially relevant for developing sites in remote areas and data-scarce regions. The available geospatial datasets, remote sensing technologies, and advanced GIS modelling techniques can be used to identify potential hydropower sites and assess their preliminary characteristics. This paper reviews web-based hydropower atlases in African and Latin American countries. Their main features are represented and compared with the recently launched HYPOSO map viewer covering two African countries (Cameroon and Uganda) and three Latin American countries (Bolivia, Colombia, and Ecuador). This hydropower atlas consists of 20 spatial layers. Its particular focus is to present a geospatial dataset of new hydropower sites with concise information for potential investors. These so-called virtual hydropower atlases can be only one type of discovery at the early project stage, automatically identifying sites worthy of further investigation. A formal validation of the web-based atlases, including the HYPOSO hydropower atlas, is briefly considered. Creating open-access hydropower map viewers is anticipated to significantly enhance the hydropower development database in these nations, offering valuable insights for small and medium-scale projects. Full article
(This article belongs to the Section Water-Energy Nexus)
Show Figures

Figure 1

Figure 1
<p>Desktop interface of the HYPOSO hydropower atlas (<b>a</b>) and key layers (<b>b</b>).</p>
Full article ">Figure 2
<p>Transmission and distribution lines of the western part of Uganda (<b>a</b>) and protected areas in Bolivia (<b>b</b>).</p>
Full article ">Figure 3
<p>Hydropower plants under operation in Ecuador and Colombia.</p>
Full article ">Figure 4
<p>Climate zones in Bolivia (<b>a</b>) and climate change projections of precipitation (mean projections—CMIP6 and scenario SSP2–4.5) in Uganda (<b>b</b>).</p>
Full article ">Figure 5
<p>Hydrologic units (geospatial polygons) of Bolivia (<b>a</b>) and rivers and streams (geospatial polyline layer) with the Strahler stream order highlighted in Ecuador (<b>b</b>). River and stream gauging stations (GS) network in Cameroon (<b>c</b>). An extract of the small catchment area generated from the DEM in Bolivia (geospatial polygon layer). (<b>d</b>). A pop-up with a catchment area of 220.73 km<sup>2</sup> is highlighted.</p>
Full article ">Figure 6
<p>Normal annual specific runoff (geospatial polygon layer) (<b>a</b>) and the mean annual flow of the rivers (geospatial polygon layer) in Cameroon (<b>b</b>).</p>
Full article ">Figure 7
<p>Hydropower potential from new stream-reach development (NSD), MW (geospatial polyline layer) (<b>a</b>), and potential sites of hydropower plants in Ecuador (geospatial point layer), with a pop-up window showing key features of a site (<b>b</b>).</p>
Full article ">Figure 8
<p>Key characteristics of the potential hydropower sites in Bolivia at large (<b>a</b>) and their frequency distribution of capacities (P &lt; 40 MW) with a fitted theoretical Weibull distribution density function (<b>b</b>); Capacity = 499*5*Weibull (x;14.18;1.21;0). Where sample size of the distribution n = 499, 5—graph conversion parameter, 14.18—scale parameter, 1.21—shape parameter, and 0—location parameter.</p>
Full article ">Figure 9
<p>(<b>a</b>) The cumulative (total) hydropower potential (MW) of the larger river basins in Uganda (geospatial polygon layer). (<b>b</b>) Specific hydropower potential (MW/km) in Colombia (geospatial polyline layer).</p>
Full article ">
13 pages, 2086 KiB  
Article
Bert-Based Latent Semantic Analysis (Bert-LSA): A Case Study on Geospatial Data Technology and Application Trend Analysis
by Quanying Cheng, Yunqiang Zhu, Jia Song, Hongyun Zeng, Shu Wang, Kai Sun and Jinqu Zhang
Appl. Sci. 2021, 11(24), 11897; https://doi.org/10.3390/app112411897 - 14 Dec 2021
Cited by 11 | Viewed by 4756
Abstract
Geospatial data is an indispensable data resource for research and applications in many fields. The technologies and applications related to geospatial data are constantly advancing and updating, so identifying the technologies and applications among them will help foster and fund further innovation. Through [...] Read more.
Geospatial data is an indispensable data resource for research and applications in many fields. The technologies and applications related to geospatial data are constantly advancing and updating, so identifying the technologies and applications among them will help foster and fund further innovation. Through topic analysis, new research hotspots can be discovered by understanding the whole development process of a topic. At present, the main methods to determine topics are peer review and bibliometrics, however they just review relevant literature or perform simple frequency analysis. This paper proposes a new topic discovery method, which combines a word embedding method, based on a pre-trained model, Bert, and a spherical k-means clustering algorithm, and applies the similarity between literature and topics to assign literature to different topics. The proposed method was applied to 266 pieces of literature related to geospatial data over the past five years. First, according to the number of publications, the trend analysis of technologies and applications related to geospatial data in several leading countries was conducted. Then, the consistency of the proposed method and the existing method PLSA (Probabilistic Latent Semantic Analysis) was evaluated by using two similar consistency evaluation indicators (i.e., U-Mass and NMPI). The results show that the method proposed in this paper can well reveal text content, determine development trends, and produce more coherent topics, and that the overall performance of Bert-LSA is better than PLSA using NPMI and U-Mass. This method is not limited to trend analysis using the data in this paper; it can also be used for the topic analysis of other types of texts. Full article
(This article belongs to the Special Issue Current Approaches and Applications in Natural Language Processing)
Show Figures

Figure 1

Figure 1
<p>Process of data collection and pre-processing.</p>
Full article ">Figure 2
<p>(<b>a</b>) Number of papers related to geospatial data published per year; (<b>b</b>) Number of papers related to geospatial data published by country.</p>
Full article ">Figure 3
<p>Document topic generation method.</p>
Full article ">Figure 4
<p>Example of document vector generation.</p>
Full article ">Figure 5
<p>Method of document topic determination.</p>
Full article ">Figure 6
<p>Topic consistency values of PLSA and Bert-LSA models obtained by the U-Mass method.</p>
Full article ">Figure 7
<p>Topic consistency values of PLSA and Bert-LSA models obtained with the <span class="html-italic">NPMI</span> method.</p>
Full article ">
18 pages, 1036 KiB  
Article
Geo-L: Topological Link Discovery for Geospatial Linked Data Made Easy
by Christian Zinke-Wehlmann and Amit Kirschenbaum
ISPRS Int. J. Geo-Inf. 2021, 10(10), 712; https://doi.org/10.3390/ijgi10100712 - 19 Oct 2021
Cited by 3 | Viewed by 2187
Abstract
Geospatial linked data are an emerging domain, with growing interest in research and the industry. There is an increasing number of publicly available geospatial linked data resources, which can also be interlinked and easily integrated with private and industrial linked data on the [...] Read more.
Geospatial linked data are an emerging domain, with growing interest in research and the industry. There is an increasing number of publicly available geospatial linked data resources, which can also be interlinked and easily integrated with private and industrial linked data on the web. The present paper introduces Geo-L, a system for the discovery of RDF spatial links based on topological relations. Experiments show that the proposed system improves state-of-the-art spatial linking processes in terms of mapping time and accuracy, as well as concerning resources retrieval efficiency and robustness. Full article
(This article belongs to the Special Issue Semantic Spatial Web)
Show Figures

Figure 1

Figure 1
<p>a within b.</p>
Full article ">Figure 2
<p>Retrieval time OLU–OLU.</p>
Full article ">Figure 3
<p>Performance OLU–OLU; size: <math display="inline"><semantics> <mrow> <mn>165</mn> <mspace width="0.166667em"/> <mi>·</mi> <mspace width="0.166667em"/> <msup> <mn>10</mn> <mn>3</mn> </msup> <mo>×</mo> <mn>165</mn> <mspace width="0.166667em"/> <mi>·</mi> <mspace width="0.166667em"/> <msup> <mn>10</mn> <mn>3</mn> </msup> </mrow> </semantics></math>.</p>
Full article ">Figure 4
<p>Performance OLU–OLU; size: <math display="inline"><semantics> <mrow> <mn>400</mn> <mspace width="0.166667em"/> <mi>·</mi> <mspace width="0.166667em"/> <msup> <mn>10</mn> <mn>3</mn> </msup> <mo>×</mo> <mn>400</mn> <mspace width="0.166667em"/> <mi>·</mi> <mspace width="0.166667em"/> <msup> <mn>10</mn> <mn>3</mn> </msup> </mrow> </semantics></math>.</p>
Full article ">Figure 5
<p>Performance SPOI–OLU; topological relation: within.</p>
Full article ">Figure 6
<p>Performance SPOI–NUTS; topological relation: within.</p>
Full article ">Figure 7
<p>Performance OLU–NUTS; size: <math display="inline"><semantics> <mrow> <mi>X</mi> <mspace width="0.166667em"/> <mi>·</mi> <mspace width="0.166667em"/> <msup> <mn>10</mn> <mn>3</mn> </msup> <mo>×</mo> <mn>1782</mn> </mrow> </semantics></math>.</p>
Full article ">Figure 8
<p>Buffer zone of a lake which intersects with a field.</p>
Full article ">Figure 9
<p>Erosion land zones of a field.</p>
Full article ">Figure 10
<p>Fields which grew maize for silage during 2019 within the South Moravian Region.</p>
Full article ">
21 pages, 3415 KiB  
Review
Digital Twin and Internet of Things—Current Standards Landscape
by Michael Jacoby and Thomas Usländer
Appl. Sci. 2020, 10(18), 6519; https://doi.org/10.3390/app10186519 - 18 Sep 2020
Cited by 137 | Viewed by 17205
Abstract
Industry 4.0 is revolutionizing industrial production by bridging the physical and the virtual worlds and further improving digitalization. Two essential building blocks in industry 4.0 are digital twins (DT) and the internet of things (IoT). While IoT is about connecting resources and collecting [...] Read more.
Industry 4.0 is revolutionizing industrial production by bridging the physical and the virtual worlds and further improving digitalization. Two essential building blocks in industry 4.0 are digital twins (DT) and the internet of things (IoT). While IoT is about connecting resources and collecting data about the physical world, DTs are the virtual representations of resources organizing and managing information and being tightly integrated with artificial intelligence, machine learning and cognitive services to further optimize and automate production. The concepts of DTs and IoT are overlapping when it comes to describing, discovering and accessing resources. Currently, there are multiple DT and IoT standards covering these overlapping aspects created by different organizations with different backgrounds and perspectives. With regard to interoperability, which is presumably the most important aspect of industry 4.0, this barrier needs to be overcome by consolidation of standards. The objective of this paper is to investigate current DT and IoT standards and provide insights to stimulate this consolidation. Overlapping aspects are identified and a classification scheme is created and applied to the standards. The results are compared, aspects with high similarity or divergence are identified and a proposal for stimulating consolidation is presented. Consensus between standards are found regarding the elements a resource should consist of and which serialization format(s) and network protocols to use. Controversial topics include which query language to use for discovery as well as if geo-spatial, temporal and historical data should be explicitly supported. Full article
(This article belongs to the Special Issue Digital Twins in Industry)
Show Figures

Figure 1

Figure 1
<p>Functional overlap between internet of things and digital twins that is subject to standardization in both domains.</p>
Full article ">Figure 2
<p>The metamodel hierarchy based on the Object Management Group basic idea of multilevel metamodeling [<a href="#B28-applsci-10-06519" class="html-bibr">28</a>] with an expanded M1 layer to reflect hierarchical organization of models typical for the internet of things and digital twins.</p>
Full article ">Figure 3
<p>Class diagram depicting the metamodel of the AssetAdministrationShell concept developed by Plattform Industrie 4.0 (based on Figure 11 from [<a href="#B39-applsci-10-06519" class="html-bibr">39</a>]).</p>
Full article ">Figure 4
<p>Class diagram depicting the metamodel of the digital twin definition language.</p>
Full article ">Figure 5
<p>Class diagram depicting the metamodel hierarchy of the Next Generation Service Interfaces-Linked Data (NGSI-LD) API as defined by European Telecommunications Standards Institute (ETSI) (based on Figure 4.2.3-1 from [<a href="#B43-applsci-10-06519" class="html-bibr">43</a>]).</p>
Full article ">Figure 6
<p>Components of URLs according to the Open Data Protocol specification.</p>
Full article ">Figure 7
<p>Class diagram depicting the data model of the SensorThings API Part 1 and 2 in version 1.0 (based on Figure 2 from [<a href="#B53-applsci-10-06519" class="html-bibr">53</a>] and Figure 1 from [<a href="#B54-applsci-10-06519" class="html-bibr">54</a>]).</p>
Full article ">Figure 8
<p>Class diagram depicting the metamodel of the Web of Things Thing Description (based on Figure 1 from [<a href="#B55-applsci-10-06519" class="html-bibr">55</a>]).</p>
Full article ">
14 pages, 9109 KiB  
Article
A Smart Web-Based Geospatial Data Discovery System with Oceanographic Data as an Example
by Yongyao Jiang, Yun Li, Chaowei Yang, Fei Hu, Edward M. Armstrong, Thomas Huang, David Moroni, Lewis J. McGibbney, Frank Greguska and Christopher J. Finch
ISPRS Int. J. Geo-Inf. 2018, 7(2), 62; https://doi.org/10.3390/ijgi7020062 - 11 Feb 2018
Cited by 11 | Viewed by 5408
Abstract
Discovering and accessing geospatial data presents a significant challenge for the Earth sciences community as massive amounts of data are being produced on a daily basis. In this article, we report a smart web-based geospatial data discovery system that mines and utilizes data [...] Read more.
Discovering and accessing geospatial data presents a significant challenge for the Earth sciences community as massive amounts of data are being produced on a daily basis. In this article, we report a smart web-based geospatial data discovery system that mines and utilizes data relevancy from metadata user behavior. Specifically, (1) the system enables semantic query expansion and suggestion to assist users in finding more relevant data; (2) machine-learned ranking is utilized to provide the optimal search ranking based on a number of identified ranking features that can reflect users’ search preferences; (3) a hybrid recommendation module is designed to allow users to discover related data considering metadata attributes and user behavior; (4) an integrated graphic user interface design is developed to quickly and intuitively guide data consumers to the appropriate data resources. As a proof of concept, we focus on a well-defined domain-oceanography and use oceanographic data discovery as an example. Experiments and a search example show that the proposed system can improve the scientific community’s data search experience by providing query expansion, suggestion, better search ranking, and data recommendation via a user-friendly interface. Full article
(This article belongs to the Special Issue Web and Mobile GIS)
Show Figures

Figure 1

Figure 1
<p>System architecture.</p>
Full article ">Figure 2
<p>Workflow of the profile analyzer.</p>
Full article ">Figure 3
<p>Workflow of semantic similarity calculator.</p>
Full article ">Figure 4
<p>Workflow of the ranker.</p>
Full article ">Figure 5
<p>Workflow of the recommender.</p>
Full article ">Figure 6
<p>System main page.</p>
Full article ">Figure 7
<p>Search results page.</p>
Full article ">Figure 8
<p>Dataset detail page.</p>
Full article ">Figure 9
<p>Query suggestion results.</p>
Full article ">Figure 10
<p>Comparison between the proposed system and PO.DAAC’s search results. (<b>a</b>) Top search results of “sea surface temperature” of PO.DAAC; (<b>b</b>) Top search results of “sea surface temperature” of the proposed system.</p>
Full article ">Figure 11
<p>Recommendation results of a selected dataset.</p>
Full article ">
1298 KiB  
Article
Web-Scale Normalization of Geospatial Metadata Based on Semantics-Aware Data Sources
by Cristiano Fugazza, Paolo Tagliolato, Luca Frigerio and Paola Carrara
ISPRS Int. J. Geo-Inf. 2017, 6(11), 354; https://doi.org/10.3390/ijgi6110354 - 13 Nov 2017
Cited by 6 | Viewed by 4254
Abstract
Geospatial metadata are largely denormalized inasmuch as resource descriptions typically accommodate property values as plain text. Hence, it is not possible to bring multiple references to the same entity (say, a keyword from a controlled vocabulary) under the same umbrella. This practice is [...] Read more.
Geospatial metadata are largely denormalized inasmuch as resource descriptions typically accommodate property values as plain text. Hence, it is not possible to bring multiple references to the same entity (say, a keyword from a controlled vocabulary) under the same umbrella. This practice is ultimately the main source for the heterogeneities in metadata descriptions by which geospatial discovery is hampered. In this paper, we elaborate on ex-post semantic augmentation of metadata, a technique generally referred to as semantic lift, which complements our previous research on semantic characterization of metadata via transparent association of uniform resource identifiers with metadata items at editing time. The latter is accomplished by means of a template-based metadata editor that can be tailored to any XML-based metadata schema. By repurposing the template language previously defined for metadata editing, we broaden the expressiveness of the former and integrate heterogeneous, XML-based resource descriptions in our semantics-aware metadata management workflow. URI-based indirection in metadata provision not only entails normalization of individual information items and allows one to overcome the aforementioned heterogeneities, but also elicits decentralized, multi-tenanted management of metadata. Full article
Show Figures

Figure 1

Figure 1
<p>Data management workflow as conceived by the ENVRI Community.</p>
Full article ">Figure 2
<p>Use cases exemplifying semantic discovery mechanisms.</p>
Full article ">Figure 3
<p>Overview of workflows for semantic lift through EDI/Liftboy.</p>
Full article ">Figure 4
<p>Interface to the Liftboy application.</p>
Full article ">
4624 KiB  
Article
Employing Search Engine Optimization (SEO) Techniques for Improving the Discovery of Geospatial Resources on the Web
by Samy Katumba and Serena Coetzee
ISPRS Int. J. Geo-Inf. 2017, 6(9), 284; https://doi.org/10.3390/ijgi6090284 - 7 Sep 2017
Cited by 12 | Viewed by 7268
Abstract
With the increasing use of geographical information and technology in a variety of knowledge domains and disciplines, the need to discover and access suitable geospatial data is imperative. Most spatial data infrastructures (SDI) provide geoportals as entry points to the SDI through which [...] Read more.
With the increasing use of geographical information and technology in a variety of knowledge domains and disciplines, the need to discover and access suitable geospatial data is imperative. Most spatial data infrastructures (SDI) provide geoportals as entry points to the SDI through which geospatial data are disseminated and shared. Geoportals are often known in geoinformation communities only, and they present technological challenges for indexing by web search engines. To overcome these challenges, we identified and categorized search terms typically employed by users when looking for geospatial resources on the Web. Guided by these terms, we published metadata about geospatial sources “directly” on the Web and performed empirical tests with search engine optimization (SEO) techniques. Two sets of HTML pages were prepared and registered with Google and Bing respectively. The metadata in one set was marked up with Dublin Core, the other with Schema.org. Analysis of the results shows that Google was more effective than Bing in retrieving the pages. Pages marked up with Schema.org were more effectively retrieved than those marked up with Dublin Core. The statistical results were significant in most of the tests performed. This research confirms that pages marked up with Schema.org and Dublin Core are a novel alternative for improving the visibility and facilitating the discovery of geospatial resources on the Web. Full article
Show Figures

Figure 1

Figure 1
<p>Overview of the study.</p>
Full article ">Figure 2
<p>Pages marked up with Dublin Core listed on Google Webmaster Tools.</p>
Full article ">Figure 3
<p>Pages marked up with Schema.org listed on Bing Webmaster.</p>
Full article ">Figure 4
<p>Bing “Markup Validator”: Result for ugandaboundaries.html, marked up with Dublin.</p>
Full article ">Figure 5
<p>Bing Markup Validator: Result for ugandaboundaries.html marked up with Schema.org using microdata.</p>
Full article ">Figure 6
<p>Google “Structured data testing tool”: Result for ugandaboundaries.html, marked up with Dublin Core.</p>
Full article ">Figure 7
<p>Google “Structured data testing tool”: Result for ugandaboundaries.html, marked up with Schema.org using microdata.</p>
Full article ">Figure 8
<p>Mapping from taxonomy to vocabularies via standards.</p>
Full article ">
5631 KiB  
Article
GeoWeb Crawler: An Extensible and Scalable Web Crawling Framework for Discovering Geospatial Web Resources
by Chih-Yuan Huang and Hao Chang
ISPRS Int. J. Geo-Inf. 2016, 5(8), 136; https://doi.org/10.3390/ijgi5080136 - 5 Aug 2016
Cited by 18 | Viewed by 10477
Abstract
With the advance of the World-Wide Web (WWW) technology, people can easily share content on the Web, including geospatial data and web services. Thus, the “big geospatial data management” issues start attracting attention. Among the big geospatial data issues, this research focuses on [...] Read more.
With the advance of the World-Wide Web (WWW) technology, people can easily share content on the Web, including geospatial data and web services. Thus, the “big geospatial data management” issues start attracting attention. Among the big geospatial data issues, this research focuses on discovering distributed geospatial resources. As resources are scattered on the WWW, users cannot find resources of their interests efficiently. While the WWW has Web search engines addressing web resource discovery issues, we envision that the geospatial Web (i.e., GeoWeb) also requires GeoWeb search engines. To realize a GeoWeb search engine, one of the first steps is to proactively discover GeoWeb resources on the WWW. Hence, in this study, we propose the GeoWeb Crawler, an extensible Web crawling framework that can find various types of GeoWeb resources, such as Open Geospatial Consortium (OGC) web services, Keyhole Markup Language (KML) and Environmental Systems Research Institute, Inc (ESRI) Shapefiles. In addition, we apply the distributed computing concept to promote the performance of the GeoWeb Crawler. The result shows that for 10 targeted resources types, the GeoWeb Crawler discovered 7351 geospatial services and 194,003 datasets. As a result, the proposed GeoWeb Crawler framework is proven to be extensible and scalable to provide a comprehensive index of GeoWeb. Full article
Show Figures

Graphical abstract

Graphical abstract
Full article ">Figure 1
<p>The GeoWeb Long Tail.</p>
Full article ">Figure 2
<p>Examples of data portals/SDIs: (<b>a</b>) Global Earth Observation System of Systems (GEOSS); (<b>b</b>) Data.gov; (<b>c</b>) National Aeronautics and Space Administration (NASA)’s data portal; and (<b>d</b>) National Climatic Data Center.</p>
Full article ">Figure 3
<p>The concept of the Surface Web and the Deep Web.</p>
Full article ">Figure 4
<p>The architecture of the GeoWeb crawler.</p>
Full article ">Figure 5
<p>Architecture of distributed computing implementation.</p>
Full article ">Figure 6
<p>The concept of Bloom filter.</p>
Full article ">Figure 7
<p>Number of datasets comparison between GeoWeb Crawler and existing approaches.</p>
Full article ">Figure 8
<p>An example of searching WMS in GEOSS.</p>
Full article ">Figure 9
<p>Number of OWSs comparison between GeoWeb Crawler and existing approaches.</p>
Full article ">Figure 10
<p>The number of discovered resources in different crawling levels.</p>
Full article ">Figure 11
<p>The resources discovery ratio in different crawling levels.</p>
Full article ">Figure 12
<p>Performance comparison between standalone and parallel processing.</p>
Full article ">Figure 13
<p>GeoHub client interface.</p>
Full article ">Figure 14
<p>An example of a WMS capabilities document.</p>
Full article ">Figure 15
<p>An example of a GeoHub search result.</p>
Full article ">
5602 KiB  
Article
Discovering Land Cover Web Map Services from the Deep Web with JavaScript Invocation Rules
by Dongyang Hou, Jun Chen and Hao Wu
ISPRS Int. J. Geo-Inf. 2016, 5(7), 105; https://doi.org/10.3390/ijgi5070105 - 30 Jun 2016
Cited by 10 | Viewed by 8022
Abstract
Automatic discovery of isolated land cover web map services (LCWMSs) can potentially help in sharing land cover data. Currently, various search engine-based and crawler-based approaches have been developed for finding services dispersed throughout the surface web. In fact, with the prevalence of geospatial [...] Read more.
Automatic discovery of isolated land cover web map services (LCWMSs) can potentially help in sharing land cover data. Currently, various search engine-based and crawler-based approaches have been developed for finding services dispersed throughout the surface web. In fact, with the prevalence of geospatial web applications, a considerable number of LCWMSs are hidden in JavaScript code, which belongs to the deep web. However, discovering LCWMSs from JavaScript code remains an open challenge. This paper aims to solve this challenge by proposing a focused deep web crawler for finding more LCWMSs from deep web JavaScript code and the surface web. First, the names of a group of JavaScript links are abstracted as initial judgements. Through name matching, these judgements are utilized to judge whether or not the fetched webpages contain predefined JavaScript links that may prompt JavaScript code to invoke WMSs. Secondly, some JavaScript invocation functions and URL formats for WMS are summarized as JavaScript invocation rules from prior knowledge of how WMSs are employed and coded in JavaScript. These invocation rules are used to identify the JavaScript code for extracting candidate WMSs through rule matching. The above two operations are incorporated into a traditional focused crawling strategy situated between the tasks of fetching webpages and parsing webpages. Thirdly, LCWMSs are selected by matching services with a set of land cover keywords. Moreover, a search engine for LCWMSs is implemented that uses the focused deep web crawler to retrieve and integrate the LCWMSs it discovers. In the first experiment, eight online geospatial web applications serve as seed URLs (Uniform Resource Locators) and crawling scopes; the proposed crawler addresses only the JavaScript code in these eight applications. All 32 available WMSs hidden in JavaScript code were found using the proposed crawler, while not one WMS was discovered through the focused crawler-based approach. This result shows that the proposed crawler has the ability to discover WMSs hidden in JavaScript code. The second experiment uses 4842 seed URLs updated daily. The crawler found a total of 17,874 available WMSs, of which 11,901 were LCWMSs. Our approach discovered a greater number of services than those found using previous approaches. It indicates that the proposed crawler has a large advantage in discovering LCWMSs from the surface web and from JavaScript code. Furthermore, a simple case study demonstrates that the designed LCWMS search engine represents an important step towards realizing land cover information integration for global mapping and monitoring purposes. Full article
(This article belongs to the Special Issue Bridging the Gap between Geospatial Theory and Technology)
Show Figures

Graphical abstract

Graphical abstract
Full article ">Figure 1
<p>The conceptual framework for discovering LCWMSs.</p>
Full article ">Figure 2
<p>A regular expression representing the first rule.</p>
Full article ">Figure 3
<p>A regular expression of the second rule.</p>
Full article ">Figure 4
<p>Instructions of the two JavaScript invocation rules.</p>
Full article ">Figure 5
<p>Pseudocode of the use of the JavaScript invocation rules.</p>
Full article ">Figure 6
<p>The framework of the focused deep web crawler for active discovery of LCWMSs.</p>
Full article ">Figure 7
<p>The LCWMS-SE architecture showing modules and linkages.</p>
Full article ">Figure 8
<p>The user query interface to display land cover web map services.</p>
Full article ">Figure 9
<p>Spatial distribution and numbers of the discovered LCWMSs.</p>
Full article ">Figure 10
<p>The user interface that displays LCWMSs for the case study.</p>
Full article ">Figure 11
<p>Interface displaying the integration of land cover web map services.</p>
Full article ">
7004 KiB  
Article
Global-Scale Resource Survey and Performance Monitoring of Public OGC Web Map Services
by Zhipeng Gui, Jun Cao, Xiaojing Liu, Xiaoqiang Cheng and Huayi Wu
ISPRS Int. J. Geo-Inf. 2016, 5(6), 88; https://doi.org/10.3390/ijgi5060088 - 8 Jun 2016
Cited by 25 | Viewed by 10429
Abstract
One of the most widely-implemented service standards provided by the Open Geospatial Consortium (OGC) to the user community is the Web Map Service (WMS). WMS is widely employed globally, but there is limited knowledge of the global distribution, adoption status or the service [...] Read more.
One of the most widely-implemented service standards provided by the Open Geospatial Consortium (OGC) to the user community is the Web Map Service (WMS). WMS is widely employed globally, but there is limited knowledge of the global distribution, adoption status or the service quality of these online WMS resources. To fill this void, we investigated global WMSs resources and performed distributed performance monitoring of these services. This paper explicates a distributed monitoring framework that was used to monitor 46,296 WMSs continuously for over one year and a crawling method to discover these WMSs. We analyzed server locations, provider types, themes, the spatiotemporal coverage of map layers and the service versions for 41,703 valid WMSs. Furthermore, we appraised the stability and performance of basic operations for 1210 selected WMSs (i.e., GetCapabilities and GetMap). We discuss the major reasons for request errors and performance issues, as well as the relationship between service response times and the spatiotemporal distribution of client monitoring sites. This paper will help service providers, end users and developers of standards to grasp the status of global WMS resources, as well as to understand the adoption status of OGC standards. The conclusions drawn in this paper can benefit geospatial resource discovery, service performance evaluation and guide service performance improvements. Full article
Show Figures

Figure 1

Figure 1
<p>Data collection and analysis workflow.</p>
Full article ">Figure 2
<p>Search strategies and discovery workflow of web map services.</p>
Full article ">Figure 3
<p>The architecture of the monitoring framework.</p>
Full article ">Figure 4
<p>The geo-locations of monitoring sites.</p>
Full article ">Figure 5
<p>The geo-location of monitored public WMSs.</p>
Full article ">Figure 6
<p>The regional distribution and types of monitored public WMS providers; (<b>a</b>) while most services are in North America and Europe, among the remaining 0.6%, Asia contains 0.23%; (<b>b</b>) providers by sector; government has the largest proportion (37.69%), followed by academic institutions (34.19%), while industry has the smallest proportion (1.78%).</p>
Full article ">Figure 7
<p>Log-log plot of the Cumulative Density Functions (CDF) p(x) for the number of WMSs contributed by each provider according to a discrete power law with <math display="inline"> <semantics> <mrow> <mi mathvariant="sans-serif">α</mi> <mo>=</mo> <mn>1.792</mn> </mrow> </semantics> </math> and <math display="inline"> <semantics> <mrow> <msub> <mi>x</mi> <mrow> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> <mo>=</mo> <mn>1</mn> </mrow> </semantics> </math>.</p>
Full article ">Figure 8
<p>Top English language keywords found in service descriptions for map layers.</p>
Full article ">Figure 9
<p>The spatial coverages of Map Layers.</p>
Full article ">Figure 10
<p>Yearly distribution of map layers and WMSs with current map layers.</p>
Full article ">Figure 11
<p>Successability histograms of the two mandatory operations for valid WMSs: (<b>a</b>) <span class="html-italic">GetCapabilities</span>; (<b>b</b>) <span class="html-italic">GetMap</span>.</p>
Full article ">Figure 12
<p>Log-log plot of the CDFs P(x) for minimum, average and maximum response times of (<b>a</b>) <span class="html-italic">GetCapabilities</span> operations and (<b>b</b>) <span class="html-italic">GetMap</span> operations for selected WMSs reflecting continuous power laws; a Kolmogorov–Smirnov test (<span class="html-italic">p</span> &gt; 0.05) indicated that the original data were likely to be drawn from the fitted power-law distribution. The plots show a sharp change in the upper boundaries of the response time dropping significantly at about 60 s, especially in the maximum response time, because the maximum timeout was set to 60 s during monitoring.</p>
Full article ">Figure 13
<p>Unit area histograms for the minimum, average and maximum response times of (<b>a</b>) <span class="html-italic">GetCapabilities</span> operations and (<b>b</b>) <span class="html-italic">GetMap</span> operations for selected WMSs; the vertical red line in each chart divides the WMSs into 80% and 20% proportions, respectively. The density, calculated as <span class="html-italic">frequency</span>/(<span class="html-italic">total_frequency</span>*<span class="html-italic">bin_width</span>), shows the proportions of WMSs for per unit of response time.</p>
Full article ">Figure 14
<p>Correlation between response times and spatial distance from monitoring sites to WMS servers. (<b>a</b>) The 876 valid WMSs and (<b>b</b>) the selected 393 WMSs located in the U.S. whose capabilities documents were less than 1 MB with average response times less than two seconds.</p>
Full article ">Figure 15
<p>Time series characteristics of WMS response times.</p>
Full article ">
1988 KiB  
Article
An Object Model for Integrating Diverse Remote Sensing Satellite Sensors: A Case Study of Union Operation
by Chuli Hu, Jia Li, Nengcheng Chen and Qingfeng Guan
Remote Sens. 2014, 6(1), 677-699; https://doi.org/10.3390/rs6010677 - 7 Jan 2014
Cited by 8 | Viewed by 8463
Abstract
In the Earth Observation sensor web environment, the rapid, accurate, and unified discovery of diverse remote sensing satellite sensors, and their association to yield an integrated solution for a comprehensive response to specific emergency tasks pose considerable challenges. In this study, we propose [...] Read more.
In the Earth Observation sensor web environment, the rapid, accurate, and unified discovery of diverse remote sensing satellite sensors, and their association to yield an integrated solution for a comprehensive response to specific emergency tasks pose considerable challenges. In this study, we propose a remote sensing satellite sensor object model, based on the object-oriented paradigm and the Open Geospatial Consortium Sensor Model Language. The proposed model comprises a set of sensor resource objects. Each object consists of identification, state of resource attribute, and resource method. We implement the proposed attribute state description by applying it to different remote sensors. A real application, involving the observation of floods at the Yangtze River in China, is undertaken. Results indicate that the sensor inquirer can accurately discover qualified satellite sensors in an accurate and unified manner. By implementing the proposed union operation among the retrieved sensors, the inquirer can further determine how the selected sensors can collaboratively complete a specific observation requirement. Therefore, the proposed model provides a reliable foundation for sharing and integrating multiple remote sensing satellite sensors and their observations. Full article
Show Figures

Graphical abstract

Graphical abstract
Full article ">
<p>Conceptual level of the sensor object model (blue font are the corresponding instructions).</p>
Full article ">
<p>Assignment of meta-attribute values for the AQUA_MODIS SRO_rs.</p>
Full article ">
<p>Sample of AQUA_MODIS SRO_rs representation.</p>
Full article ">
<p>The assignment of meta-attribute values for RADARSAT-2_SAR SRO_rs.</p>
Full article ">
<p>The stages of our proposed object model involved in the integration of satellite imagery observation (the marked numbers represent the detailed experimental flows).</p>
Full article ">
<p>Sensor application based on the proposed model.</p>
Full article ">
<p>Useful observation information extracted from the corresponding new RS_rs of SRO_rs.</p>
Full article ">
Back to TopTop