Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
Trace Organic Removal during River Bank Filtration for Two Types of Sediment
Previous Article in Journal
Hypochlorite Generation from a Water Softener Spent Brine
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Support Vector Machine Forecasting Model for Typhoon Flood Inundation Mapping and Early Flood Warning Systems

1
Research Center of Climate Change and Sustainable Development, National Taiwan University, Taipei 10617, Taiwan
2
Department of Bioenvironmental Systems Engineering, National Taiwan University, Taipei 10617, Taiwan
3
Department of Civil Engineering, National Taiwan University, Taipei 10617, Taiwan
4
Hydrotech Research Institute, National Taiwan University, Taipei 10617, Taiwan
5
Center for Weather Climate and Disaster Research, National Taiwan University, Taipei 10617, Taiwan
*
Author to whom correspondence should be addressed.
Water 2018, 10(12), 1734; https://doi.org/10.3390/w10121734
Submission received: 27 October 2018 / Revised: 20 November 2018 / Accepted: 21 November 2018 / Published: 26 November 2018
(This article belongs to the Section Hydraulics and Hydrodynamics)

Abstract

:
Accurate real-time forecasts of inundation depth and extent during typhoon flooding are crucial to disaster emergency response. To manage disaster risk, the development of a flood inundation forecasting model has been recognized as essential. In this paper, a forecasting model by integrating a hydrodynamic model, k-means clustering algorithm and support vector machines (SVM) is proposed. The task of this study is divided into four parts. First, the SOBEK model is used in simulating inundation hydrodynamics. Second, the k-means clustering algorithm classifies flood inundation data and identifies the dominant clusters of flood gauging stations. Third, SVM yields water level forecasts with 1–3 h lead time. Finally, a spatial expansion module produces flood inundation maps, based on forecasted information from flood gauging stations and consideration of flood causative factors. To demonstrate the effectiveness of the proposed forecasting model, we present an application to the Yilan River basin, Taiwan. The forecasting results indicate that the simulated water level forecasts from the point forecasting module are in good agreement with the observed data, and the proposed model yields the accurate flood inundation maps for 1–3 h lead time. These results indicate that the proposed model accurately forecasts not only flood inundation depth but also inundation extent. This flood inundation forecasting model is expected to be useful in providing early flood warning information for disaster emergency response.

1. Introduction

According to records from the past 100 years from the Central Weather Bureau, Taiwan, an average of three typhoons strike Taiwan each year [1]. During typhoons, heavy rainfall and widespread flood inundation typically impact the Island of Taiwan. To illustrate the extremity of these events, the average annual rainfall in Taiwan is around 2500 mm, with more than 78% of the precipitation concentrated in the typhoon season from May to October [2]. The torrential rainfall brought by typhoons frequently causes flood inundation, which leads to the loss of life and property. For disaster mitigation in the form of an early flood warning system, the development of a flood inundation forecasting model has been recognized as a crucial task. A forecasting model can drastically improve the lead time of decision-making and assist the personnel in handling the emergency response [3]. However, the development of flood inundation forecasting models is always a challenge due to the complex nature of flooding processes and the typical lack of detailed hydro-geographical information in a given study area. Due to advances in numerical modeling techniques and computing capabilities, distributed mathematical and numerical models have recently become increasingly attractive solutions for hydrodynamic simulation. Examples of such models include the SOBEK model [4,5,6], FLO-2D [7], ANUGA Hydro [8], 2D zero-inertia inundation model [9] and 2D-DOFM (2D diffusive overland flow model) [10,11,12]. Of these approaches, the SOBEK model is a fully integrated modeling framework for river, estuary, and storm water systems, capable of simulating hydrodynamics of flood inundation phenomena. Doong et al. [13] indicated that the SOBEK model could simulate flood inundation depth during typhoons while taking into account tidal effects. Kuntiyawichai et al. [14] estimated flooding with a process-based hydrological model coupled to a 1D/2D SOBEK model for the estimation of flood retardation and damage mitigation. Verwey et al. [15] presented a conceptualization of the rainfall-runoff process using SOBEK for an urbanized catchment in Singapore. However, the SOBEK model requires various types of hydro-geomorphological information as well as long computation times to model flood inundation depths and extents. This again indicates that accurate flood inundation forecasting is difficult to achieve. Moreover, the uncertainty in physically based models also cause the difficulty of the flood inundation forecasting [16]. To obtain the real-time and accurate flood inundation forecasts, the artificial neural network (ANN), which provides rapid, precise and inexpensive estimates of network structures, is substituted for the physically based models [17].
ANN provides great flexibility in solving nonlinear problems and it has been applied in various aspects of hydrology [18,19,20,21]. Due to its superior ability in modeling nonlinear systems and its computational efficiency, ANN has also been employed for flood inundation forecasting [22,23,24]. ANN models, which include back propagation networks and support vector machines (SVM), etc., perform more efficiently for hydrodynamic forecasting than physically based models [25,26]. Among ANN models, SVM have been particularly effective in flood inundation forecasting modeling. Lin et al. [27] proposed a flood inundation forecasting model using SVM to yield 1–3 h lead time flood inundation maps. Lin et al. [27] defined control points to forecast the flood inundation map in their study. However, the location of a given control point was not the location of a flood gauging station, so the flood inundation data could not be directly obtained. To address this problem, flood inundation depths at flood gauging stations, rather than at control points, were employed as input in constructing the flood inundation forecasting model. Then, the flood causative factors are selected as candidate input in constructing the spatial expansion module. With the spatial expansion module, the flood inundation forecasts are expanded from points to areas and yield the flood inundation maps. The high accuracy and efficiency SVM in this study showed it to be suitable for rapidly producing forecasted flood inundation maps with real-time data and integrating with disaster warning systems.
Determination of the critical flood causative factors is crucial in the creation of useful flood inundation maps [28,29,30,31,32]. Flood causative factors can be commonly divided into topographic, geologic, geographical and location factors. However, typically not all candidate factors are selected as input for the model, since some factors may effectively act as noise. Hong et al. [28] considered eleven flood-related variables as input into the fuzzy WofE-SVM model, namely: lithology, soil cover, elevation, slope angle, aspect, topographic wetness index (TWI), stream power index (SPI), sediment transport index, plan curvature, profile curvature, and distance from river network. Using the ensemble technique of logistic regression and weight of evidence, Tehrany et al. [32] selected 15 flood causative factors as input for evaluating predictive performance in flood susceptibility mapping in China. The flood causative factors were altitude, slope, aspect, geology, distance from river, distance from road, distance from fault, soil type, land use/cover, rainfall, normalized difference vegetation index, SPI, TWI, sediment transport index and curvature. Fourteen factors potentially responsible for flooding were determined and selected as input in a hybrid model by integrating the principal component analysis, logistic regression and frequency distribution analysis to quantify hazard potential and to map flood characteristics [30]. Among these studies, the flood causative factors are determined by using the correlation coefficient analysis. Nine flood causative factors are identified and adopted as input to the proposed model, including elevation, slope, aspect, curvature, plan curvature, profile curvature, TWI, distance to river, and SPI.
In the present study, flood inundation depths are simulated by the SOBEK model, as calibrated and validated by survey data of flood inundation extents and flood water levels. The flood inundation data are grouped into several clusters by a k-means clustering algorithm, in order to identify the dominant clusters for each flood gauging station. Then, rainfall and water level data are determined as input in developing the point forecasting module. Finally, based on rainfall data, point forecasts and flood causative factors, the spatial expansion module is constructed to expand the flood inundation depth from points to areas as flood inundation extents. To demonstrate the effectiveness of the flood inundation forecasting model, we explore an application to the Yilan River basin in Yilan County, Taiwan. Our study is organized as follows. The study area and data collection are described in Section 2. Section 3 presents the development of the flood inundation forecasting model, including hydrodynamic simulation, classification, point forecasting, and spatial expansion steps. The results and performance of the proposed model are presented and discussed in Section 4. The conclusions are summarized in Section 5.

2. Study Area and Hydrological Data

The Yilan River basin is located in northeastern Taiwan. The annual average precipitation and temperature are 2522 mm and 22 °C, respectively. The mainstream length is approximately 17.25 km, while the total watershed area is around 149.06 km2. Several irrigation and drainage systems have been built in the Yilan River basin. The Meifu drainage system, located on the southern side of the Yilan River, is one of the major drainage systems. Typhoons usually hit this region in the summer and fall, from August to October. During typhoons, severe flood inundations may quickly form in low-lying areas between the Meifu drainage system and the Yilan River, causing serious property loss and damage.
The locations of the rainfall, water level and flood gauging stations in the Yilan River basin are shown in Figure 1. The total average hourly rainfall is calculated with Thiessen’s Polygon method. Among the Thiessen area, the maximum area is dominated by Dajiaoxi rainfall station. It indicates that the rainfall at the Dajiaoxi rainfall station is crucial to affect the forecasting result. Table 1 presents hydrological data from ten typhoons, including duration, cumulative maximum within 36 h and flood inundation extents. The eight flood causative factors were calculated from the digital elevation model (DEM) data with a spatial resolution of 40 m × 40 m, consisting of elevation, slope, aspect, curvature, plan curvature, profile curvature, distance to river, SPI and TWI. The SPI and TWI are expressed as A × tan ( B ) and ln(A/tan(B)), respectively, where A is the upstream contributing area (m2) and B is the local slope (degree).

3. Methodology Development

3.1. Hydrodynamic Simulation

For hydrologic and hydraulic analysis, the SOBEK model was adopted for solving the Saint-Vernant equations [4]. The SOBEK model contains three major modules: a rainfall-runoff module (RR), a 1D flow module (1DF) and a 2D overland flow module (OF). The SOBEK model’s finite difference scheme is commonly applied in simulating the unsteady flow velocities, water levels, and inundation extents associated with flooding events, both in rivers and in urban sewer/drainage systems.
Since the study area contains many drainage systems, we divide the basin into rural river areas, urban sewer areas and surface runoff catchments, each of which is simulated by a different analysis module. For rural river areas, the Soil Conservation Service (SCS) curve number is used to analyze the runoff for different rainfall events according to land use. For urban sewer areas, a rational formula is used to calculate the surface runoff discharge. The RR module with rainfall data calculates surface runoff discharge hydrographs.
For the 1D flow module, the continuity equation and the momentum equation are the dominant equations and can be expressed as
A f t + Q x = q l a t
Q t + x [ Q 2 A f ] + g A f h x + g Q | Q | C 2 R A f W f τ w i ρ w = 0
where Q is the discharge (m3/s), g is the acceleration due to gravity (m/s2), t is the time (s), h is the water level (m), R is the hydraulic radius (m), q l a t presents the lateral discharge per unit length (m2/s), A f is the cross sectional flow area (m2), C is the Chezy coefficient, W f is the cross sectional width at the corresponding water level (m2), τ w i is the wind shear stress ( kg m × s 2 ), and ρ w is the water density (kg/m3).
The 2D overland flow module is described by the continuity equation and the momentum equation in the x- and y-directions. The continuity equation and momentum equations are expressed as
h t + ( u d ) x + ( v d ) y = 0
u t + u u x + v u y + g h x + g u | V | c 2 d + a u | u | = 0
v t + u v x + v v y + g h y + g v | V | c 2 d + a v | v | = 0
where d is the water depth (m); u and v are the velocity components (m/s) in the x-direction and y-direction, respectively; V is the velocity magnitude u 2 + v 2 (m/s); c is the Chezy coefficient; and a is the wall friction coefficient.
The flow chart of the linkage of the integrated model is shown in Figure 2. The 1DF module calculates the hydrographs of overflow flow rate at channel cross-sections when the surface runoff exceeds the design capacity of the drainage system. The overflow hydrographs are subsequently used as sources in the OF module. Historical typhoon event records are used in calibrating some parameters: the SCS curve number (CN) and White Colebrook (k). The value of the Chezy coefficient c is obtained from the White-Colebrook formula, expressed as c = 18 10 log ( 12 R k n ) .

3.2. k-means Clustering Algorithm

The k-means clustering algorithm [33] groups data with simulated statistical characteristics. Due to the ease of implementation and efficiency, the k-means algorithm is one of the most commonly used partitional clustering algorithms [34,35], and many studies have confirmed its clustering ability in hydrology [27,36]. Data are grouped into n clusters by their common characteristics. The clusters are recognized by minimizing the average Euclidean distance from individual data points to the cluster center. The k-means clustering algorithm function is written as
E = k = 1 n E k = i = 1 n j = 1 l w j i x j c i 2
where n is the number of clusters, xj is the input vector, ci is the ith cluster center and wji is a l × k data matrix. For more details on the k-means clustering algorithm, refer to [37].
In this study, similar flood inundation data are grouped into the same cluster. Then, clusters of flood inundation data are identified by minimizing their average Euclidean distance to the cluster center. Determination of an optimal number of clusters is crucial for efficiently grouping the flood inundation depths. In order to obtain an optimal number of clusters, the grid-search method [38] is used for determining the optimal number of clusters. Integrating a classification scheme like k-means into an SVM model is expected to reduce the number of the constructed models and increase the forecast accuracy.

3.3. Support Vector Machine

Vapnik [39] developed SVM for classification and later extended the technique for regression analysis. Classifier functions are used for separating different groups of training data to construct hyperplanes in the multidimensional space. In the past two decades, SVM has been widely adopted in rainfall-runoff [40,41], flood [27,42,43,44] and peak-flood analyses [45]. For further details on SVM, refer to [39,46].
A SVM model is a given training set N d [ ( x 1 , y 1 ) , ( x 2 , y 2 ) , , ( x N d , y N d ) ] , with input vector xi and output data yi. The objective of the SVM is to find a nonlinear regression function y ^ = f ( x ) = w T ϕ ( x ) + b and produce the output y ^ , which is the optimal approximate of the observed data with an error tolerance of ε , where ϕ ( x ) is a nonlinear function, w is weight, and b is the bias of the regression function, respectively. According to the structural risk minimization (SRM) induction principle, w and b are calculated by minimizing the structural risk function:
R = 1 2 w 2 + C i = 1 N d L ε ( y ^ )
where Vapnik’s ε-insensitive loss function is defined as
L ε ( y ^ ) = | y f ( x ) | ε = { 0 if | y f ( x ) | < ε | y f ( x ) | ε if | y f ( x ) | ε
The first term in Equation (2) represents model complexity; the second term represents empirical error. The penalty parameter Cp represents the tradeoff between model complexity and empirical error.
The SVM problem can be formulated as the following optimization problem:
min R ( w , b , ξ , ξ ) = 1 2 W 2 + C P i = 1 N d ( ξ i + ξ i ) subject   to y i y ^ i = y i ( w T ϕ ( x i ) + b ) ε + ξ i y ^ i y i = ( w T ϕ ( x i ) + b ) y i ε + ξ i ξ i 0 , i = 1 , 2 , , N d ξ i 0 , i = 1 , 2 , , N d
where ξ and ξ’ are slack variables representing, respectively, the upper and lower training errors subject to error tolerance ε. The dual Lagrange multipliers, a and a , can be applied to solve the above optimization problem. Consequently, the approximate function can be expressed as follows:
f ( x ) = i = 1 m ( a i a i ) K ( x i , x ) + b
where m is the number of support vectors, xi is the support vector, and K(xi,x) is a kernel function, used for mapping the SVM input vector into a higher-dimensional feature space. The radial basis function (RBF) is used herein and expressed as follows:
K ( x i , x j ) = ( γ x i x j ) , γ > 0
where γ is the gamma term. The correct determination of parameters significantly increases the accuracy of SVM solutions. The penalty parameter Cp and the error tolerance ε are also crucial SVM parameters. In this study, the grid-search method is employed for determining the optimal combination of the kernel function, γ, Cp and ε. In this study, the SVM is applied to develop the point forecasting module to forecast the flood inundation depth for each flood gauging station. Then, the SVM is used to develop the spatial expansion module to expand the flood inundation depth from points to areas for each cluster.

3.4. Methodology Construction

To yield flood inundation maps in a time series, a flood inundation forecasting model is developed in this study. Figure 3 shows a flowchart of the flood inundation forecasting model, which consists of four steps: hydrodynamic simulation, classification of flood inundation data, point forecasting for flood inundation depth and spatial expansion for flood inundation extent. Details of these four steps are described below.

3.4.1. Hydrodynamic simulation step

Flood inundation in the Yilan River basin is simulated using the SOBEK model. The river reach, cross section points of rivers and cross-sectional shapes of rivers are collected as input, along with properties of sewers and hydraulic structures. Moreover, ArcGIS applies the rainfall runoff (RR) module to divide the river and drainage basin and calculate the average rainfall with DEM characteristics. The Manning formula is used to calculate channel roughness along rivers and sewer systems. The White–Colebrook formula is used to calculate subcatchment surface roughness. In general, the higher the DEM spatial resolution, the higher the flooding simulation accuracy. However, increasing the resolution of the DEM is not necessary to improve the accuracy of flooding simulation such as flood inundation depth or extent, especially in the lowland areas. As shown in Figure 4, elevation at lowland areas of the Yilan River basin near the downstream boundary is less than 2 m. According to some test simulations with different spatial resolutions of DEM, it was found that using a spatial resolution of 40 m × 40 m DEM can obtain almost the same simulated results by 20 m × 20 m DEM for the flood inundation map in this study area. Therefore, the spatial resolution of 40 m × 40 m DEM is sufficiently accurate for flood inundation simulation in the study area, which can also result better computational efficiency, e.g., less CPU time.
According to the typhoon warning information delivered from the Central Weather Bureau (CWB), Taiwan, the sequential 36 h rainfall data with most intensive rainfall is used for model calibration and forecasting. Moreover, obtaining from the CWB, the historical temporal datasets for model inputs are hourly-based hydrological data for each typhoon event, including rainfall intensity, tidal sea-level variations, etc. Then, to establish a stable and reasonable hydrodynamic initial condition, the warm-up period is needed. The warm-up time for the initial condition is 1 h at which we impose the same values of initial water depth and tidal water elevation at t = 0. Given the above information, the SOBEK model can be successfully applied to simulate the hydrodynamic characteristics of flood inundation.

3.4.2. Classification Step

For model efficiency, the k-means clustering algorithm is applied in grouping the flood inundation data into several clusters. First, flood inundation and non-inundation extents have to be identified. In this study, an extent with a flood inundation depth above 0.3 m is regarded as a flood inundation extent. The dominant clusters of flood gauging stations are then identified by minimizing the average Euclidean distance from the flood inundation data to the center of the cluster.

3.4.3. Point Forecasting Step

The point forecasting module for each flood gauging station is constructed in this step. Observed rainfall and water level are used as input for the point forecasting module. The point forecasting module can be written in a general form as
H c ( t + Δ t ) = SVM [ R ( t ) , R ( t 1 ) , , R ( t n ) , H c ( t ) , H c ( t 1 ) , , H c ( t m ) ]
where t is the current time, Δ t is the lead time period (from 1–3 h), R is the rainfall, H c is the water level at a given flood gauging stations and H c ( t + Δ t ) is the point forecasted water level at time t + Δ t .
The determination of the inputs and of appropriate lag lengths is crucial to the effectiveness of the proposed point forecasting module. Rainfall and water level are selected as input, while the lag lengths of input are determined by the grid search method.

3.4.4. Spatial Expansion Step

In this step, the spatial expansion module is developed to expand the forecasts from points to areas. First, the forecast of each flood gauging station is transformed to a flood inundation depth. Then, SVM is applied to expand the flood inundation depth from points to areas for each cluster. Inputs for developing the spatial expansion module include the forecasted flood inundation depths of flood gauging stations with grid coordinates, rainfall and nine flood causative factors. The spatial expansion module can be written as follows:
D n ( t + Δ t ) = SVM [ R ( t ) , D c ( t + Δ t ) , I n ]
where R is the rainfall, D c is the flood inundation depth of a given flood gauge station, I n is a given flood causative factor, and D n ( t + Δ t ) is the forecasted flood inundation depth of grid n at time t + Δ t .

3.5. Model Evaluation and Cross Validation

To evaluate model performance, six measures of error are employed to indicate the discrepancy between the observed and forecasted values: root mean square error (RMSE), mean absolute error (MAE), error of time to peak water level (ETp), error of peak water level (EWp), capture rate (CR) and coefficient of efficiency (CE). Smaller RMSE, MAE, ETp and EWp values indicate less significant errors between the observed and forecasted values, whereas higher CR value means better agreement of flood inundation extents between observed and forecasted values. The CE value is used to evaluate forecasting ability, with a CE value close to 1 representing high performance. In particular, RMSE and CE are selected as performance measures for the point forecasting module.
For the construction of the proposed model, the collected event-based data are usually separated into two sets: training and testing data. Training data are adopted to develop the proposed model, whereas testing data are used to evaluate the performance of the proposed model. Different selections of training and testing data do impact results, sometimes even leading to different conclusions. To evaluate the accuracy and robustness of the proposed model, a statistical technique called cross validation [47] is applied in this study. Cross validation is described in detail as follows. Each single typhoon event is chosen as the testing set in turn, while the remaining events are used as the training sets. Thus, for N typhoons, each of the events is used to test the performance of the proposed model, and the test results and their performance measures are obtained. Then, performance conclusions for the proposed model are drawn on the basis of the averaged performance measures over all testing events.

4. Results and Discussion

4.1. Calibration and Validation of SOBEK

The observed flood inundation depths of the six water level stations on the Yilan River and Meifu drainage system are adopted in this study to calibrate and validate the SOBEK model. However, the selection of the parameter values of CN, n and k impacts the modeled values for flood inundation extent, depth and velocity. To determine the optimal parameter values for CN, n and k, these parameters are respectively varied from 39 to 98, from 0.015 to 0.035 and from 0.2 to 10. The determined optimal parameter values are similar to previous studies [6,48], which selected the same study area.
The performance of the SOBEK model at each water level station is shown in Table 2. As demonstrated in Figure 5, water level stations located downstream (i.e., Gamalan, Sijie, Dongjin and Zhuangwei) show good agreement between observed and simulated water levels. However, the ETp and RMSE values at upstream water level stations (i.e., Yixing and Ximen) are worse than those at downstream water level stations. ETp values below 2 h are acceptable, as are EWp values below 10%. Meanwhile, CE values above 0.7 are acceptable [49]. Though the EWp value at Dongjin is greater than 10%, the difference between observed and simulated peak water levels is only 0.5 m; therefore, we accept the errors of the simulated water levels as reasonable. Moreover, the simulated and observed flood inundation extents are in a good agreement (see Figure 6). The CR value of 78% indicates that the SOBEK model can accurately simulate the flood inundation extents. We accept the SOBEK model as an accurate and efficient way to simulate flood inundation in the Yilan River basin.

4.2. Identification of Clusters

In this subsection, the flood inundation depth within each cluster identified by the classification module is analyzed. The k-means clustering algorithm is applied to obtain the relative information of the flood inundation data in each grid. In this study, the optimal number of clusters is 10, determined by the grid-search method. The dominated clusters of flood gauging stations are listed in Table 3.
Figure 7 shows the results of the k-means clustering algorithm and the location of each flood gauging station. The main flood inundation extents are located between the Yilan River and Meifu drainage system, especially at low elevations (shown in Figure 4 and Figure 7). Clusters 7–10, which contain areas located adjacent to the river show a distinct of flood inundation depth dynamic: peak flood inundation depths in Clusters 7–10 are above 1 m, while peak flood inundation depths in Clusters 1–6 are below 0.8 m. As shown in Figure 8, flood inundation depths are implicitly clustered according to their respective time series, including peak flood inundation depth and amplitude of flood inundation.
A narrower focus on the comparison between Clusters 7, 9 and 10, reveals that the flood inundation depth patterns are similar, with the highest peak in Cluster 10, followed by Cluster 9 and Cluster 7. The timing order of flood inundation is Cluster 10 first, then Cluster 9, and finally Cluster 7. These phenomena are consequences of the geographic distance from the river to each cluster’s geographic areas. For the same reason, Clusters 1 and 5 show similar dynamics, as do Clusters 2 and 4. We conclude that the k-means clustering algorithm effectively captures the spatiotemporal distribution of flood inundation depths.

4.3. Performance of the Point Forecasting Module

Observed rainfall and water level are the inputs for point forecasting. Based on the grid search method, the lag lengths for rainfall and water level are both determined to be 1, representing 1 h lead time. Current rainfall and water level are both determined as input for 2 to 3 h lead time.
Figure 9 presents the point forecasting results for each flood gauging station for 1–3 h lead time. Most of the water level forecasts from the point forecasting module are in good agreement with the observed data. However, the peak flood inundation depths at ISR2, KXL1, ISR3 and GJL1 are underforecasted for Typhoons Nonmadol and Sinlaku, especially for 2 to 3 h lead time. We therefore employed RMSE and CE to clearly and objectively compare the discrepancies between observed and forecasted water levels. As shown in Table 4, with increasing forecast lead time the RMSE values increase (i.e., worsen) and the CE values decrease (i.e., worsen).
A comparison of Table 3 and Table 4 clearly shows that with decreasing water level amplitude, RMSE values decrease (i.e., improve) while CE values increase (i.e., improve), with the exception of GJL1. The dynamics at GJL1 could be caused by the water level pattern as well as underforecasting. The water level pattern at GJL1 is fluctuant like ISR2, KXL1 and ISR3, and notably the peak flood inundation depths are underforecast at all these locations. Moreover, the RMSE and CE values at ISR2 increase from 0.19 m to 0.55 m and decrease from 0.9 to 0.26, respectively. The proposed model is relatively low performance at ISR2 and the RMSE value increases 65% from 1–3 h ahead time. Despite this, the performance deterioration for the proposed model is slower than that obtained by Lin et al. [27] (69%). Based on the aforementioned results, we conclude that the proposed point forecasting module yields sufficiently high forecast accuracy for most gauging stations.

4.4. Performance of the Spatial Expansion Module

The performance measures for the proposed spatial expansion module are presented in Table 5. With increasing forecast lead time, RMSE and MAE values increase (i.e., worsen). As the forecast lead time increases, the more noises are included between inputs and target output and hence the more errors in the forecasts.
RMSE and MAE values across clusters are also apparently influenced by maximum flood inundation depth. As shown in Figure 8, RMSE and MAE values increase with increasing number of clusters (i.e., with increasing the maximum flood inundation depth). As can be seen in Table 5, maximum flood inundation depths in Clusters 1–5 remain below 0.56 m, and in these same clusters RMSE values remain below 0.16 m, and MAE values remain below 0.11 m.
In addition, the more accurately the model forecasts the water level of the cluster’s flood gauging station, the more accurately it forecasts the cluster’s flood inundation depths. Due to excellent model performance at ISR7, Cluster 10′s RMSE and MAE values are lower than 0.16 m and 0.11 m, respectively. In contrast, due to relatively poor model performance at ISR2 and KXL1, the spatial expansion module in Clusters 6–9 performs worse. Despite this, most of the results confirm that the proposed spatial expansion module effectively forecasts flood inundation depths.
To highlight the forecasting performance of the proposed spatial expansion module, the recent Typhoon Dujuan (2015) is taken as an example. Figure 10 presents the flood inundation data versus corresponding forecasts for flood inundation depth at 1–3 h lead time for Typhoon Dujuan. The forecasted flood inundation depths are generally in good agreement with the flood inundation data. As above, with increasing forecast lead time, the difference between observed values and forecasted values increases. Figure 11 shows MAE performance across the flood inundation map at 1–3 h lead time for Typhoon Dujuan. High performance is indicated by MAE values between 0 and 0.1 m; at 1–3 h lead time we observe high performance covering 85.2%, 84.2% and 83.4% of the map area, respectively. Meanwhile, MAE values exceeding 0.5 m rarely occur. Compared to Chang et al. [18], the proposed model obtains higher percentage of MAE values between 0 and 0.1 m. It indicates that the proposed model yields the accurate flood inundation map.
The aforementioned results indicate that the proposed model accurately forecasts not only flood inundation depth, but also areal flooding extent. The proposed spatial expansion module accurately and reliably produces flood inundation forecast maps, providing information to help disaster mitigation and reduce loss of life and property.

5. Conclusions

Accurate forecasts for flood inundation depth and extent play a crucial role in flood early warning systems. For this purpose, an accurate and efficient forecasting model is proposed for producing flood inundation forecast maps.
Based on various measures of error, we find that the SOBEK model accurately simulates flood inundation depths. Flood inundation depth at most locations shows model errors less than 0.1 m, making the proposed flood inundation forecasting model suitable for flood inundation forecasts in typhoon.
The point forecasting module accurately forecasts water level for 1–3 h lead time for most flood gauging stations. Finally, based on the strong performance of the spatial expansion module, we conclude that the proposed model can provide acceptable flood inundation forecast maps for 1–3 h lead time. The accurate forecast maps of inundation depth and extent are expected to be useful for flood early warning systems. They also can be helpful for decision makers in handling disaster emergency response, reducing human casualties and property damage.
Due to some error of simulated flood inundation depths resulted from hydrodynamic modeling, it may cause poor performance in the flood inundation forecasting model. In the future, the proposed forecasting model can use real-time monitoring data and hence produce more accurate flood inundation forecast maps. Meanwhile, novel clustering algorithms and ANNs probably may improve the model performance.

Author Contributions

M.-J.C. developed the ANN model and took the lead in writing the manuscript; H.-K.C. and Y.-C.C. performed the hydrodynamic simulation and analyzed the data; P.-A.C. contributed to the analysis of the results and to the writing of the manuscript; G.-F.L. supervised the research work; J.-S.L. and Y.-C.T. provided guidance and suggestion to the manuscript.

Funding

This paper is based on work partially funded by Ministry of Science and Technology, Taiwan, under Grants MOST 107-2119-M-002-019 and MOST 107-2628-M-002-016.

Acknowledgments

The authors gratefully acknowledge the support by providing data from the Central Weather Bureau and the Water Resources Agency, Taiwan. The authors also thank the Hydrotech Research Institute of National Taiwan University for using facilities and technique support. Finally, we would like to thank the editors and reviewers for their constructive suggestions that greatly improved the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wu, C.C.; Kuo, Y.H. Typhoons affecting Taiwan: Current understanding and future challenges. Bull. Am. Meteorol. Soc. 1999, 80, 67–80. [Google Scholar] [CrossRef]
  2. WRA (Water Resources Agency). Hydrological year book of Taiwan, Republic of China, 2016; Part I-Rainfall, Taipei, Taiwan; Water Resources Agency, Ministry of Economic Affairs: Taipei, Taiwan, 2015; pp. 5–7.
  3. Carsell, K.M.; Pingel, N.D.; Ford, D.T. Quantifying the benefit of a flood warning system. Nat. Hazards Rev. 2004, 5, 131–140. [Google Scholar] [CrossRef]
  4. Delft Hydraulics. SOBEK Software User’s Manual; WL|Delft Hydraulics: Delft, The Netherlands, 2013. [Google Scholar]
  5. Prinsen, G.F.; Becker, B.P.J. Application of SOBEK hydraulic surface water models in the Netherlands Hydrological Modelling Instrument. Irrig. Drain. 2011, 60, 35–41. [Google Scholar] [CrossRef]
  6. Yang, S.N.; Chan, M.H.; Chang, C.H.; Chang, L.F. The damage assessment of flood risk transfer effect on surrounding areas arising from the land development in Tainan, Taiwan. Water 2018, 10, 473. [Google Scholar] [CrossRef]
  7. Risi, R.D.; Paola, F.D.; Turpie, J.; Kroeger, T. Life cycle cost and return on investment as complementary decision variables for urban flood risk management in developing countries. Int. J. Disaster Risk Reduction. 2018, 28, 88–106. [Google Scholar] [CrossRef]
  8. Rigby, E.; Van Drie, R. ANUGA: A new free and open source hydrodynamic model. In Proceedings of Water Down Under 2008; Engineers Australia: Modbury, Australia, 2008. [Google Scholar]
  9. Lai, J.S.; Chang, H.K. Inundation Scenario Simulation due to Levee Breach and Overbank Flow in the Keelung River (II); Ministry of Science and Technology: Taipei, Taiwan, 2001.
  10. Chang, H.K.; Lin, Y.J.; Lai, J.S. Methodology to set trigger levels in an urban drainage flood warning system—An application to Jhonghe, Taiwan. Hydrol. Sci. J. 2017, 63, 31–49. [Google Scholar] [CrossRef]
  11. Chang, H.K.; Tan, Y.C.; Lai, J.S.; Pan, T.Y.; Liu, T.M.; Tung, C.P. Improvement of a drainage system for flood management with assessment of the potential effects of climate change. Hydrol. Sci. J. 2013, 58, 1581–1597. [Google Scholar] [CrossRef] [Green Version]
  12. Chang, T.J.; Wang, C.H.; Chen, A.S. A novel approach to model dynamic flow interactions between storm sewer system and overland surface for different land covers in urban areas. J. Hydrol. 2015, 524, 662–679. [Google Scholar] [CrossRef] [Green Version]
  13. Doong, D.J.; Lo, W.; Vojinovic, Z.; Lee, W.L.; Lee, S.P. Development of a new generation of flood inundation maps—A case study of the coastal city of Tainan, Taiwan. Water 2016, 8, 521. [Google Scholar] [CrossRef]
  14. Kuntiyawichai, K.; Schultz, B.; Uhlenbrook, S.; Suryadi, F.X.; Van Griensven, A. Comparison of flood management options for the Yang River Basin, Thailand. Irrig. Drain. 2011, 60, 526–543. [Google Scholar] [CrossRef]
  15. Verwey, A.; Muttil, N.; Liong, S.Y.; He, S. Implementing an urban rainfall-runoff concept in SOBEK for a catchment in Singapore. In Proceedings of Water Down Under; Engineers Australia: Modbury, Australia, 2008; p. 36. [Google Scholar]
  16. Dimitriadis, P.; Tegos, A.; Oikonomou, A.; Pagana, V.; Koukouvinos, A.; Mamassis, N.; Koutsoyiannis, D.; Efstratiadis, A. Comparative evaluation of 1D and quasi-2D hydraulic models based on benchmark and real-world applications for uncertainty assessment in flood mapping. J. Hydrol. 2016, 534, 478–492. [Google Scholar] [CrossRef]
  17. Liu, W.C.; Chung, C.E. Enhancing the predicting accuracy of the water stage using a physical-based model and an artificial neural network-genetic algorithm in a river system. Water 2014, 6, 1642–1661. [Google Scholar] [CrossRef]
  18. Chang, L.C.; Shen, H.Y.; Chang, F.J. Regional flood inundation nowcast using hybrid SOM and dynamic neural networks. J. Hydrol. 2014, 519, 476–489. [Google Scholar] [CrossRef]
  19. Cheng, C.T.; Feng, Z.K.; Niu, W.J.; Liao, S.L. Heuristic methods for reservoir monthly inflow forecasting: A case study of Xinfeng-jiang Reservoir in Pearl River, China. Water 2015, 7, 4477–4495. [Google Scholar] [CrossRef]
  20. Pan, T.Y.; Lai, J.S.; Chang, T.J.; Chang, H.K.; Chang, K.C.; Tan, Y.C. Hybrid neural networks in rainfall-inundation forecasting based on a synthetic potential inundation database. Nat. Hazard Earth Syst. 2011, 11, 771. [Google Scholar] [CrossRef]
  21. Wu, M.C.; Lin, G.F. An hourly streamflow forecasting model coupled with an enforced learning strategy. Water 2015, 7, 5876–5895. [Google Scholar] [CrossRef]
  22. Chang, L.C.; Amin, M.; Yang, S.N.; Chang, F.J. Building ANN-based regional multi-step-ahead flood inundation forecast models. Water 2018, 10, 1283. [Google Scholar] [CrossRef]
  23. Chang, L.C.; Shen, H.Y.; Wang, Y.F.; Huang, J.Y.; Lin, Y.T. Clustering-based hybrid inundation model for forecasting flood inundation depths. J. Hydrol. 2010, 385, 257–268. [Google Scholar] [CrossRef]
  24. Jhong, Y.D.; Chen, C.S.; Lin, H.P.; Chen, S.T. Physical hybrid neural network model to forecast typhoon floods. Water 2018, 10, 632. [Google Scholar] [CrossRef]
  25. Chen, W.B.; Liu, W.C.; Hsu, M.H. Comparison of ANN approach with 2D and 3D hydrodynamic models for simulating estuary water stage. Adv. Eng. Softw. 2012, 45, 69–79. [Google Scholar] [CrossRef]
  26. Ahooghalandari, M.; Khiadani, M.; Kothapalli, G. Assessment of artificial neural networks and IHACRES models for simulating streamflow in Marillana catchment in the Pilbara, Western Australia. Australas. J. Water Resour. 2005, 19, 116–126. [Google Scholar] [CrossRef]
  27. Lin, G.F.; Lin, H.Y.; Chou, Y.C. Development of a real-time regional-inundation forecasting model for the inundation warning system. J. Hydroinform. 2013, 15, 1391–1407. [Google Scholar] [CrossRef]
  28. Hong, H.; Tsangaratos, P.; Ilia, I.; Liu, J.; Zhu, A.X.; Chen, W. Application of fuzzy weight of evidence and data mining techniques in construction of flood susceptibility map of Poyang County, China. Sci. Total Environ. 2018, 625, 575–588. [Google Scholar] [CrossRef] [PubMed]
  29. Lai, C.; Shao, Q.; Chen, X.; Wang, Z.; Zhou, X.; Yang, B.; Zhang, L. Flood risk zoning using a rule mining based on ant colony algorithm. J. Hydrol. 2016, 542, 268–280. [Google Scholar] [CrossRef]
  30. Nandi, A.; Mandal, A.; Wilson, M.; Smith, D. Flood hazard mapping in Jamaica using principal component analysis and logistic regression. Environ. Earth Sci. 2016, 75, 465. [Google Scholar] [CrossRef]
  31. Tehrany, M.S.; Pradhan, B.; Mansor, S.; Ahmad, N. Flood susceptibility assessment using GIS-based support vector machine model with different kernel types. Catena 2015, 125, 91–101. [Google Scholar] [CrossRef]
  32. Tehrany, M.S.; Shabani, F.; Neamah Jebur, M.; Hong, H.; Chen, W.; Xie, X. GIS-based spatial prediction of flood prone areas using standalone frequency ratio, logistic regression, weight of evidence and their ensemble techniques. Geomatics Nat. Hazards Risk 2017, 8, 1538–1561. [Google Scholar] [CrossRef] [Green Version]
  33. MacQueen, J.B. Some methods for classification and analysis of multivariate observations. In 5-th Berkeley Symposium on Mathematical Statistics and Probability; University of California Press: Berkeley, CA, USA, 1967; pp. 281–297. [Google Scholar]
  34. Liu, C.L.; Hsaio, W.H.; Chang, T.H. Locality Sensitive K-means Clustering. J. Inf. Sci. Eng. 2018, 34, 289–305. [Google Scholar]
  35. Neshatpour, K.; Malik, M.; Sasan, A.; Rafatirad, S.; Mohsenin, T.; Ghasemzadeh, H.; Homayoun, H. Energy-efficient acceleration of map reduce applications using FPGAs. J. Parallel Distrib. Comput. 2018, 119, 1–17. [Google Scholar] [CrossRef]
  36. Wei, W.; Chen, L.; Fu, B.; Huang, Z.; Wu, D.; Gui, L. The effect of land uses and rainfall regimes on runoff and soil erosion in the semi-arid loess hilly area, China. J. Hydrol. 2007, 335, 247–258. [Google Scholar] [CrossRef] [Green Version]
  37. Johnson, R.A.; Wichern, D.W. Applied Multivariate Statistical Analysis, 5th ed.; Prentice Hall: Upper Saddle River, NJ, USA, 2002. [Google Scholar]
  38. Brad, J.F. An efficient point algorithm for a linear two-stage optimization problem. Oper. Res. 1983, 31, 670–684. [Google Scholar] [CrossRef]
  39. Vapnik, V. The Nature of Statistical Learning Theory; Springer science and business media: New York, NY, USA, 1995. [Google Scholar]
  40. Chua, L.H.C.; Wong, T.S.W. Runoff forecasting for an asphalt plane by artificial neural networks and comparisons with kinematic wave and autoregressive moving average models. J. Hydrol. 2011, 397, 191–201. [Google Scholar] [CrossRef]
  41. Lin, G.F.; Chen, L.H. A non-linear rainfall–runoff model using radial basis function network. J. Hydrol. 2004, 289, 1–8. [Google Scholar] [CrossRef]
  42. Adnan, R.; Ruslan, F.A.; Samad, A.M.; Zain, Z.M. New artificial neural network and extended kalman filter hybrid model of flood prediction system. In Proceedings of the 2013 IEEE 9th International Colloquium on Signal Processing and its Applications, Kuala Lumpur, Malaysia, 8–10 March 2013; pp. 252–257. [Google Scholar]
  43. Chang, L.C.; Chang, F.J.; Wang, Y.P. Auto-configuring radial basis function networks for chaotic time series and flood forecasting. Hydrol. Process. 2009, 23, 2450–2459. [Google Scholar] [CrossRef]
  44. Chen, C.S.; Chen, B.P.T.; Chou, F.N.F.; Yang, C.C. Development and application of a decision group Back-Propagation Neural Network for flood forecasting. J. Hydrol. 2010, 385, 173–182. [Google Scholar] [CrossRef]
  45. Chidthong, Y.; Tanaka, H.; Supharatid, S. Developing a hybrid multi-model for peak flood forecasting. Hydrol. Process. 2009, 23, 1725–1738. [Google Scholar] [CrossRef]
  46. Cristianini, N.; Shaw-Taylor, J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods; Cambridge University Press: New York, NY, USA, 2000. [Google Scholar]
  47. Geisser, S. Predictive Inference; Chapman and Hall: New York, NY, USA, 1993. [Google Scholar]
  48. Dahm, R.; Hsu, C.T.; Lien, H.C.; Chang, C.H.; Prinsen, G. Next Generation Flood Modelling using 3Di: A Case Study in Taiwan. In Proceedings of the DSD International Conference, Hong Kong, China, 12–14 November 2014. [Google Scholar]
  49. Liu, W.C. Monitoring and Applications in the Yilan and Dianbo River Experimental Watersheds; Water Resources Planning Institute: Taichung, Taiwan, 2015.
Figure 1. The Yilan River basin and the locations of rainfall, water level and flood gauging stations.
Figure 1. The Yilan River basin and the locations of rainfall, water level and flood gauging stations.
Water 10 01734 g001
Figure 2. Flowchart of the SOBEK model.
Figure 2. Flowchart of the SOBEK model.
Water 10 01734 g002
Figure 3. Flowchart of the proposed model.
Figure 3. Flowchart of the proposed model.
Water 10 01734 g003
Figure 4. High-resolution elevation map of the Yilan River basin.
Figure 4. High-resolution elevation map of the Yilan River basin.
Water 10 01734 g004
Figure 5. Comparison of observed water levels with simulated ones by SOBEK model for Typhoon Dujuan (from 27 September 2015 9:00 am to 28 September 2015 9:00 am) at (a) Gamalan, (b) Sijie, (c) Dongjin, (d) Zhuangwei, (e) Yixing, and (f) Ximen.
Figure 5. Comparison of observed water levels with simulated ones by SOBEK model for Typhoon Dujuan (from 27 September 2015 9:00 am to 28 September 2015 9:00 am) at (a) Gamalan, (b) Sijie, (c) Dongjin, (d) Zhuangwei, (e) Yixing, and (f) Ximen.
Water 10 01734 g005
Figure 6. Comparison of simulated and observed flood inundation extents.
Figure 6. Comparison of simulated and observed flood inundation extents.
Water 10 01734 g006
Figure 7. Data clustering results from the k-means clustering algorithm, along with locations of flood gauging stations.
Figure 7. Data clustering results from the k-means clustering algorithm, along with locations of flood gauging stations.
Water 10 01734 g007
Figure 8. Average flood inundation depth of each cluster over time.
Figure 8. Average flood inundation depth of each cluster over time.
Water 10 01734 g008
Figure 9. Comparison of observed and forecasted water levels for 1–3 h lead time at (a) ISR2, (b) KXL1, (c) ISR3, (d) ISR7, (e) GJL1, and (f) ISR5.
Figure 9. Comparison of observed and forecasted water levels for 1–3 h lead time at (a) ISR2, (b) KXL1, (c) ISR3, (d) ISR7, (e) GJL1, and (f) ISR5.
Water 10 01734 g009
Figure 10. Comparison of flood inundation data with forecasts obtained from the proposed model for Typhoon Dujuan.
Figure 10. Comparison of flood inundation data with forecasts obtained from the proposed model for Typhoon Dujuan.
Water 10 01734 g010
Figure 11. Distribution of MAE value with respect to the proposed model during Typhoon Dujuan.
Figure 11. Distribution of MAE value with respect to the proposed model during Typhoon Dujuan.
Water 10 01734 g011
Table 1. Hydrological and inundation data for typhoons from 2004 to 2015.
Table 1. Hydrological and inundation data for typhoons from 2004 to 2015.
EventDate
(yyyy/mm/dd)
Duration (h)Cumulative Maximum
within 36 h Rainfall (mm)
Inundation Extent (km2)
Aere2004/08/2380350.40.82
Nanmadol2004/12/0335300.41.36
Sepat2007/08/1677186.61.75
Sinlaku2008/09/11125454.17.33
Jangmi2008/09/2771185.60.10
Parma2009/10/0383305.65.51
Megi2010/10/2168416.06.35
Saola2012/07/3089379.85.22
Soudelor2015/08/0680214.90.87
Dujuan2015/09/2756179.90.54
Table 2. ETp, EWp, CE and RMSE values for the water level: simulated results by SOBEK model.
Table 2. ETp, EWp, CE and RMSE values for the water level: simulated results by SOBEK model.
Water Level StationETp (h)EWp (%)CERMSE (m)
Gamalan00.340.980.09
Sijie04.920.970.16
Dongjin010.180.950.18
Zhuangwei08.160.960.30
Yixing25.070.900.76
Ximen25.100.741.09
Table 3. Hydrologic descriptions and dominant clusters for flood gauging stations.
Table 3. Hydrologic descriptions and dominant clusters for flood gauging stations.
Flood Gauging StationMaximum Water Level (m)Minimum Water Level (m)Range of Water Levels (m)Dominant Cluster
ISR25.182.372.813
KXL12.730.222.516
ISR36.574.332.241, 5
ISR71.810.071.7410
GJL11.770.131.647, 8, 9
Table 4. RMSE and CE values for the point forecasting module for 1–3 h lead time forecasting.
Table 4. RMSE and CE values for the point forecasting module for 1–3 h lead time forecasting.
Lead Time (h)ISR2KXL1ISR3ISR7GJL1ISR5
RMSE (m)
t + 10.190.120.090.030.070.01
t + 20.410.260.190.070.170.02
t + 30.550.360.270.100.240.02
CE
t + 10.900.920.930.980.970.99
t + 20.570.690.670.910.810.94
t + 30.260.370.290.790.560.88
Table 5. RMSE and MAE values for the spatial expansion module for 1–3 h lead time forecasting.
Table 5. RMSE and MAE values for the spatial expansion module for 1–3 h lead time forecasting.
Lead Time (h)Cluster
12345678910
RMSE (m)
t + 10.070.090.080.130.140.200.200.130.350.11
t + 20.070.080.080.130.150.180.190.120.320.13
t + 30.070.080.080.130.140.180.200.120.310.16
MAE (m)
t + 10.050.050.050.090.090.150.140.100.260.07
t + 20.050.050.050.080.100.130.130.090.240.09
t + 30.040.050.050.090.090.130.130.090.240.11

Share and Cite

MDPI and ACS Style

Chang, M.-J.; Chang, H.-K.; Chen, Y.-C.; Lin, G.-F.; Chen, P.-A.; Lai, J.-S.; Tan, Y.-C. A Support Vector Machine Forecasting Model for Typhoon Flood Inundation Mapping and Early Flood Warning Systems. Water 2018, 10, 1734. https://doi.org/10.3390/w10121734

AMA Style

Chang M-J, Chang H-K, Chen Y-C, Lin G-F, Chen P-A, Lai J-S, Tan Y-C. A Support Vector Machine Forecasting Model for Typhoon Flood Inundation Mapping and Early Flood Warning Systems. Water. 2018; 10(12):1734. https://doi.org/10.3390/w10121734

Chicago/Turabian Style

Chang, Ming-Jui, Hsiang-Kuan Chang, Yun-Chun Chen, Gwo-Fong Lin, Peng-An Chen, Jihn-Sung Lai, and Yih-Chi Tan. 2018. "A Support Vector Machine Forecasting Model for Typhoon Flood Inundation Mapping and Early Flood Warning Systems" Water 10, no. 12: 1734. https://doi.org/10.3390/w10121734

APA Style

Chang, M. -J., Chang, H. -K., Chen, Y. -C., Lin, G. -F., Chen, P. -A., Lai, J. -S., & Tan, Y. -C. (2018). A Support Vector Machine Forecasting Model for Typhoon Flood Inundation Mapping and Early Flood Warning Systems. Water, 10(12), 1734. https://doi.org/10.3390/w10121734

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop