Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
How Far Can We Classify Macroalgae Remotely? An Example Using a New Spectral Library of Species from the South West Atlantic (Argentine Patagonia)
Next Article in Special Issue
Validation of CHIRPS Precipitation Estimates over Taiwan at Multiple Timescales
Previous Article in Journal
Spatio-Temporal Patterns of Drought and Impact on Vegetation in North and West Africa Based on Multi-Satellite Data
Previous Article in Special Issue
Meteorological OSSEs for New Zenith Total Delay Observations: Impact Assessment for the Hydroterra Geosynchronous Satellite on the October 2019 Genoa Event
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessment of IMERG-V06, TRMM-3B42V7, SM2RAIN-ASCAT, and PERSIANN-CDR Precipitation Products over the Hindu Kush Mountains of Pakistan, South Asia

by
Ali Hamza
1,
Muhammad Naveed Anjum
1,2,
Muhammad Jehanzeb Masud Cheema
1,
Xi Chen
3,
Arslan Afzal
1,4,
Muhammad Azam
1,5,
Muhammad Kamran Shafi
1 and
Aminjon Gulakhmadov
3,6,7,*
1
Department of Land and Water Conservation Engineering, Faculty of Agricultural Engineering and Technology, PMAS-Arid Agriculture University, Rawalpindi 46000, Pakistan
2
State Key Laboratory of Cryospheric Science, Northwest Institute of Eco-Environment and Resources, Chinese Academy of Sciences, Lanzhou 730000, China
3
Research Center for Ecology and Environment of Central Asia, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Urumqi 830011, China
4
Department of Energy Systems Engineering, Faculty of Agricultural Engineering and Technology, PMAS-Arid Agriculture University, Rawalpindi 46000, Pakistan
5
Department of Structures and Environmental Engineering, Faculty of Agricultural Engineering and Technology, PMAS-Arid Agriculture University, Rawalpindi 46000, Pakistan
6
State Key Laboratory of Desert and Oasis Ecology, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Urumqi 830011, China
7
Institute of Water Problems, Hydropower and Ecology of the Academy of Sciences of the Republic of Tajikistan, Dushanbe 734042, Tajikistan
*
Author to whom correspondence should be addressed.
Remote Sens. 2020, 12(23), 3871; https://doi.org/10.3390/rs12233871
Submission received: 27 September 2020 / Revised: 18 November 2020 / Accepted: 19 November 2020 / Published: 26 November 2020
(This article belongs to the Special Issue Remote Sensing of the Water Cycle)
Graphical abstract
">
Figure 1
<p>(<b>a</b>) The geographic extants of the study domain, and (<b>b</b>) topographic map of the study area and locations of the selected meteorological stations.</p> ">
Figure 2
<p>Spatial variation of the observed average annual precipitation (from January 2010 to December 2017) over the Hindu Kush Mountains.</p> ">
Figure 3
<p>Comparison of the spatial variation of average daily precipitation acquired from the reference stations and four SPPs (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) from 2010 to 2017.</p> ">
Figure 4
<p>Comparison of the temporal variability of average daily precipitation acquired from the reference meteorological stations and four SPPs. ((<b>a</b>) PERSIANN-CDR, (<b>b</b>) SM2Rain-ASCAT, (<b>c</b>) TRMM-3B42V7, and (<b>d</b>) IMERG-V06) over the Hindu Kush range from 2010 to 2017.</p> ">
Figure 5
<p>Taylor diagram demonstrating the performances of PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06 at a monthly scale. The values of RMSE are denoted by semi-circular lines (shown in green color) and values of CC are shown by the straight blue lines.</p> ">
Figure 6
<p>Box plots of evaluation indices (<b>a</b>) CC, (<b>b</b>) BIAS, (<b>c</b>) RMSE), and (<b>d</b>) rBIAS at monthly scale for four satellite-based products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush range of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median. The blue lines show the linear trend of the mean values.</p> ">
Figure 7
<p>Taylor diagram displaying the performance of the daily precipitation estimates from TRMM-3B42V7, PERSIANN-CDR, SM2Rain-ASCAT, and IMERG-V06. Root mean square difference (RMSD) values are denoted by the semi-circular green line. The values of CC are represented by the straight (blue) lines.</p> ">
Figure 8
<p>Box plots of evaluation indices (<b>a</b>) CC, (<b>b</b>) BIAS, (<b>c</b>) RMSE), and (<b>d</b>) rBIAS at daily scale for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and horizontal lines inside the boxes indicate the median values.</p> ">
Figure 9
<p>Scatter plots between the evaluation indices (CC, BIAS, rBIAS, and RMSE) on daily time scales versus elevation. Red markers represent the meteorological stations and dotted lines indicate the linear regression fitting lines.</p> ">
Figure 10
<p>Scatter plots between the evaluations indices (CC, BIAS, rBIAS, and RMSE) versus precipitation. Blue markers represent the meteorological stations and the dotted lines indicate the linear regression fitting lines.</p> ">
Figure 11
<p>Spatial distribution of statistical performance evaluation measures calculated for four SPPs, at a daily scale.</p> ">
Figure 12
<p>Box plots of the seasonal values of (<b>a</b>) CC, (<b>b</b>) BIAS, and (<b>c</b>) RMSE for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median.</p> ">
Figure 13
<p>Relative Bias (rBias: %) at seasonal scale for four satellite precipitation products for the entire study area. Horizontal dashed lines are used to represent the threshold (±10%) of rBias.</p> ">
Figure 14
<p>Performance diagram for representing the ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) in capturing the daily precipitation over the study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).</p> ">
Figure 15
<p>Performance diagram for the precipitation detection ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at the seasonal basis ((<b>a</b>) Spring, (<b>b</b>) Summer, (<b>c</b>) Autumn, and (<b>d</b>) Winter) for the entire study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).</p> ">
Figure 16
<p>Probability density function (PDF) calculated for precipitation data acquired from the in-situ gauges and four satellite precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at different intensities. (<b>a</b>) Daily precipitation in the entire study period, (<b>b</b>) winter daily precipitation, (<b>c</b>) spring daily precipitation, (<b>d</b>) summer daily precipitation, and (<b>e</b>) autumn daily precipitation.</p> ">
Versions Notes

Abstract

:
In this study, the performances of four satellite-based precipitation products (IMERG-V06 Final-Run, TRMM-3B42V7, SM2Rain-ASCAT, and PERSIANN-CDR) were assessed with reference to the measurements of in-situ gauges at daily, monthly, seasonal, and annual scales from 2010 to 2017, over the Hindu Kush Mountains of Pakistan. The products were evaluated over the entire domain and at point-to-pixel scales. Different evaluation indices (Correlation Coefficient (CC), Root Mean Square Error (RMSE), Bias, and relative Bias (rBias)) and categorical indices (False Alarm Ration (FAR), Critical Success Index (CSI), Success Ratio (SR), and Probability of Detection (POD)) were used to assess the performances of the products considered in this study. Our results indicated the following. (1) IMERG-V06 and PERSIANN capably tracked the spatio-temporal variation of precipitation over the studied region. (2) All satellite-based products were in better agreement with the reference data on the monthly scales than on daily time scales. (3) On seasonal scale, the precipitation detection skills of IMERG-V06 and PERSIANN-CDR were better than those of SM2Rain-ASCAT and TRMM-3B42V7. In all seasons, overall performance of IMERG-V06 and PERSIANN-CDR was better than TRMM-3B42V7 and SM2Rain-ASCAT. (4) However, all products were uncertain in detecting light and moderate precipitation events. Consequently, we recommend the use of IMERG-V06 and PERSIANN-CDR products for subsequent hydro-meteorological studies in the Hindu Kush range.

Graphical Abstract">

Graphical Abstract

1. Introduction

Reliable precipitation information is crucial for hydro-climatological studies, hydrological infrastructure planning, crop irrigation scheduling, and prediction of floods and droughts. Traditionally, ground-based weather radars and gauging-stations are considered as reliable sources of precipitation information [1]. However, scarcity and uneven distribution of these ground-based stations in mountainous and remote areas, hamper the access to frequent measurements for many applications [2]. Furthermore, uncertainties in ground-based measurements due to wind-induced errors, missing values, and heterogeneity, also restrict their use [3,4,5]. Similar limitations of ground-based measurements also exist in the Hindu Kush Mountains. Therefore, the exploration of other reliable sources of uninterrupted precipitation data for such areas is indispensable.
Over the past few decades, several satellite-based precipitation products (SPPs) were developed to provide uninterrupted data of global precipitation at fine spatial and temporal scales [6,7]. Generally, algorithms of SPPs retrieve the precipitation information from microwave (WM) [6] or infrared (IR) sensors [7,8]. Some of the recently developed algorithms of SPPs are capable of providing precipitation information, by combining the information of both MW and IR sensors [9]. Such algorithms were used in Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA) [10,11], Integrated Multi-Satellite Retrievals for Global Precipitation Measurement (IMERG) [12], and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) [13]. These SPPs provide the information of precipitation occurrence at the finest temporal (≤3 h) and spatial (≤0.25°) resolutions available from current satellite instruments [14].
TRMM was launched in 1997 as a joint mission of National Aeronautics and Space Administration (NASA) and the Japanese Aerospace Exploration Agency (JAXA). TRMM provides precipitation estimates at a 3-hourly time-step with a spatial resolution of 0.25°, over a spatial domain of 50° N-S. Considering the success of the TRMM project, NASA, in a joint venture with JAXA, introduced IMERG in 2014, with the aim of providing uninterrupted global precipitation at high spatial and temporal resolutions. Recently, they launched Version 6 of IMERG products (known as IMERG-V06). This version of IMERG provides global precipitation estimates at a half-hour time-step with a spatial resolution of 0.1°. The algorithm of SM2Rain-ASCAT is based on the “bottom-up” approach and uses the information of the Advanced SCATterometer (ASCAT), Soil Moisture and Ocean Salinity (SMOS), and Advanced Microwave Scanning Radiometer for Earth Observing (AMSR-E) to estimate the global soil moisture [12,15,16]. SM2Rain-ASCAT (hereafter SM2rain) product is available since 2007. PERSIANN-CDR (hereafter PERSIANN) provides daily global precipitation information at a 0.25° grid scale. It was introduced by the Centre for Hydrometeorology and Remote Sensing, University of California, and is available since March 2000.
Although SPPs provide uninterrupted information of precipitation, their accuracy varies from region to region [17,18]. Therefore, it is important to assess their accuracy before direct application. In previous years, several researchers assessed the accuracy of SPPs in different regions of the world, such as in Africa [17,18,19], Europe [20,21,22], America [23,24,25], Austria [26], Australia [27], China [28,29], Iran [30], and Pakistan [9,31,32,33,34,35]. For instance, Anjum et al. [36] assessed the performance of IMERG-V06 and TRMM-3B42V7 (hereafter IMERG and TRMM, respectively) over the Tianshan Mountains of China and concluded that the latest post real-time (final ̶ run) IMERG product outperformed the TRMM. Mosaffa et al. [30] recommended the use of PERSIANN to understand the spatiotemporal variability of precipitation in Iran. Shraifi et al. [26] concluded that the performance of IMERG was significantly better than SM2Rain in Austria.
Although few studies evaluated the performances of IMERG-V05, TRMM, SM2Rain, and PERSIANN in Pakistan [15,32,37], the error characteristics and advantages of recently developed products (IMERG-V06 and SM2Rain-ASCAT) are not documented yet, particularly in the Hindu Kush Mountains. This mountainous range is situated on the northwestern region of Pakistan, which is about 800 km long and about 240 km wide. In the north, this mountainous system separates the Amu Darya Valley from the Indus River Basin. In the east, the Hindu Kush defends Pamir range, at the border of China and Pakistan. Most of the eastern part of the range lies in the Pakistani territory. This range splits key climate zones of Asia. It is situated at the junction of monsoon and westerlies circulation systems. This range is a source region of the Swat, Panjkora, Chitral, Gilgit, Kunhar, and Kabul Rivers. These rivers play a very important role in the agriculture, hydropower production, and socio-economic development of Pakistan. Recently, the Government of Pakistan started the construction of a multipurpose dam in this region. The literature review revealed that the scarcity of in situ meteorological stations hampered the application of their data for several hydro-meteorological applications in the Hindu Kush range [9,33]. Therefore, this study was conducted to assess and inter-compare the error characteristics of four SPPs (IMERG, TRMM, SM2Rain, and PERSIANN) against the measurements of available meteorological stations in the Hindu Kush range of Pakistan. This is the first rigorous assessment of IMERG and SM2Rain products over the Hindu Kush Mountainous range and uses all available in situ gauging stations data. Findings of this study would be beneficial for algorithm developers of considered satellite products, as well as for the data users of SPPs.

2. Materials and Methods

2.1. Study Area

The Hindu Kush Mountainous range (Figure 1), one of the largest mountainous ranges in South Asia, was selected for error characterization of four SPPs (IMERG, TRMM, SM2Rain, and PERSIANN). The eastern side of the range mainly receives precipitation from the monsoon circulation system, however, the western parts of this range are under the influence of the westerlies circulation system [9]. In this range, the snow/rainy spell starts in July and ends in September, and the winter season is mostly dry. Figure 2 demonstrates the spatial variation of mean annual precipitation. The precipitation magnitude varies significantly over the entire domain. Generally, the southern part of the range receives more precipitation, while the eastern part receives lesser precipitation. This range has a very rugged terrain; the altitude varies between 339 m and 7609 m above mean sea level (a.m.s.l.), with a north to south gradient.

2.2. Datasets

The daily precipitation datasets of 24 in situ meteorological stations were obtained from Water and Power Development Authority (WAPDA) and Pakistan Meteorological Department (PMD) for the period of January 2010 to December 2017. The locations of considered meteorological stations are presented in Figure 1. The quality of precipitation records was ensured by two data handling organizations (WAPDA and PMD). Previously, several researchers used the daily records of considered meteorological stations for various hydro-climatological applications [9,29,34,38]. Table 1 elaborates the salient features of in situ meteorological stations.
The PERSIANN product is capable of providing information on global daily precipitation at a 0.25° grid-scale over a spatial domain of 50° S to 50° N [39]. In the present study, daily precipitation estimates of PERSIANN at 0.25° grid scale for eight years (from 2010 to 2017) were downloaded from the website CHRS (https://chrsdata.eng.uci.edu/). The estimates of daily precipitation of SM2Rain-ASCAT product at the 12.5 km grid scale were obtained from http://hydrology.irpi.cnr.it/download-area/sm2rain-data-sets/. The three-hourly precipitation estimates of the TRMM product at a 0.25° grid scale were obtained from https://gpm.nasa.gov/data/directory, while half-hourly precipitation estimates of the IMERG Final-Run product at a 0.1° grid-scale were downloaded from https://giovanni.gsfc.nasa.gov/giovanni/. The SPPs with half-hourly and three-hourly temporal resolutions (IMERG and TRMM, respectively) were first adjusted by considering the local data acquisition time (from UTC 00:00 to UTC 05:00) and were then accumulated to acquire daily precipitation estimates. Monthly, seasonal, and annual time series data of all SPPs were obtained by accumulating daily data. Previously, several researchers followed the same methodology to obtain the monthly, seasonal, and annual data from the daily or sub-daily precipitation estimates of SPPs [9,40].

2.3. Methods

The error characteristics of four SPPs (IMERG, TRMM, PERSIANN, and SM2Rain) were assessed against the measurements of in situ meteorological stations. In this study, only grids of SPPs that contained at least one reference meteorological station were considered, by following the methodology of Wang et al. [40]. The performances of SPPs were assessed at different temporal (daily, monthly, seasonal, and annual) and spatial (entire domain and point-to-pixel) scales, against measurements of reference gauging stations, for the period of January 2010 to December 2017. The spatial distribution map of annual average precipitation over the study domain was developed by using geostatistical spatial interpolation techniques (Kriging with external drift (KED)). KED is recommended for interpolation in mountainous regions [37,38].
The skills of all SPPs to reproduce the spatial variability of precipitation over the Hindu Kush Mountains were assessed. Several widely used evaluation indices (Correlation Coefficients (CC), Bias, relative Bias (rBias), and Root Mean Square Error (RMSE), categorical indices (Probability of Detection (POD), False Alarm Ratio (FAR), and Critical Success Index (CSI) were used to assess the performance of SPPs. Previously, many researchers used these indices to evaluate the error characteristics of SPPs in different climatic and topographic conditions [9,36,41,42,43]. The skill of SPPs to characterize the temporal variation of precipitation over the mountains was also examined by comparing their daily temporal variation with variation of the reference data.
The dimensionless CC was estimated to measure the linear agreement between reference measurements and estimates of SPPs. BIAS (mm/time) was estimated to assess the overestimation or underestimation of the precipitation magnitude. The rBias (in percentage) was determined to evaluate the relative difference between the observations of in situ stations and SPPs. RMSE was computed to quantify the average magnitude of error (mm/time) in the satellite-based data, with reference to the gauge-based data.
C C = i = 1 n ( G i G ¯ ) ( S i S ¯ ) i = 1 n ( G i G ¯ ) 2 × i = 1 n ( S i S ¯ ) 2
B i a s = i = 1 n ( S i G i ) n
r B i a s = i = 1 n ( S i G i ) i = 1 n G i × 100
R M S E = 1 n i = 1 n ( S i G i ) 2
where G i denotes the gauge-based (reference) data, G ¯ is mean of reference data, Si means the satellite-based estimates, S ¯ indicates the mean of satellite-based estimates, and n indicates the total number of observations. If the estimated values of BIAS and RMSE for a satellite product are zero, and the value of CC is unity, then that product is considered as the perfect proxy of gauge-based data. Some recent performance assessments of SPPs [9,43,44] documented the thresholds of CC and rBias to accept their accuracy for hydro-climatological applications. The documented thresholds for rBias and CC are ±10 and ≥0.70, respectively. Negative/positive values of BIAS denote underestimation/overestimation of the precipitation amount.
The Probability of Detection (POD), Critical Success Index (CSI), and False Alarm Ratio (FAR) were calculated to evaluate the ability of SPPs to represent the occurrence of precipitation events [45]. The POD indicates the proportion of events that were correctly detected by the product, out of the total reported events. Higher values of POD indicate that majority of the precipitation events were detected by the SPPs. FAR is the proportion of events that were incorrectly recorded by the precipitation product out of the total reported events of the product. Higher values of FAR show a higher error in the precipitation detection skill of the SPPs. CSI is the ratio between the events that were correctly detected by the product to the total number of precipitation events recorded by the product. Higher values of CSI indicate a high ratio of the events that were correctly detected by the product. In the present study, the threshold for the computation of CSI, FAR, and POD was 1 mm/day, by adopting the methodology of previous studies [9,40]. The categorical indices were computed using the following equations:
P O D = H H + M
C S I = H H + M + F
F A R = F H + F
where H indicates the events that were correctly detected by the SPPs, F represents the events that were falsely reported by the product, and M denotes the events that were missed by the product. The perfect value of CSI and POD is 1 and that of the FAR is zero.
Probability Density Function (PDF) of the daily estimates of four SPPs and reference gauges were also calculated at different precipitation intensities. To estimate the PDF of SPPs, different precipitation intensities were selected by following the recommendations of World Meteorological Organization (WMO). Additionally, the Taylor diagrams (Taylor (2001)) were drawn to present the brief summary of the agreements of satellite products, with the gauging stations. In Taylor diagrams, the values of standard deviation of the gauge-based measurements and the estimates of SPPs were plotted on the vertical axis, values of RMSE were displayed on the angular distance from the x-axis, and values of CC were drawn along the azimuthal angle.

3. Results

3.1. Skill of SPPs to Track the Spatio-Temporal Variability of Precipitation

Figure 3 illustrates the spatial variation of average daily precipitation acquired from the reference meteorological stations and four SPPs over the study area. Significant spatial variability in the precipitation magnitude was found over the study domain, which might be due to the complex topography. Overall, all data sources (reference gauges and SPPs) indicated higher precipitation amounts over the low elevation areas (southern part of the mountain). Daily station-based precipitation showed considerable spatial variation, as shown in Figure 3. The records of reference gauges indicated a higher amount of precipitation over the south-western parts of the Hindu Kush range, whereas the meteorological stations installed in the north-western parts of the study area exhibited a lesser amount of precipitation. Results showed that TRMM was unable to track the spatial variability of observed precipitation and it significantly underestimated the precipitation magnitude over all reference stations. PERSIANN slightly overestimated and underestimated the precipitation over the north-eastern and north-western parts, respectively. It showed better performance over the meteorological stations installed in the southern parts of the study domain. Although the ability of SM2Rain to track the spatial variability of observed precipitation was better over the low elevation areas, it was uncertain to accurately report the precipitation magnitude over the higher altitudes. Despite the fact that IMERG showed considerable over and underestimations at some of the considered meteorological stations, the overall performance of IMERG in terms of ability to track the spatial variability of precipitation magnitude was better than the other considered SPPs.
Figure 4 shows the comparison of the temporal variability of average daily precipitation magnitude obtained from the reference stations and four SPPs. The time-series of precipitation were obtained by taking the moving average of daily data of reference stations and the considered SPPs for the period of January 2010 to December 2017. Previously, [8,36] applied the same methodology to compare the variability of daily precipitation obtained from the reference stations and SPPs over the Tianshan Mountains of China and the northwestern part of South America, respectively. The Hindu Kush range receives high precipitation in two seasons, winter and summer, due to westerlies and monsoon circulation systems, respectively [18]. The reference (station-based) data showed two peaks in a year, as shown in Figure 4. Comparison showed that the PERSIANN and IMERG products were capable of tracking the temporal variability of observed precipitation over the study domain. The average of daily data obtained from the reference stations was 1.9 mm/day, with a variation between 0.0 and 10.2 mm/day. In comparison, the satellite-based average daily precipitation magnitude varied between 0.0 and 11.1 mm/day (with an average of 1.7 mm/day), between 0.0 and 6.5 mm/day (with an average of 1.8 mm/day), between 0.0 and 5.8 mm/day (with average 1.5 mm/day), and between 0.0 and 2.7 mm/day (with average 0.5 mm/day) for IMERG, PERSIANN, SM2Rain, and TRMM, respectively. SM2Rain underestimated the precipitation magnitude in the winter season and overestimated it in summer season, whereas TRMM underestimated the precipitation magnitude throughout the year. Comparatively, IMERG and PERSIANN showed better performances than the TRMM and SM2Rain products in terms of ability to track the temporal variability of daily precipitation.

3.2. Performance of SPPs at Monthly Scale

Figure 5 (Taylor diagram) summarizes the performances of the four SPPs (PERSIANN, SM2Rain, TRMM, and IMERG) at a monthly scale. In order to develop the Taylor diagram, we used the normalized areal average data of meteorological stations and SPPs, following [31]. Generally, all SPPs indicated a good linear relationship with the reference monthly data, except SM2Rain. The correlations between the monthly station-based data and the estimates of IMERG, PERSIANN, and TRMM were higher than 0.80, however, the value of CC for SM2Rain was less than 0.50. The estimated values of RMSE for IMERG and PERSIANN were lower than 0.50. Conversely, the values of RMSE for TRMM and SM2Rain were higher than 0.5 (Figure 5), which showed a higher error in the estimates of SM2Rain and TRMM products over the Hindu Kush range. The values of SD of all SPPs were comparable with the SD value of the reference data.
Figure 6 displays the variation in the estimated values of CC, BIAS, and RMSE for four SPPs (PERSIANN, SM2Rain, TRMM, and IMERG) at each meteorological station. Box length of CC for TRMM showed significant variation, and box length of CC for the PERSIANN showed minimum variation. The variations in the BIAS and rBIAS values of IMERG were minimum, as compared to other SPPs in the Hindu Kush range, as indicated by the box lengths of BIAS and rBIAS for this product. The box lengths of RMSE showed the highest variation in the values of RMSE for TRMM.

3.3. Performance of the Satellite-Based Products at Daily Scale

Figure 7 summaries the performances of SPPs (PERSIANN, SM2Rain, TRMM, and IMERG) against daily gauge-based precipitation data over the study domain. It was found that the CC values of IMERG, PERSIANN, SM2Rain, and TRMM were 0.41, 0.42, 0.20, and 0.30, respectively. This showed poor agreements of the daily gauge-based data, with the estimates of SM2Rain and TRMM products. However, all SPPs exhibited poor performance in terms of RMSE, as indicated by its higher values (>0.5) in Figure 7.
Figure 8 displays the box plots of CC, BIAS, and RMSE for four SPPs (PERSIANN, SM2Rain, TRMM, and IMERG). Box length of CC for IMERG indicates the lowest variation in the values of CC for this product (Figure 8a). Generally, all SPPs showed high inconsistency and low linear relationship with the daily gauge data. TRMM showed a higher variation in the BIAS values, whereas IMERG indicated the lowest variation in the BIAS values (Figure 8b). In comparison, the box length of RMSE for IMERG (Figure 8c) showed the highest variation in the RMSE values of this product. Overall, all products showed significant inconsistencies in the values of evaluation indices on a daily scale.
Figure 9 shows the effect of elevation on the performance of all used satellite products in terms of CC, BIAS, rBIAS, and RMSE. It was found that the RMSE values of all SPPs decreased with the increase of elevation. With the increase of elevation, the values of CC and rBIAS of SM2Rain and IMERG-V06 decreased, whereas the values of PERSIANN and TRMM increased with an increase in elevation.
Figure 10 represents the influence of the average daily precipitation on the evaluation indices (CC, BIAS, rBIAS, and RMSE) of SPPs. A decrease in the BIAS (rBIAS) and an increase in the RMSE was found with the increases of the precipitation rate. All products underestimated the precipitation at higher precipitation rates, compared to the station data on daily time scales. The values of CC of SM2Rain showed an increasing trend with an increase of the precipitation rate. However, the influence of precipitation rate on the CC of PERSIANN, TRMM, and IMERG with the station data was not considerable, as shown in Figure 10. Overall, CC did not seem too dependent on the precipitation rate. Thus, it was deduced that the products were uncertain to capture the correct magnitude of precipitation and tended to underestimate it with an increasing precipitation rate.
Figure 11 displays the spatial variation of rBIAS, CC, and RMSE estimated for the PERSIANN, SM2Rain, TRMM, and IMERG products at a daily scale. Considerable spatial variations in the values of evaluation indices were found in the study area. The spatial pattern of rBIAS showed that all TRMM and SM2Rain products were uncertain to accurately estimate the precipitation amount at most meteorological stations. TRMM showed significant underestimation of precipitation amount over most stations, while IMERG was the least biased product over most stations, followed by the PERSIANN. SM2Rain showed a good performance over the lower altitudes. The spatial pattern of CC indicated that all agreements between the SPPs and reference gauges were inconsistent over the study domain. Comparatively, the IMERG and PERSIANN products were in good agreement with the reference data at the higher altitudes. The spatial pattern of RMSE showed significant variations in the error characteristics of SPPs. Generally, all SPPs indicated higher values of RMSE over the southern parts of the range. It is worth pointing out that the best agreement in terms of RMSE was in the northeast region of the domain, where all SPPs had their lowest RMSE values.

3.4. Performance of Satellite Products at Seasonal Scale

Figure 12 exhibits the variations in the estimated values of CC, BIAS, and RMSE for SPPs, at a seasonal scale. The box lengths of CC showed high variations in the linear agreements between the reference data and the estimates of PERSIANN, SM2Rain, and IMERG products in the autumn and winter seasons. The box lengths of BIAS of all SPPs indicated less variation in the over- and underestimation of precipitation magnitude in autumn, while all products showed considerable variations in the Bias in other seasons, as indicated by the box lengths of Bias of all products. The values of RMSE for IMERG showed the highest variations, as compared to the other SPPs.
Figure 13 shows the relative Biases (%) calculated for all precipitation products against the station-based precipitation data, at annual and seasonal scales over the entire study domain. SM2Rain and TRMM products showed high inconsistency in all seasons. TRMM indicated significant underestimation of precipitation in all seasons, whereas SM2Rain overestimated the precipitation in the summer season and underestimated it in all other seasons. On annual scales, both IMERG and PERSIANN showed an acceptable underestimation of precipitation, whereas TRMM and SM2Rain exhibited significant underestimation of precipitation. Overall, the performances of IMERG and PERSIANN products were acceptable in all seasons, albeit IMERG slightly underestimated the values in the spring season and PERSIANN slightly overestimated the precipitation magnitude in the autumn season.

3.5. Ability of SPPs to Detect Occurrence of Precipitation

Figure 14 shows the performance diagram of precipitation estimates obtained from four SPPs over the Hindu Kush Mountains of Pakistan. Roebber [46] introduced a performance diagram to graphically compare the results of the categorical indices (POD, SR, CSI, and Bias) of the products, where SR is equal to 1-FAR. It is known as the Roebber Performance diagram (or simply performance diagram) and shows the geometric relation between the reference gauges and satellite products. Previously, some researchers used the performance diagram to illustrate the performances of different precipitation products in different countries. For instance, [9] used this diagram in the northern mountainous terrain of Pakistan, [2] used this diagram in Egypt, and [47] used in Brazil. In the performance diagram, if the values of all estimated indices for a product are close to one, then that product is regarded as a suitable proxy for reference data. The values of the POD for the IMERG, PERSIANN, SM2Rain, and TRMM are 0.76, 0.70, 0.55, and 0.19, respectively, as shown in Figure 14. The higher values of POD of IMERG and PERSIANN products showed that the detection skills of these products were good and most events were detected by these SPPs. This finding is also supported by the high values of SR for both of these products. The TRMM was uncertain in detecting the occurrence of precipitation events, as exhibited by the low value of POD for this product.
The ability of SPPs to accurately report the occurrence of precipitation events is summarized in terms of performance diagrams on the seasonal scale. Figure 15 shows that the detection skills of IMERG and PERSIANN products were generally better than SM2Rain and TRMM products, particularly in the spring and winter seasons. SM2Rain showed good detection ability in the summer season, while in the other three seasons, it showed poor detection ability. Overall, SM2Rain was relatively better than TRMM product, which displayed very poor performance in all seasons.
Figure 16 shows the Probability Density Function (PDF) calculated for the daily precipitation events reported by the reference stations and SPPs in the Hindu Kush Mountains. Analysis of the daily measurements of the reference gauges for the entire study period showed that the light precipitation events (<2 mm/day) occurred most frequently (72.0%). TRMM showed overestimation of light events (>95%), IMERG and SM2Rain slightly overestimated the light precipitation events (74.7% and 74.3%, respectively), whereas PERSIANN slightly underestimated the occurrence of light precipitation events (69.9%). Generally, all SPPs showed underestimation of the occurrence of moderate precipitation events (2–10 mm/day), except PERSIANN, which showed slight overestimation of moderate precipitation events. On a seasonal scale, the overall performances of all SPPs in terms of PDF of light and heavy precipitation events were generally consistent with their performances at the daily scale. Generally, TRMM and SM2Rain showed larger deviations from the PDFs for winter, spring, and summer. IMERG consistently showed the best agreement. It is worth pointing out that summer showed the worst agreement for all SPPs.

4. Discussion

In this study, different statistical indices were computed to analyze the error characteristics and accuracies of four satellite-based precipitation products over the Hindu Kush Mountains of Pakistan. Previously, several researchers assessed the performances of the SPPs (including, PERSIANN, SM2Rain, TRMM, and IMERG) in different climatic and topographic conditions of the world [14,26,28,35,36,45,47,48,49,50,51,52]. It is well-documented that the performances of SPPs products are strongly dependent on the in-situ topographic and climatic conditions. For instance, Tan et al. [50] compared six SPPs (including, PERSIANN-CDR and TRMM-3B42V7) over Malaysia. They concluded that the regional climatology and precipitation retrieval algorithm of satellites significantly affected the accuracy of the precipitation products. Xu et al. [29] compared GPM and TRMM over the Southern Tibetan Plateau. They suggested that different indices (BIAS and RMSE) were significantly correlated with topographic variations.
In the current study, we compared the accuracy and error characteristics of the latest product of GPM (IMERG-V06) with the TRMM, PERSIANN, and SM2Rain, over the Hindu Kush Mountains of Pakistan. The SPPs were assessed against the measurements of 24 reference meteorological stations, at different spatial and temporal scales from January 2010 to December 2017. Results of the present study advocated that the performances of considered satellite products were considerably affected by the topography and climatic conditions of the study area, which was consistent with the results of previous studies [9,31,36]. SM2Rain and TRMM products were unable to represent the spatial variability of the precipitation, which was consistent with the finding of [30,51]. Among the considered SPPs, the skills of IMERG and PERSIANN to characterize the spatial variability of the observed precipitation were better. In a previous study, Alijanian et al. [52] confirmed that the skill of PERSIANN–CDR to characterize the spatial variation of the precipitation was better than other satellite-products. Correlations of all SPPs with the reference data at a daily scale were not good, as witnessed by the estimated values of CC (<0.50) of products. The correlations of IMERG, PERSAINN, and TRMM with the reference monthly data were >0.80, which advocated for better agreements of monthly estimates of SPPs, with the reference data, as compared to the daily data. It was found that the linear agreements between the reference data and estimates of SM2Rain and TRMM decreased with an increase in the precipitation magnitude, while there was an opposite trend in the agreements between the station-based data and the estimates of IMERG and PERSIANN. Previously, Wang et al. [36] also reported a similar pattern of correlation between IMERG and gauge-based data, in a mountainous region of China. The probability of detection (POD) of IMERG and PERSIANN was quite better than SM2rain and TRMM products, with POD > 0.60. Similar findings of POD for the considered SPPs were also reported by [8]. However, TRMM showed very poor performance in terms of POD than the other three products at a daily scale, which was consistent with the finding of [9]. TRMM and SM2Rain showed significant underestimation of the precipitation magnitude at daily and monthly scales. Previous studies confirmed that TRMM showed underestimation at the Himalayan region [53,54,55]. The overall performances of all SPPs were better at the monthly scale than the daily scale, which was consistent with a previous study [50]. On seasonal scales, the correlations of SM2Rain and TRMM with the gauge data were also very poor (<0.40), whereas CC of IMERG and PERSIANN with the reference data were moderate (>0.40) in all seasons. TRMM and SM2Rain showed significant underestimation of precipitation magnitude in all seasons, except summer, when Sm2Rain significantly overestimated the precipitation magnitude. PERSIANN and IMERG showed the lowest Bias with the gauge data in all seasons.

5. Conclusions

In the present study, the performances of four satellite-based precipitation products (PERSIANN, SM2Rain, TRMM, and IMERG) were assessed on different temporal (daily, monthly, and seasonal) and spatial (station and regional) scales, with reference to the observations of 24 in situ gauges in the Hindu Kush region of Pakistan. All precipitation products were evaluated for the period of January 2010 to December 2017. The main conclusions of the present study are as following:
  • Two of the considered SPPs (IMERG and PERSIANN) were capable of characterizing the spatial variability of precipitation over the Hindu Kush Mountains of Pakistan. However, SM2Rain and TRMM products were unsuitable for understanding the spatial variation of precipitation over the said spatial domain.
  • The temporal variation of average daily precipitation was captured well by the IMERG and PERSIANN products, while SM2Rain and TRMM products were uncertain to characterize the temporal variability of precipitation.
  • The overall performances of all considered SPPs were better at the monthly scale than the daily scale.
  • TRMM and SM2Rain showed a significant underestimation (73.95% and 20.89%, respectively) of precipitation magnitude, while IMERG and PERSIANN exhibited a slight underestimation of the precipitation amount by −8.85% and −1.24%, respectively, over the Hindu Kush region.
  • The precipitation detection capabilities of PERSIANN and IMERG products were better than the TRMM and SM2Rain products. The IMERG showed the best performance in terms of probability of detection (0.76), followed by PERSIANN (0.70). The performance of TRMM in terms of POD was very poor (<0.30).
  • Detection skills of IMERG and PERSIANN in all seasons were good (>0.70). In this area, the overall performance of TRMM was very poor in all seasons.
The results of this study advocated that the IMERG-V06 and PERSIANN-CDR products outperformed the TRMM and SM2Rain products for the Hindu Kush Mountains in Pakistan. Both of these products (IMERG-V06 and PERSIANN) were capable of characterizing the spatio-temporal variability of the observed precipitation over the study region, which confirmed their application in understanding the spatial variability of precipitation over the Hindu Kush Mountains of Pakistan. Moreover, the value of CC for IMERG-V06 and PERSIANN products was >0.70 and rBias was within the acceptable limit (±10), at monthly scales. Thus, we recommend the use of their monthly estimates as a complimentary substitute for hydro-meteorological studies in the Hindu Kush range.

Author Contributions

Conceptualization, A.H., M.N.A., and M.K.S.; Data curation, A.H., M.N.A., and M.A.; Formal analysis, A.H., M.N.A., and M.K.S.; Funding acquisition, A.G. and X.C.; Investigation, A.H., and M.N.A., and M.K.S.; Methodology, A.H., and M.N.A.; Project administration, M.N.A., M.J.M.C., and A.A.; Resources, M.N.A., A.A., and M.A.; Software, M.N.A., A.H., A.A., and M.A.; Supervision, M.N.A., and M.J.M.C.; Validation, M.N.A., M.J.M.C., X.C., and A.G.; Visualization, M.N.A., M.J.M.C., X.C., and A.G.; Writing—original draft, A.H.; Writing—review & editing, M.N.A., M.J.M.C., A.G., and A.A. All authors have read and agreed to the published version of the manuscript.

Funding

This study was financially supported by the Strategic Priority Research Program of the Chinese Academy of Sciences, the Pan-Third Pole Environment Study for a Green Silk Road (Grant No. XDA20060303), the National Natural Science Foundation of China (Grant No. 41950410575), the International Cooperation Project of National Natural Science Foundation of China (Grant No. 41761144079), the Xinjiang Tianchi Hundred Talents Program (Grant No. Y848041), the project of the research Center of Ecology and Environment in Central Asia (Grant No. Y934031), and the CAS PIFI fellowship (Grant No. 2021PC0002).

Acknowledgments

We are thankful to the Pakistan Meteorological Department (PMD) and Water and Power Development Authority (WAPDA) Pakistan for providing climatic data.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Qin, Y.; Chen, Z.; Shen, Y.; Zhang, S.; Shi, R. Evaluation of satellite rainfall estimates over the Chinese Mainland. Remote Sens. 2014, 6, 11649–11672. [Google Scholar] [CrossRef] [Green Version]
  2. Nashwan, M.S.; Shahid, S.; Wang, X. Assessment of satellite-based precipitation measurement products over the hot desert climate of Egypt. Remote Sens. 2019, 11, 555. [Google Scholar] [CrossRef] [Green Version]
  3. Porcù, F.; Milani, L.; Petracca, M. On the uncertainties in validating satellite instantaneous rainfall estimates with raingauge operational network. Atmos. Res. 2014, 144, 73–81. [Google Scholar] [CrossRef]
  4. Guo, H.; Chen, S.; Bao, A.; Behrangi, A.; Hong, Y.; Ndayisaba, F.; Hu, J.; Stepanian, P.M. Early assessment of Integrated Multi-satellite Retrievals for Global Precipitation Measurement over China. Atmos. Res. 2016, 176–177, 121–133. [Google Scholar] [CrossRef]
  5. Sharifi, E.; Steinacker, R.; Saghafian, B. Assessment of GPM-IMERG and other precipitation products against gauge data under different topographic and climatic conditions in Iran: Preliminary results. Remote Sens. 2016, 8, 135. [Google Scholar] [CrossRef] [Green Version]
  6. Ferraro, R.R. Special sensor microwave imager derived global rainfall estimates for climatological applications. J. Geophys. Res. 1997, 102, 715–735. [Google Scholar] [CrossRef]
  7. Susskind, J.; Piranio, P.; Rokke, L.; Iredell, L.; Mehta, A. Characteristics of the TOVS Pathfinder Path A Dataset. Bull. Am. Meteorol. Soc. 1997, 78, 2679–2701. [Google Scholar] [CrossRef]
  8. Palomino-Ángel, S.; Anaya-Acevedo, J.A.; Botero, B.A. Evaluation of 3B42V7 and IMERG daily-precipitation products for a very high-precipitation region in northwestern South America. Atmos. Res. 2019, 217, 37–48. [Google Scholar] [CrossRef]
  9. Anjum, M.N.; Ding, Y.; Shangguan, D.; Ahmad, I.; Ijaz, M.W.; Farid, H.U.; Yagoub, Y.E.; Zaman, M.; Adnan, M. Performance evaluation of latest integrated multi-satellite retrievals for Global Precipitation Measurement (IMERG) over the northern highlands of Pakistan. Atmos. Res. 2018, 205, 134–146. [Google Scholar] [CrossRef]
  10. Huffman, G.J.; Adler, R.F.; Bolvin, D.T.; Gu, G.; Nelkin, E.J.; Bowman, K.P.; Hong, Y.; Stocker, E.F.; Wolff, D.B. The TRMM Multisatellite Precipitation Analysis (TMPA): Quasi-global, multiyear, combined-sensor precipitation estimates at fine scales. J. Hydrometeorol. 2007, 8, 38–55. [Google Scholar] [CrossRef]
  11. Brocca, L.; Ciabatta, L.; Massari, C.; Camici, S.; Tarpanelli, A.; Filippucci, P.; Hahn, S.; Ciabatta, L.; Massari, C.; Camici, S.; et al. Soil as a natural rain gauge: Estimating global rainfall from satellite soil moisture data. Geo-Information Sci. 2014, 119, 5128–5141. [Google Scholar] [CrossRef]
  12. Hou, A.Y.; Kakar, R.K.; Neeck, S.; Azarbarzin, A.A.; Kummerow, C.D.; Kojima, M.; Oki, R.; Nakamura, K.; Iguchi, T. The global precipitation measurement mission. Bull. Am. Meteorol. Soc. 2014, 95, 701–722. [Google Scholar] [CrossRef]
  13. Hsu, K.L.; Gao, X.; Sorooshian, S.; Gupta, H.V. Precipitation estimation from remotely sensed information using artificial neural networks. J. Appl. Meteorol. 1997, 36, 1176–1190. [Google Scholar] [CrossRef]
  14. Moazami, S.; Golian, S.; Kavianpour, M.R.; Hong, Y. Comparison of PERSIANN and V7 TRMM multi-satellite precipitation analysis (TMPA) products with rain gauge data over Iran. Int. J. Remote Sens. 2013, 34, 8156–8171. [Google Scholar] [CrossRef]
  15. Cheema, M.J.M.; Bastiaanssen, W.G.M.; Rutten, M.M. Validation of surface soil moisture from AMSR-E using auxiliary spatial data in the transboundary Indus Basin. J. Hydrol. 2011, 405, 137–149. [Google Scholar] [CrossRef]
  16. Ghazanfari, S.; Pande, S.; Cheema, M.J.M.; Alizadeh, A.; Farid, A. The role of soil moisture accounting in estimation of soil evaporation and transpiration. J. Hydroinformatics 2016, 18, 329–344. [Google Scholar] [CrossRef] [Green Version]
  17. Guilloteau, C.; Roca, R.; Gosset, M. A multiscale evaluation of the detection capabilities of high-resolution satellite precipitation products in West Africa. J. Hydrometeorol. 2016, 17, 2041–2059. [Google Scholar] [CrossRef]
  18. Dembélé, M.; Zwart, S.J. Evaluation and comparison of satellite-based rainfall products in Burkina Faso, West Africa. Int. J. Remote Sens. 2016, 37, 3995–4014. [Google Scholar] [CrossRef] [Green Version]
  19. Pellarin, T.; Román-Cascón, C.; Baron, C.; Bindlish, R.; Brocca, L.; Camberlin, P.; Fernández-Prieto, D.; Kerr, Y.H.; Massari, C.; Panthou, G.; et al. The precipitation inferred from soil moisture (PrISM) near real-time rainfall product: Evaluation and comparison. Remote Sens. 2020, 12, 481. [Google Scholar] [CrossRef] [Green Version]
  20. Duan, Z.; Liu, J.; Tuo, Y.; Chiogna, G.; Disse, M. Evaluation of eight high spatial resolution gridded precipitation products in Adige Basin (Italy) at multiple temporal and spatial scales. Sci. Total Environ. 2016, 573, 1536–1553. [Google Scholar] [CrossRef] [Green Version]
  21. Derin, Y.; Anagnostou, E.; Berne, A.; Borga, M.; Boudevillain, B.; Buytaert, W.; Chang, C.H.; Delrieu, G.; Hong, Y.; Hsu, Y.C.; et al. Multiregional satellite precipitation products evaluation over complex terrain. J. Hydrometeorol. 2016, 17, 1817–1836. [Google Scholar] [CrossRef]
  22. Beaufort, A.; Gibier, F.; Palany, P. Comparison and correction of three satellite precipitation estimates products to improve flood prevention in French Guiana. EGUGA 2017, 19, 8270. [Google Scholar]
  23. Zubieta, R.; Getirana, A.; Espinoza, J.C.; Lavado-Casimiro, W.; Aragon, L. Hydrological modeling of the Peruvian-Ecuadorian Amazon basin using GPM-IMERG satellite-based precipitation dataset. Hydrol. Earth Syst. Sci. Discuss. 2016, 1–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Mourre, L.; Condom, T.; Junquas, C.; Lebel, T.; E Sicart, J.; Figueroa, R.; Cochachin, A. Spatio-temporal assessment of WRF, TRMM and in situ precipitation data in a tropical mountain environment (Cordillera Blanca, Peru). Hydrol. Earth Syst. Sci. 2016, 20, 125–141. [Google Scholar] [CrossRef] [Green Version]
  25. Paredes-Trejo, F.; Barbosa, H.; dos Santos, C.A.C. Evaluation of the performance of SM2RAIN-derived rainfall products over Brazil. Remote Sens. 2019, 11, 1113. [Google Scholar] [CrossRef] [Green Version]
  26. Sharifi, E.; Eitzinger, J.; Dorigo, W. Performance of the state-of-the-art gridded precipitation products over mountainous terrain: A regional study over Austria. Remote Sens. 2019, 11, 2018. [Google Scholar] [CrossRef] [Green Version]
  27. Forootan, E.; Khandu Awange, J.L.; Schumacher, M.; Anyah, R.O.; van Dijk, A.I.J.M.; Kusche, J. Quantifying the impacts of ENSO and IOD on rain gauge and remotely sensed precipitation products over Australia. Remote Sens. Environ. 2016, 172, 50–66. [Google Scholar] [CrossRef] [Green Version]
  28. Zhang, L.; Li, X.; Cao, Y.; Nan, Z.; Wang, W.; Ge, Y.; Wang, P.; Yu, W. Evaluation and integration of the top-down and bottom-up satellite precipitation products over mainland China. J. Hydrol. 2020, 581, 124456. [Google Scholar] [CrossRef]
  29. Xu, F.; Guo, B.; Ye, B.; Ye, Q.; Chen, H.; Ju, X.; Guo, J.; Wang, Z. Systematical Evaluation of GPM IMERG and TRMM 3B42V7 Precipitation Products in the Huang-Huai-Hai Plain, China. Remote Sens. 2019, 11, 697. [Google Scholar] [CrossRef] [Green Version]
  30. Mosaffa, H.; Shirvani, A.; Khalili, D.; Nguyen, P.; Sorooshian, S. Post and near real-time satellite precipitation products skill over Karkheh River Basin in Iran. Int. J. Remote Sens. 2020, 41, 6484–6502. [Google Scholar] [CrossRef]
  31. Ahmed, E.; Al Janabi, F.; Zhang, J.; Yang, W.; Saddique, N.; Krebs, P. Hydrologic assessment of TRMM and GPM-based precipitation products in transboundary river catchment (Chenab River, Pakistan). Water 2020, 12, 1902. [Google Scholar] [CrossRef]
  32. Anjum, M.N.; Ding, Y.; Shangguan, D.; Tahir, A.A.; Iqbal, M.; Adnan, M. Comparison of two successive versions 6 and 7 of TMPA satellite precipitation products with rain gauge data over Swat Watershed, Hindukush Mountains, Pakistan. Atmos. Sci. Lett. 2016, 17, 270–279. [Google Scholar] [CrossRef] [Green Version]
  33. Cheema, M.J.M.; Bastiaanssen, W.G.M. Local calibration of remotely sensed rainfall from the TRMM satellite for different periods and spatial scales in the Indus Basin. Int. J. Remote Sens. 2012, 33, 2603–2627. [Google Scholar] [CrossRef]
  34. Rahman, K.U.; Shang, S.; Shahid, M.; Wen, Y. An appraisal of dynamic bayesian model averaging-based merged multi-satellite precipitation datasets over complex topography and the diverse climate of Pakistan. Remote Sens. 2020, 12, 10. [Google Scholar] [CrossRef] [Green Version]
  35. Rahman, K.U.; Shang, S.; Shahid, M.; Wen, Y. Performance assessment of SM2RAIN-CCI and SM2RAIN-ASCAT precipitation products over Pakistan. Remote Sens. 2019, 11, 2040. [Google Scholar] [CrossRef] [Green Version]
  36. Anjum, M.N.; Ahmad, I.; Ding, Y.; Shangguan, D.; Zaman, M.; Ijaz, M.W.; Sarwar, K.; Han, H.; Yang, M. Assessment of IMERG-V06 precipitation product over different hydro-climatic regimes in the Tianshan Mountains, North-Western China. Remote Sens. 2019, 11, 2314. [Google Scholar] [CrossRef] [Green Version]
  37. Hussain, S.; Song, X.; Ren, G.; Hussain, I.; Han, D.; Zaman, M.H. Evaluation of gridded precipitation data in the Hindu Kush–Karakoram–Himalaya mountainous area. Hydrol. Sci. J. 2017, 62, 2393–2405. [Google Scholar] [CrossRef]
  38. Ahmad, I.; Zhang, F.; Tayyab, M.; Anjum, M.N.; Zaman, M.; Liu, J.; Farid, H.U.; Saddique, Q. Spatiotemporal analysis of precipitation variability in annual, seasonal and extreme values over upper Indus River basin. Atmos. Res. 2018, 213, 346–360. [Google Scholar] [CrossRef]
  39. Ur Rahman, K.; Shang, S.; Shahid, M.; Li, J. Developing an ensemble precipitation algorithm from satellite products and its topographical and seasonal evaluations over Pakistan. Remote Sens. 2018, 10, 1835. [Google Scholar] [CrossRef] [Green Version]
  40. Wang, X.; Ding, Y.; Zhao, C.; Wang, J. Similarities and improvements of GPM IMERG upon TRMM 3B42 precipitation product under complex topographic and climatic conditions over Hexi region, Northeastern Tibetan Plateau. Atmos. Res. 2019, 218, 347–363. [Google Scholar] [CrossRef]
  41. Chen, C.; Chen, Q.; Duan, Z.; Zhang, J.; Mo, K.; Li, Z.; Tang, G. Multiscale comparative evaluation of the GPM IMERG v5 and TRMM 3B42 v7 precipitation products from 2015 to 2017 over a climate transition area of China. Remote Sens. 2018, 10, 944. [Google Scholar] [CrossRef] [Green Version]
  42. Guo, H.; Chen, S.; Bao, A.; Hu, J.; Gebregiorgis, A.S.; Xue, X.; Zhang, X. Inter-comparison of high-resolution satellite precipitation products over Central Asia. Remote Sens. 2015, 7, 7181–7211. [Google Scholar] [CrossRef] [Green Version]
  43. Condom, T.; Rau, P.; Espinoza, J.C. Correction of TRMM 3B43 monthly precipitation data over the mountainous areas of Peru during the period 1998-2007. Hydrol. Process. 2011, 25, 1924–1933. [Google Scholar] [CrossRef]
  44. Brown, J.E.M. An analysis of the performance of hybrid infrared and microwave satellite precipitation algorithms over India and adjacent regions. Remote Sens. Environ. 2006, 101, 63–81. [Google Scholar] [CrossRef]
  45. Xu, R.; Tian, F.; Yang, L.; Hu, H.; Lu, H.; Hou, A. Ground validation of GPM IMERG and trmm 3B42V7 rainfall products over Southern Tibetan plateau based on a high-density rain gauge network. J. Geophys. Res. 2017, 122, 910–924. [Google Scholar] [CrossRef]
  46. Roebber, P.J. Visualizing multiple measures of forecast quality. Weather Forecast. 2009, 24, 601–608. [Google Scholar] [CrossRef] [Green Version]
  47. Rozante, J.R.; Vila, D.A.; Chiquetto, J.B.; Fernandes, A.D.A.; Alvim, D.S. Evaluation of TRMM/GPM blended daily products over Brazil. Remote Sens. 2018, 10, 882. [Google Scholar] [CrossRef] [Green Version]
  48. Hosseini-Moghari, S.M.; Tang, Q. Validation of gpm imerg v05 and v06 precipitation products over iran. J. Hydrometeorol. 2020, 21, 1011–1037. [Google Scholar] [CrossRef] [Green Version]
  49. Tan, M.L.; Santo, H. Comparison of GPM IMERG, TMPA 3B42 and PERSIANN-CDR satellite precipitation products over Malaysia. Atmos. Res. 2018, 202, 63–76. [Google Scholar] [CrossRef]
  50. Tan, M.L.; Ibrahim, A.L.; Duan, Z.; Cracknell, A.P.; Chaplot, V. Evaluation of six high-resolution satellite and ground-based precipitation products over Malaysia. Remote Sens. 2015, 7, 1504–1528. [Google Scholar] [CrossRef] [Green Version]
  51. Tarek, M.H.; Hassan, A.; Bhattacharjee, J.; Choudhury, S.H.; Badruzzaman, A.B.M. Assessment of TRMM data for precipitation measurement in Bangladesh. Meteorol. Appl. 2017, 24, 349–359. [Google Scholar] [CrossRef] [Green Version]
  52. Chiaravalloti, F.; Brocca, L.; Procopio, A.; Massari, C.; Gabriele, S. Assessment of GPM and SM2RAIN-ASCAT rainfall products over complex terrain in southern Italy. Atmos. Res. 2018, 206, 64–74. [Google Scholar] [CrossRef]
  53. Alijanian, M.; Rakhshandehroo, G.R.; Mishra, A.K.; Dehghani, M. Evaluation of satellite rainfall climatology using CMORPH, PERSIANN-CDR, PERSIANN, TRMM, MSWEP over Iran. Int. J. Climatol. 2017, 37, 4896–4914. [Google Scholar] [CrossRef]
  54. Barros, A.P.; Kim, G.; Williams, E.; Nesbitt, S.W. Probing orographic controls in the Himalayas during the monsoon using satellite imagery. Nat. Hazards Earth Syst. Sci. 2004, 4, 29–51. [Google Scholar] [CrossRef] [Green Version]
  55. Berg, W.; L’Ecuyer, T.; Kummerow, C. Rainfall climate regimes: The relationship of regional TRMM rainfall biases to the environment. J. Appl. Meteorol. Climatol. 2006, 45, 434–454. [Google Scholar] [CrossRef]
Figure 1. (a) The geographic extants of the study domain, and (b) topographic map of the study area and locations of the selected meteorological stations.
Figure 1. (a) The geographic extants of the study domain, and (b) topographic map of the study area and locations of the selected meteorological stations.
Remotesensing 12 03871 g001
Figure 2. Spatial variation of the observed average annual precipitation (from January 2010 to December 2017) over the Hindu Kush Mountains.
Figure 2. Spatial variation of the observed average annual precipitation (from January 2010 to December 2017) over the Hindu Kush Mountains.
Remotesensing 12 03871 g002
Figure 3. Comparison of the spatial variation of average daily precipitation acquired from the reference stations and four SPPs (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) from 2010 to 2017.
Figure 3. Comparison of the spatial variation of average daily precipitation acquired from the reference stations and four SPPs (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) from 2010 to 2017.
Remotesensing 12 03871 g003
Figure 4. Comparison of the temporal variability of average daily precipitation acquired from the reference meteorological stations and four SPPs. ((a) PERSIANN-CDR, (b) SM2Rain-ASCAT, (c) TRMM-3B42V7, and (d) IMERG-V06) over the Hindu Kush range from 2010 to 2017.
Figure 4. Comparison of the temporal variability of average daily precipitation acquired from the reference meteorological stations and four SPPs. ((a) PERSIANN-CDR, (b) SM2Rain-ASCAT, (c) TRMM-3B42V7, and (d) IMERG-V06) over the Hindu Kush range from 2010 to 2017.
Remotesensing 12 03871 g004
Figure 5. Taylor diagram demonstrating the performances of PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06 at a monthly scale. The values of RMSE are denoted by semi-circular lines (shown in green color) and values of CC are shown by the straight blue lines.
Figure 5. Taylor diagram demonstrating the performances of PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06 at a monthly scale. The values of RMSE are denoted by semi-circular lines (shown in green color) and values of CC are shown by the straight blue lines.
Remotesensing 12 03871 g005
Figure 6. Box plots of evaluation indices (a) CC, (b) BIAS, (c) RMSE), and (d) rBIAS at monthly scale for four satellite-based products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush range of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median. The blue lines show the linear trend of the mean values.
Figure 6. Box plots of evaluation indices (a) CC, (b) BIAS, (c) RMSE), and (d) rBIAS at monthly scale for four satellite-based products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush range of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median. The blue lines show the linear trend of the mean values.
Remotesensing 12 03871 g006
Figure 7. Taylor diagram displaying the performance of the daily precipitation estimates from TRMM-3B42V7, PERSIANN-CDR, SM2Rain-ASCAT, and IMERG-V06. Root mean square difference (RMSD) values are denoted by the semi-circular green line. The values of CC are represented by the straight (blue) lines.
Figure 7. Taylor diagram displaying the performance of the daily precipitation estimates from TRMM-3B42V7, PERSIANN-CDR, SM2Rain-ASCAT, and IMERG-V06. Root mean square difference (RMSD) values are denoted by the semi-circular green line. The values of CC are represented by the straight (blue) lines.
Remotesensing 12 03871 g007
Figure 8. Box plots of evaluation indices (a) CC, (b) BIAS, (c) RMSE), and (d) rBIAS at daily scale for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and horizontal lines inside the boxes indicate the median values.
Figure 8. Box plots of evaluation indices (a) CC, (b) BIAS, (c) RMSE), and (d) rBIAS at daily scale for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and horizontal lines inside the boxes indicate the median values.
Remotesensing 12 03871 g008
Figure 9. Scatter plots between the evaluation indices (CC, BIAS, rBIAS, and RMSE) on daily time scales versus elevation. Red markers represent the meteorological stations and dotted lines indicate the linear regression fitting lines.
Figure 9. Scatter plots between the evaluation indices (CC, BIAS, rBIAS, and RMSE) on daily time scales versus elevation. Red markers represent the meteorological stations and dotted lines indicate the linear regression fitting lines.
Remotesensing 12 03871 g009
Figure 10. Scatter plots between the evaluations indices (CC, BIAS, rBIAS, and RMSE) versus precipitation. Blue markers represent the meteorological stations and the dotted lines indicate the linear regression fitting lines.
Figure 10. Scatter plots between the evaluations indices (CC, BIAS, rBIAS, and RMSE) versus precipitation. Blue markers represent the meteorological stations and the dotted lines indicate the linear regression fitting lines.
Remotesensing 12 03871 g010
Figure 11. Spatial distribution of statistical performance evaluation measures calculated for four SPPs, at a daily scale.
Figure 11. Spatial distribution of statistical performance evaluation measures calculated for four SPPs, at a daily scale.
Remotesensing 12 03871 g011
Figure 12. Box plots of the seasonal values of (a) CC, (b) BIAS, and (c) RMSE for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median.
Figure 12. Box plots of the seasonal values of (a) CC, (b) BIAS, and (c) RMSE for four precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) over the Hindu Kush Mountains of Pakistan. Small squares denote the mean values and the horizontal lines inside the boxes indicate the median.
Remotesensing 12 03871 g012
Figure 13. Relative Bias (rBias: %) at seasonal scale for four satellite precipitation products for the entire study area. Horizontal dashed lines are used to represent the threshold (±10%) of rBias.
Figure 13. Relative Bias (rBias: %) at seasonal scale for four satellite precipitation products for the entire study area. Horizontal dashed lines are used to represent the threshold (±10%) of rBias.
Remotesensing 12 03871 g013
Figure 14. Performance diagram for representing the ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) in capturing the daily precipitation over the study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).
Figure 14. Performance diagram for representing the ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) in capturing the daily precipitation over the study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).
Remotesensing 12 03871 g014
Figure 15. Performance diagram for the precipitation detection ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at the seasonal basis ((a) Spring, (b) Summer, (c) Autumn, and (d) Winter) for the entire study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).
Figure 15. Performance diagram for the precipitation detection ability of four satellite products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at the seasonal basis ((a) Spring, (b) Summer, (c) Autumn, and (d) Winter) for the entire study area. The straight line indicates BIAS and the curved line indicates the critical success index (CSI).
Remotesensing 12 03871 g015
Figure 16. Probability density function (PDF) calculated for precipitation data acquired from the in-situ gauges and four satellite precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at different intensities. (a) Daily precipitation in the entire study period, (b) winter daily precipitation, (c) spring daily precipitation, (d) summer daily precipitation, and (e) autumn daily precipitation.
Figure 16. Probability density function (PDF) calculated for precipitation data acquired from the in-situ gauges and four satellite precipitation products (PERSIANN-CDR, SM2Rain-ASCAT, TRMM-3B42V7, and IMERG-V06) at different intensities. (a) Daily precipitation in the entire study period, (b) winter daily precipitation, (c) spring daily precipitation, (d) summer daily precipitation, and (e) autumn daily precipitation.
Remotesensing 12 03871 g016
Table 1. Salient features of the meteorological stations.
Table 1. Salient features of the meteorological stations.
Sr. No.StationLongitudeLatitudeAltitudeAverage Annual
(°)(°)(m)Precipitation (mm)
1Amandara71.9834.63664753.1
2Astore74.9035.372394359.7
3Balakot73.3534.389951301.6
4Bunji74.6335.671372179.0
5Chillas74.1035.421251171.2
6Chitral71.8335.851498432.2
7Dir71.8535.2014251303.1
8Drosh71.7835.571464509.9
9Gilgit74.3335.921460168.1
10Gupis73.4036.172156176.2
11Kakul73.2534.1813081273.6
12Kalam72.6035.472744904.1
13Khot72.5836.523505541.2
14Kohistan73.1935.32841924.8
15Lower Dir71.8234.83786876.3
16Naltar74.2736.222810675.7
17Naran73.6534.9023631824.8
18Pattan73.0335.107521091.3
19Peshawar71.5133.99362488.0
20Saidu Sharif72.3534.82961985.8
21Ushkore73.3636.023350286.7
22Yasin73.3036.633353296.2
23Zani Post72.1536.283000194.1
24Ziarat74.2836.833669773.9
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hamza, A.; Anjum, M.N.; Masud Cheema, M.J.; Chen, X.; Afzal, A.; Azam, M.; Kamran Shafi, M.; Gulakhmadov, A. Assessment of IMERG-V06, TRMM-3B42V7, SM2RAIN-ASCAT, and PERSIANN-CDR Precipitation Products over the Hindu Kush Mountains of Pakistan, South Asia. Remote Sens. 2020, 12, 3871. https://doi.org/10.3390/rs12233871

AMA Style

Hamza A, Anjum MN, Masud Cheema MJ, Chen X, Afzal A, Azam M, Kamran Shafi M, Gulakhmadov A. Assessment of IMERG-V06, TRMM-3B42V7, SM2RAIN-ASCAT, and PERSIANN-CDR Precipitation Products over the Hindu Kush Mountains of Pakistan, South Asia. Remote Sensing. 2020; 12(23):3871. https://doi.org/10.3390/rs12233871

Chicago/Turabian Style

Hamza, Ali, Muhammad Naveed Anjum, Muhammad Jehanzeb Masud Cheema, Xi Chen, Arslan Afzal, Muhammad Azam, Muhammad Kamran Shafi, and Aminjon Gulakhmadov. 2020. "Assessment of IMERG-V06, TRMM-3B42V7, SM2RAIN-ASCAT, and PERSIANN-CDR Precipitation Products over the Hindu Kush Mountains of Pakistan, South Asia" Remote Sensing 12, no. 23: 3871. https://doi.org/10.3390/rs12233871

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop