Nothing Special   »   [go: up one dir, main page]
Next Article in Journal
Case Studies on The Use of LiveLink for MATLAB for Evaluation and Optimization of The Heat Sources in Experimental Borehole
Previous Article in Journal
Humidity-Resistive Optical NO Gas Sensor Devices Based on Cobalt Tetraphenylporphyrin Dispersed in Hydrophobic Polymer Matrix
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 20
Issue 5
10.3390/s20051296
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimation of Crop Growth Parameters Using UAV-Based Hyperspectral Remote Sensing Data

by
Huilin Tao
1,2,
Haikuan Feng
1,3,4,*,
Liangji Xu
2,
Mengke Miao
1,3,
Huiling Long
1,3,4,
Jibo Yue
1,3,4,
Zhenhai Li
1,3,4,
Guijun Yang
1,3,4,
Xiaodong Yang
1,3,4 and
Lingling Fan
1,3
1
Key Laboratory of Quantitative Remote Sensing in Agriculture, Ministry of Agriculture and Rural Affairs, P. R. China, Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China
2
School of Geodesy and Geomatics, Anhui University of Science and Technology, Huainan 232001, China
3
National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
4
Beijing Engineering Research Center for Agriculture Internet of Things, Beijing 100097, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(5), 1296; https://doi.org/10.3390/s20051296
Submission received: 3 February 2020 / Revised: 25 February 2020 / Accepted: 26 February 2020 / Published: 27 February 2020
(This article belongs to the Section Remote Sensors)
Browse Figures
Figure 1
<p>Location of the test area. (<b>a</b>) location of Changping District in Beijing; (<b>b</b>) image of test area acquired by unmanned aerial vehicle (UAV).</p> "> Figure 2
<p>Experimental design. ZM175: winter-wheat variety Zhongmai 175; J9843: winter-wheat variety Jingmai 9843. N1, N2, N3, and N4 represent nitrogen treatments of 0, 195, 390, and 780 kg/ha, respectively.</p> "> Figure 3
<p>Relationship between ground-measured values of AGB (kg/m<sup>2</sup>) and LAI (m<sup>2</sup>/m<sup>2</sup>) in different growth stages of winter wheat and the values predicted based on vegetation indices (VIs) and stepwise regression (SWR): (<b>a</b>) AGB (jointing stage); (<b>b</b>) AGB (flagging stage); (<b>c</b>) AGB (flowering stage); (<b>d</b>) AGB (filling stage); (<b>e</b>) LAI (jointing stage); (<b>f</b>) LAI (flagging stage); (<b>g</b>) LAI (flowering stage); and (<b>h</b>) LAI (filling stage). <span class="html-italic">R<sup>2</sup></span>: coefficient of determination; RMSE: root-mean-square error; NRMSE: normalized RMSE.</p> "> Figure 4
<p>Relationship between ground-measured values of AGB (kg/m<sup>2</sup>) and LAI (m<sup>2</sup>/m<sup>2</sup>) in different growth stages of winter wheat and the values predicted based on VIs and PLSR: (<b>a</b>) AGB (jointing stage); (<b>b</b>) AGB (flagging stage); (<b>c</b>) AGB (flowering stage); (<b>d</b>) AGB (filling stage); (<b>e</b>) LAI (jointing stage); (<b>f</b>) LAI (flagging stage); (<b>g</b>) LAI (flowering stage); and (<b>h</b>) LAI (filling stage).</p> "> Figure 5
<p>Relationship between ground-measured values of AGB (kg/m<sup>2</sup>) and LAI (m<sup>2</sup>/m<sup>2</sup>) in different growth stages of winter wheat and the values based on a combination of VIs and red-edge parameters (RPs) and SWR: (<b>a</b>) AGB (jointing stage); (<b>b</b>) AGB (flagging stage); (<b>c</b>) AGB (flowering stage); (<b>d</b>) AGB (filling stage); (<b>e</b>) LAI (jointing stage); (<b>f</b>) LAI (flagging stage); (<b>g</b>) LAI (flowering stage); (<b>h</b>) LAI (filling stage).</p> "> Figure 6
<p>Relationship between ground-measured values of AGB (kg/m<sup>2</sup>) and LAI (m<sup>2</sup>/m<sup>2</sup>) in different growth stages of winter wheat and the values predicted based on a combination of VIs and RPs and PLSR: (<b>a</b>) AGB (jointing stage); (<b>b</b>) AGB (flagging stage); (<b>c</b>) AGB (flowering stage); (<b>d</b>) AGB (filling stage); (<b>e</b>) LAI (jointing stage); (<b>f</b>) LAI (flagging stage); (<b>g</b>) LAI (flowering stage); (<b>h</b>) LAI (filling stage).</p> "> Figure 7
<p>Maps showing the distribution of the estimated values of AGB (kg/m<sup>2</sup>) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (<b>a</b>) jointing stage; (<b>b</b>) flagging stage; (<b>c</b>) flowering stage.</p> "> Figure 8
<p>Maps showing the distribution of the estimated values of LAI (m<sup>2</sup>/m<sup>2</sup>) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (<b>a</b>) jointing stage; (<b>b</b>) flagging stage; (<b>c</b>) flowering stage.</p> ">
Versions Notes

Abstract

:
Above-ground biomass (AGB) and the leaf area index (LAI) are important indicators for the assessment of crop growth, and are therefore important for agricultural management. Although improvements have been made in the monitoring of crop growth parameters using ground- and satellite-based sensors, the application of these technologies is limited by imaging difficulties, complex data processing, and low spatial resolution. Therefore, this study evaluated the use of hyperspectral indices, red-edge parameters, and their combination to estimate and map the distributions of AGB and LAI for various growth stages of winter wheat. A hyperspectral sensor mounted on an unmanned aerial vehicle was used to obtain vegetation indices and red-edge parameters, and stepwise regression (SWR) and partial least squares regression (PLSR) methods were used to accurately estimate the AGB and LAI based on these vegetation indices, red-edge parameters, and their combination. The results show that: (i) most of the studied vegetation indices and red-edge parameters are significantly highly correlated with AGB and LAI; (ii) overall, the correlations between vegetation indices and AGB and LAI, respectively, are stronger than those between red-edge parameters and AGB and LAI, respectively; (iii) Compared with the estimations using only vegetation indices or red-edge parameters, the estimation of AGB and LAI using a combination of vegetation indices and red-edge parameters is more accurate; and (iv) The estimations of AGB and LAI obtained using the PLSR method are superior to those obtained using the SWR method. Therefore, combining vegetation indices with red-edge parameters and using the PLSR method can improve the estimation of AGB and LAI.

1. Introduction

Crop growth can also reflect soil conditions, nutritional status [1]. Above-ground biomass (AGB) and the leaf area index (LAI) are two of the main crop growth parameters, and play important roles in monitoring crop growth in agricultural management [2,3]. The timely and accurate estimation of crop growth parameters can provide a strong basis for the formulation of timely agricultural policies and food trade, and can also allow the estimation of the loss of crop yield caused by meteorological disasters and pests. Additionally, the accurate estimation of growth parameters can improve the accuracy of growth monitoring but also of growth modeling [4,5]. However, the traditional method of measuring crop growth parameters is destructive to crops [6], requires large amounts of manpower, material resources, and time, and has a small application range.
Remote sensing technology has attracted attention as a way to better estimate crop growth parameters due to its ability to provide timely, dynamic, macro-scale observations. This method involves estimating crop growth parameters using spectral data of the crop canopy [7,8], and has been widely applied [9,10,11,12]. Remote sensing technology is divided into ground-based, low-altitude, and high-altitude. For ground-based remote sensing, non-imaging ground-feature spectrometers are usually used. Due to the limited height of the platform, ground-feature spectrometers and cannot easily be used to generate orthophotos. Meanwhile, satellites can acquire image data over large areas, providing data with very high spatial resolution; however, they have long operating cycles, are affected by changes in weather and cloud cover, and high maintenance and operation costs. Low-altitude unmanned aerial vehicle (UAV) platforms are simple to operate, and have a higher spatial resolution than satellites [13,14,15,16,17,18,19,20]. Additionally, the flight requirements of UAVs are simpler than those of aircraft. UAV-based remote sensing technology has been applied in farmland management. The spectral parameters obtained from UAV-based cameras can be used to estimate crop growth parameters. At present, the sensors which are carried by UAVs are mostly Red-Green-Blue cameras and multispectral cameras, and, due to the small number of sensor bands in such cameras, the acquired spectral information is limited [21,22]. However, using hyperspectral sensors, which have more bands, more spectral data related to crop growth parameters can be obtained, thereby allowing a better estimation of growth parameters [23,24,25,26,27,28,29,30].
Vegetation indices (VIs) are obtained using a combination of two or more spectral bands. Usually, the spectral bands are combined mathematically. VIs can simply and effectively reflect the status of vegetation, and are widely used to estimate vegetation structure and physiological characteristics such as ground biomass, the LAI, and chlorophyll content. [6,9,10,31,32]. Based on crop characteristics and environmental impacts, researchers have developed many VIs to estimate crop growth parameters. For example, the optimized soil-adjusted vegetation index (OSAVI) has been used to obtain accurate estimates of the LAI [32]. Furthermore, the linear combination index (LCI) has been shown to allow accurate estimates of AGB [6]. Accurate estimates of crop parameters have also been obtained using a combination of a vegetation index and different methods. For example, Koppe et al. [33] used multiple regression to estimate winter-wheat biomass using VIs and microwave coefficients as estimation model factors, and obtained accurate results. Moreover, Jin et al. [34] used a VI and radar parameter to accurately estimate the LAI and biomass of winter wheat using partial least squares regression (PLSR). Additionally, it is possible to monitor crop growth using hyperspectral data from UAVs [35].
Compared with RGB and multispectral cameras, hyperspectral cameras can obtain more waveband information and can therefore better reflect the physiological and biochemical information of crops. However, the sensitivity of the waveband information obtained by hyperspectral sensors is different from the sensitivity of the crop growth parameters. Therefore, the reflectance of vegetation varies in different waveband ranges. For example, due to the absorption of chlorophyll and scattering by leaves and the canopy, the spectral reflectance of vegetation increases rapidly from a low value to a high value in the range of 670–750 nm, which is called the “red edge” band. The reflectance behavior in the red-edge band is very different from that in other bands [36]. Additionally, since this band contains a large amount of crop information, it can be used to estimate crop growth parameters.
Many of the abovementioned studies used UAV-based remote sensing data to estimate crop growth parameters such as AGB and the LAI. However, these studies only used VIs or a combination of VIs and analytical methods to estimate crop growth parameters. Meanwhile, very few studies have conducted in-depth investigations of spectral bands information to explore the impact of spectral information on the estimation of growth parameters. Therefore, the purpose of this study was to evaluate the estimation of the AGB and LAI of winter wheat during multiple growth stages using VIs, red-edge parameters, and their combination. Specifically, we (i) estimated the AGB and LAI using only VIs, only red-edge parameters, and a combination of VIs and red-edge parameters; (ii) compared the use of stepwise regression (SWR) and partial least squares regression (PLSR) to estimate the AGB and LAI; and (iii) combined VIs and red-edge parameters to estimate and map the distribution of AGB and LAI over multiple growth stages. The structure of this article is as follows: Section 1 introduces the research area and experimental design, ground data acquisition and processing, and acquisition and processing of UAV-based hyperspectral data. Selection of vegetation indices and red-edge parameters are also discussed; Section 2 introduces the results and analysis described above; and Section 3 and Section 4 present a discussion and conclusions, respectively.

2. Materials and Methods

2.1. Research Area and Experimental Design

The research area is located in the National Precision Agriculture Research Demonstration Base in Xiaotangshan Town, Changping District, Beijing, China (40°10′48″–40°10′54″ N, 116°26′51″–116°26′53″ E, average altitude of about 36 m a.s.l.). The area has a warm temperate and semi-humid continental monsoon climate, with precipitation mostly occurring in summer and autumn, an average annual precipitation of about 42 mm, an average annual temperature of about 11.8 °C, and a large temperature difference between day and night. The previously planted crops were corn, and the soil type was fluvo-aquic, which was relatively fertile. The test area is shown in Figure 1.
Winter wheat was planted in 48 plots, each of which had an area of 48 m2. In order to increase the crop diversity of each experimental plot, two winter wheat varieties—Zhongmai 175 and Jingmai 9843—were selected; Zhongmai 175 was selected by the Chinese Academy of Agricultural Sciences, and Jingmai 9843 was selected by the Beijing Municipal Bureau of Agriculture. Different nitrogen and water treatments were used in each plot. Four nitrogen treatments were used—0 kg/ha (N1), 195 kg/ha (N2), 390 kg/ha (N3), and 780 kg/ha (N4)—and three water treatments were used—rainwater only (W0), rainwater plus normal irrigation (100 mm; W1), and rainwater plus twice normal irrigation (200 mm; W2). The planting density was 489 plants/m2. The specific test design is shown in Figure 2.
Remote sensing data were collected during four growth stages of winter wheat using a UAV carrying a hyperspectral sensor (see Section 2.3). Additionally, ground-based data acquisition was also carried out during each of these four stages (see Section 2.2). The ground-based and UAV-based data were acquired simultaneously on the same four days, corresponding to the winter-wheat jointing stage (21 April 2015), flag picking stage (26 April 2015), flowering stage (13 May 2015), and filling stage (22 May 2015).

2.2. Ground Data Acquisition and Processing

2.2.1. Calculation of Leaf Area Index (LAI)

To measure the LAI, a total of 20 plants were harvested from each plot near the uniform growth area of the plot, and the total number of plants and the line spacing in the sampling area were measured. The samples were placed in a sealed paper bag and transported to a laboratory in the test base. In the laboratory, the stems and leaves were separated and all the leaves were placed on A4 paper. Then, the total area of each leaf was measured using a CI-203 Handheld Laser Leaf Area Meter (CID Bio-Science, Inc., Camas, WA, USA). Then, using this data, the LAI was obtained based on the counted number of single stems and the total number of stems per unit area in the sample plots.

2.2.2. Calculation of Above-Ground Biomass (AGB)

After calculating the LAI, the leaves and stems were placed in a paper bag, and the fresh biomass of the samples was measured using a high-precision balance (accuracy of 0.001 g). Then, the paper bag was placed in an oven at 80 ° C for 24 h to a constant mass state, and the sample was then weighed to determine the dry mass. Finally, the AGB was calculated by dividing the obtained dry mass by the surface area of the sample.

2.3. Acquisition and Processing of UAV-Based Hyperspectral Data

Hyperspectral data were acquired on cloudless and windless days. The UAV platform used was a DJI S1000 UAV (SZ DJI Technology Co., Ltd., Sham Chun, Guangdong, China). The UAV has eight propellers, is equipped with two 18,000-mAh (25 V) batteries with a battery life of 30 min, and can maintain stability at low speed and low altitude; for the acquisition, the take-off mass was 6 kg, the flight altitude was 80 m, and the flight speed was 8 m/s.
The hyperspectral sensor carried by the UAV was a UHD 185-Firefly (Cubert GmbH, Ulm, Baden-Würtemberg, Germany), hereafter referred to as UHD185. The UHD185 is a full-frame non-scanning real-time imaging spectrometer with dimensions of 195 mm × 67 mm × 60 mm and a weight of 470 g. It acquires wavelengths from the visible to the near-infrared (450–950 nm) from 125 spectral bands, and can collect full-color images. The sampling interval of the hyperspectral data is 4 nm (Table 1). Atmospheric correction is generally required for remote sensing hyperspectral images; however, since the hyperspectral images obtained in this study were acquired under stable lighting conditions, atmospheric correction was not required. Following data acquisition, the Cubert Cube-Pilot software version 1.4 (Cubert GmbH) was used to perform two types of data (full-color images and hyperspectral cubes) fusion to form the hyperspectral images. The process of radiation correction involves converting the digital number (DN) value of the hyperspectral image to the surface reflectance [37]. Then, the Agisoft PhotoScan Professional version 1.1.6 software (Agisoft LLC, St. Petersburg, Russia) was used to stitch images [38].

2.4. Selection of Vegetation Indices and Red-Edge Parameters

2.4.1. Selection of Vegetation Indices

The results of a large number of studies have shown that many vegetation indices are closely related to AGB and LAI. This study investigated the relationship between 20 VIs and AGB and LAI, the definitions of these VIs are shown in Table 2.

2.4.2. Selection of Red-Edge Parameters

This study used five red-edge parameters: red edge position (REP), red edge amplitude (Dr), red edge area (SDr), minimum red-edge amplitude (Drmin), and the ratio of the red edge amplitude and the minimum red-edge amplitude (Dr/Drmin). The red-edge parameters were calculated according to the maximum first derivative [56,57,58]. REP is the wavelength of the maximum spectral reflectance curve slope, that is, the wavelength of the maximum first derivative of the spectrum in the range of 680–750 nm [56]; Dr is the first derivative of the red-edge position [57]; SDr is the sum of the first derivative of the spectrum of the red-edge region [58]; and Drmin is the value of the minimum red-edge amplitude [57].

2.4.3. Analysis Methods

SWR is a type of linear regression. When there are many independent variables, some of the factors may not have a large impact on the variables, and the independent variables may not be completely independent of each other. When introducing new variables, the previous model must be tested, insignificant variables must be eliminated, and this process must be repeated until new variables are not introduced. Additionally, the more independent variables the regression equation contains, and the smaller the error of the predicted value. If the equation has too many variables, the workload of forecasting will be greater, and if some of the predictors are not significantly correlated it will affect the accuracy of the prediction. Therefore, it is particularly important to choose the appropriate number of variables. PLSR is a combination of multiple linear regression, canonical correlation analysis, and principal component analysis. Models established using PLSR have advantages over traditional classical regression analysis, since in the PLSR method the best model is constructed by minimizing the sum of squares of errors [59]. In this study, PLSR was performed using the MATLAB 2018a software (MathWorks, Natick, MA, USA).

2.4.4. Accuracy Evaluation

A total of 48 datasets (i.e., one for each plot) was obtained for each growth stage, with each dataset consisting of ground-measured and UAV-measured data. For the data analysis, 2/3 (32) of these datasets were used as the modeling set to build the model, and the remaining 1/3 (16) were used to validate the model. The accuracy of the AGB and LAI estimation models were evaluated using the coefficient of determination (R2), root-mean-square error (RMSE), and the normalized RMSE (NRMSE) [6]; a larger R2 indicates a better model fit, while a smaller RMSE and NRMSE indicate a higher model accuracy. The values of R2, RMSE, and NRMSE were calculated using Formulas (1), (2), and (3), respectively:
R 2 = 1 − ∑ i = 1 n ( x i − y i ) 2 ∑ i = 1 n ( x i − x ¯ ) 2
R M S E = ∑ i = 1 n ( y i − x i ) 2 n
N R M S E ( % ) = R M S E X ¯
where x i is the measured AGB or LAI for winter wheat, x   ¯ is the average measured AGB or LAI, y i is the AGB or LAI predicted by the model, and n is the number of data points.

3. Results and Analysis

3.1. Correlation Analysis between Vegetation Indices and Red-Edge Parameters and AGB and the LAI

Correlation analysis was performed between the ground-measured AGB and LAI and (i) the 20 VIs and (ii) the five red-edge parameters, for different winter-wheat growth stages. The results are shown in Table 3. As shown in the table, for most of the VIs and red-edge parameters, the correlations with AGB and the LAI are significant at the p < 0.01 level. The correlation coefficients for both the VIs and the red-edge parameters are significantly different between the four growth stages; overall, the correlations between both AGB and the LAI and the VIs and red-edge parameters are stronger in the flowering stage than in the other three growth stages. The correlation between the vegetation indices and the red-edge parameters reached the highest, and the correlation at the filling stage began to be weak. Furthermore, the correlations between AGB and the VIs and red-edge parameters are significantly different to the correlations between the LAI and the VIs and red-edge parameters. For example, for the jointing stage, the correlation coefficients for AGB and the LAI are similar, with the most strongly correlated VI being the PBI and the most strongly correlated red-edge parameter being REP. For the flagging stage, the correlations between AGB and the VIs and red-edge parameters are stronger than those between the LAI and the VIs and red-edge parameters; for both AGB and LAI, the most strongly correlated VI is the LCI, and the most strongly correlated red-edge parameter is Dr/Drmin. For the flowering stage, stronger correlations are observed between AGB and the VIs and red-edge parameters than between the LAI and the VIs and red-edge parameters; for both AGB and the LAI, the most strongly correlated VI is the PBI and the most strongly correlated red-edge parameter is Dr. In general, for the filling stage, the correlations between the LAI and the VIs and red-edge parameters are stronger than those between AGB and the VIs and red-edge parameters; for AGB, the most strongly correlated VI and red-edge parameter is the LCI and Dr, respectively, while, for the LAI, the most strongly correlated VI and red-edge parameter is the PBI and Dr/Drmin, respectively.

3.2. Relationship between Vegetation Indices and Red-Edge Parameters and AGB and LAI

3.2.1. Estimation of AGB and LAI Using Vegetation Indices

A simple linear regression method was used to establish linear models between the studied VIs and the winter-wheat AGB and LAI, and the optimal vegetation index was selected for each growth stage based on the evaluation of the model performances (Table 4). For the modeling dataset, between the jointing stage and the flowering stage, the R2 values of the models using the optimal VI increased from 0.47 to 0.70, and the NRMSE values decreased from 20.54 to 14.19%. Additionally, for the validation dataset, between the same growth stages, the R2 values of the models using the optimal VI increased from 0.60 to 0.72, and the NRMSE values decreased from 14.22 to 12.02%. That is, using the optimal VIs, the accuracy of the AGB estimates progressively improves between the jointing stage and the flowering stage. Meanwhile, between the flowering stage and the filling stage, the R2 values of AGB estimates for the modeling dataset decreased from 0.70 to 0.45, while the R2 values of AGB estimates for the validation dataset decreased from 0.72 to 0.65. Meanwhile, between the same two stages, the NRMSE of AGB estimates for the modeling dataset increased from 14.19 to 19.30%, while the NRMSE of AGB estimates for the validation dataset increased from 12.02 to 14.18%. For the LAI estimates, the R2 values for the modeling dataset were similar between the jointing stage and the flagging stage, and the NRMSE values for the modeling dataset increased from 17.65 to 24.75% between the same two stages. From the flowering stage to the filling stage, for the modeling dataset, R2 decreases from 0.65 to 0.63 and the NRMSE increases from 20.76 to 32.55%, that is, the model’s LAI estimation ability decreases.

3.2.2. Estimation of AGB and LAI Using Red-Edge Parameters

As described above for the VIs, linear regression analysis was used to determine the optimal red-edge parameters for the estimation of AGB and LAI for each growth stage. The R2, RMSE, and NRMSE values for the optimal red-edge parameters are shown in Table 5. For AGB, for the modeling dataset, the estimation progressively improves from the jointing stage to the flowering stage, with R2 increasing from 0.49 to 0.62 and NRMSE decreasing from 22.57 to 16.04%, while, for the validation dataset, R2 increases from 0.45 to 0.70 and NRMSE decreases from 16.87 to 12.46%. Meanwhile, for the modeling dataset, the estimation progressively worsens between the flowering stage and the filling stage, with R2 decreasing from 0.62 to 0.45 and NRMSE increasing from 16.04 to 19.29%, while for the validation dataset R2 decreased from 0.70 to 0.48 and NRMSE increased from 12.46 to 17.32%. From the jointing stage to the flagging stage, the LAI estimation ability decreases: for the modeling dataset, R2 decreases from 0.57 to 0.51 and the NRMSE increases from 17.24 to 25.37%. Meanwhile, from the flagging stage to the filling stage, for the modeling dataset, the R2 increases from 0.51 to 0.66 and the RMSE decreases from 1.16 to 0.53 kg/ha, the NRMSE increases from 25.37% to 31.09%. that is, the LAI estimation ability is enhanced. These results show that the estimation of AGB using red-edge parameters is superior to the estimation of LAI using these parameters.

3.2.3. Estimation of AGB and LAI Using Combinations of Vegetation Indices and Red-Edge Parameters

For each growth stage, a combination of the optimal VI and red-edge parameter for that growth stage (see Table 4 and Table 5) was used to estimate AGB and LAI. The results are shown in Table 6. As can be seen from a comparison between Table 4 and Table 5 and Table 6, the combinations of the optimal VI and red-edge parameter improved the estimation accuracy of AGB and LAI; the accuracy was improved by a small margin for the flagging and flowering stages, and was improved more significantly for the jointing and filling stages. For AGB, for the modeling dataset, the most accurate estimation was obtained in the flowering stage, the estimation accuracy increases progressively between the jointing stage and the flowering stage, and the estimation accuracy decreases between the flowering stage and the filling stage. For the estimation of LAI, for the modeling dataset, between the jointing stage and the flagging stage, R2 decreased from 0.61 to 0.55 and the NRMSE increased from 16.42 to 24.33%; that is, the estimation worsened between these stages. Meanwhile, between the flagging stage and the filling stage, R2 increased progressively from 0.55 to 0.69; however, the NRMSE also increased, from 24.33 to 29.94%, indicating a reduced estimation ability between these stages.

3.3. Estimating AGB and LAI Using Vegetation Indices and Red-Edge Parameters Combined with SWR and PLSR

Additionally, in order to assess the performances of SWR and PLSR for estimating crop parameters, the AGB and LAI were estimated for the different growth stages using (i) selected VIs, (ii) selected red-edge parameters, and (iii) a combination of selected VIs and red-edge parameters, using both the SWR and PLSR methods, respectively. As shown in Table 3, when building the model, the use of too many independent variables will lead to overfitting, and it is therefore necessary to ensure that an appropriate number of independent variables are used in the model, and that these variables have a high correlation. In order to achieve this, in this study, for each growth stage, we selected the seven vegetation indices and two red-edge parameters with the highest correlation coefficients. For the estimation of AGB, the following seven vegetation indices and two red-edge parameters were selected for each growth stage. For the jointing stage, the VIs PBI, LCI, PSSR, RARS, PSND, WDRVI, and MSR were chosen, and the red-edge parameters REP and Dr/Drmin were chosen. For the flagging stage, the VIs LCI, PSRI, WDRVI, MSR, PBI, NDVI, and SR were chosen, and the red-edge parameters Dr/Drmin and Dr were chosen. For the flowering stage, the VIs PBI, SR, PSSR, RARS, MSR, SPVI, and EVI2 were chosen, and the red-edge parameters Dr and SDr were chosen. Finally, for the filling stage, the VIs LCI, PBI, EVI2, PSSR, MSR, RDVI, and WDRVI were chosen, and the red-edge parameters Dr and SDr were chosen. Additionally, for the estimation of the LAI, the following seven vegetation indices and two red-edge parameters were also selected for each growth stage. For the jointing stage, the VIs PBI, LCI, PSSR, RARS, WDRVI, PSND, and MSR were chosen, and the red-edge parameters REP and Dr/Drmin were chosen. For the flagging stage, the VIs LCI, PSSR, SR, RARS, MSR, PBI, and WDRVI were chosen, and the red-edge parameters Dr/Drmin and Dr were chosen. For the flowering stage, the VIs PBI, PSSR, RARS, SR, MSR, LCI, and SPVI were chosen, and the red-edge parameters Dr and SDr were chosen. Finally, for the filling stage, the VIs PBI, LCI, WDRVI, MSR, SR, PSSR, and RARS were chosen, and the red-edge parameters Dr/Drmin and Dr were chosen. The results are shown in Table 7 and Table 8 and Figure 3, Figure 4, Figure 5 and Figure 6. As shown in Table 7, for the modeling dataset and using the VIs, the best AGB estimation was obtained for the flowering stage for both the SWR and PLSR methods (SWR: R2 = 0.74, RMSE = 0.11 kg/m2, NRMSE = 13.32%; PLSR: R2 = 0.78, RMSE = 0.10 kg/m2, NRMSE = 12.26%); meanwhile, for the LAI, the estimation accuracy varies greatly between growth stages, with R2 showing an upward trend between the jointing stage and the filling stage for both the SWR and PLSR methods; although the highest R2 value is obtained for the filling stage when using the PLSR method, when considering all three accuracy metrics together, the best estimation of LAI is obtained during the flowering stage for both the SWR and PLSR methods.
Table 8 shows the estimates of AGB and LAI obtained using a combination of VIs and RPs using the SWR and PLSR methods, respectively. The results show that this estimation approach is superior to the approaches using either the VIs and RPs for both the SWR and PLSR methods. As shown in the table, the most accurate estimates were obtained for the flowering stage. For the SWR method, the largest R2 value is 0.77 (AGB, flowering stage), and for the PLSR method the largest R2 value is 0.80 (AGB, flowering stage). For the LAI estimates, the R2 and NMRSE values tend to increase from the jointing stage to the filling stage, with the highest values of NMRSE being obtained for the filling stage for both the SWR and PLSR method and the highest values of R2 being obtained for the flowering stage and filling stage for the SWR and PLSR methods, respectively.
In order to evaluate the effect of the models constructed using SWR and PLSR, the validation dataset was used to verify (i) the selected VIs, (ii) the selected red-edge parameters, and (iii) a combination of the selected VIs and the selected red-edge parameters. The results for the validation dataset are shown in Figure 3, Figure 4, Figure 5 and Figure 6. These results show that, compared with the estimation based on VIs only (Figure 3 and Figure 4), the estimation based on a combination of VIs and RPs is superior (Figure 5 and Figure 6).
The results show that using either the SWR or PLSR methods can significantly improve the accuracy of the estimation of AGB and LAI (Table 5 and Table 6). Additionally, in the four growth stages of winter wheat, the fit, accuracy, and model stability of the estimates of AGB and LAI obtained using the PLSR method are superior to those of the estimates obtained using the SWR method.

3.4. Construction of Spatial Distribution Map of AGB and LAI

By comparing the AGB and LAI estimation models at different growth stages, it is found that the model using the PLSR method and a combination of VIs and RPs as model factors achieves the best estimation results. Therefore, this model was used to construct AGB and LAI distribution maps.
Maps showing the estimated spatial distribution of AGB in the winter-wheat jointing, flagging, and flowering stages is shown in Figure 7. As can be seen in the figure, from the jointing stage to the flowering stage, the estimated values of AGB gradually increase. In the jointing stage, the estimated AGB ranges from 0 to 0.5 kg/m2, with most values falling in the range 0 to 0.3 kg/m2. During the flagging stage, the estimated AGB ranges from 0 to 0.7 kg/m2. During the flowering stage, the estimated AGB ranges from 0 to 1.3 kg/m2, with most values falling in the range 0.5 to 1.3 kg/m2.
Similarly, the spatial distribution of LAI in the winter-wheat jointing, flagging, and flowering stages based on VIs and RPs and using the PLSR method is shown in Figure 8. As shown in the figure, the estimated LAI values increase between the jointing stage and the flagging stage, but decrease between the flagging stage and the flowering stage.

4. Discussion

4.1. Estimation of AGB and LAI Based on Vegetation Indices

In this work, the optimal VIs for the estimation of the AGB and LAI of winter wheat were determined for each growth stage. It was found that, from the jointing stage to the flowering stage, the optimal VIs for the estimation of AGB and LAI were the same for each growth stage, namely PBI for the jointing stage, LCI for the flagging stage, and PBI for the flowering stage. In the filling stage, the optimal VIs for the estimation of AGB and LAI were LCI and PBI, respectively. These findings show that the sensitivity of VIs to AGB and LAI is closely related to the crop growth stage. The PBI is constructed using wavelengths of 560 and 810 nm, while the LCI is constructed using wavelengths of 670, 710, and 850 nm. That is, both the PBI and LCI use visible and near-infrared wavelengths, and therefore contain the characteristics of vegetation at these wavelengths. Rama et al. [41] used the PBI to improve the inversion of the chlorophyll and nitrogen concentrations of crops. The present study proves that the PBI can also be used to obtain good estimates of crop AGB and LAI. Yue et al. [6] found that the LCI can be used to accurately invert AGB and LAI during the crop growth stage. Consistent with these findings, in the present study, the LCI was also found to have a strong estimation ability for AGB and LAI in different growing seasons, and was found to be the optimal vegetation index in multiple growing seasons. During growth, most photosynthetic products are stored in stems and leaves [60], which means that some VIs cannot be used to accurately estimate AGB. Therefore, determining the sensitivity of VIs to AGB and LAI in different growth stages is very important for the estimation of crop parameters based on UAV hyperspectral images.

4.2. Estimation of AGB and LAI Based on Red-Edge Parameters

Due to the effects of leaf scattering and chlorophyll absorption in the red-edge region (670–750 nm), the spectral reflectance changes dramatically from low to high in this region [38]. In this study, it was found that, in the first three growth stages of winter wheat, the optimal red-edge parameters for the estimation of AGB and LAI were the same for each growth stage, namely REP for the jointing stage, Dr/Drmin for the flagging stage, and REP for the flowering stage. In the filling stage, the optimal red-edge parameters for the estimation of AGB and LAI are REP and Dr/Drmin, respectively. The results show that, as for VIs, the optimal red-edge parameters for the estimation of winter-wheat AGB and LAI differ between growth stages. Gao et al. [61] found that red-edge parameters are less effective than the vegetation indices for estimating the LAI. This result is consistent with the findings of this study. The reason for this phenomenon is that, due to the spectral resolution of the sensor, the red-edge region has a strong sensitivity to crop parameters. The calculation of red-edge parameters requires a sensor with a high spectral resolution [62,63]. Additionally, the measurement of these parameters is affected to a certain extent by the pigment content of leaves. It is necessary to further study the connection between RPs and crop parameters.

4.3. Estimation of AGB and LAI Based on Vegetation Indices and Red-Edge Parameters

In this study, it was found that, although estimations of AGB and LAI based on red-edge parameters alone were inferior to those based on VIs alone, estimations of AGB and LAI based on a combination of VIs and red-edge parameters were superior to those based on only VIs or only red-edge parameters (Table 4, Table 5 and Table 6). Furthermore, using this combined approach, higher estimation accuracy was obtained for AGB than for LAI. AGB reflects the canopy coverage of the crop. As the crop grows, AGB increases from the jointing to the filling stage; meanwhile, LAI is related to AGB and water content [23,64]. From the jointing stage to the filling stage, LAI first increases and then decreases.

4.4. AGB and LAI Estimation Performance of Regression Methods

As shown in Table 7 and Table 8, the estimates of AGB and LAI obtained using a combination of VIs and red-edge parameters and using either the SWR and PLSR methods are more accurate than the estimates obtained using the optimal vegetation indices or the optimal red-edge parameters. Of the two regression methods, overall, the PLSR method obtained superior estimates of the two crop parameters. Additionally, it was found that the validation results were acceptable and consistent with the performance of the modeling (Figure 3, Figure 4, Figure 5 and Figure 6). The superior performance of the PLSR method observed in this study is consistent with previous results. For example, Yue et al. [65] used the PLSR regression technique to estimate the AGB of winter wheat, and obtained accurate estimates, while Fan et al. [66] improved the accuracy of nitrogen content estimation using PLSR. As the PLSR method uses principal component analysis, and can solve the problem of collinearity among multiple variables. Therefore, a model based on VIs, red-edge parameters, and the PLSR method was used in order to produce estimated distribution maps of AGB and LAI for the 48 study plots. The estimated values are consistent with the ground-measured values, indicating that the model is reliable.

5. Conclusions

In this work, UAV-based hyperspectral remote sensing images were used to estimate the AGB and LAI of winter wheat at different growth stages based on vegetation indices, red-edge parameters, and their combination. It was found that the estimates obtained using a combination of vegetation indices and red-edge parameters were superior to those obtained using a single vegetation index or red-edge parameter. Furthermore, it was found that the estimates obtained using a combination of vegetation indices and red-edge parameters and either the SWR or PLSR methods were more accurate than those obtained using linear regression and only vegetation indices or red-edge parameters, and that the PLSR method obtained higher accuracy and stability than the SWR method.

Author Contributions

Conceptualization, H.T., H.F., L.X., and Z.L.; data curation, M.M., H.L., G.Y., and X.Y.; formal analysis, H.T.; investigation, H.T., H.F., L.X., M.M., J.Y., H.L., Z.L., and L.F.; methodology, H.T.; resources, L.F.; writing—original draft, H.T. and H.F.; writing—review and editing, L.X., J.Y., Z.L., and X.Y. All authors have read and agreed to the published version of the manuscript.

Funding

The study was funded by the National Key Research and Development Program (2016YFD070030303) and the National Science Foundation of China (41601346, 41871333, 41501481, 61661136003, 41771370, 41471285, 41471351).

Acknowledgments

We appreciate the help from Hong Chang and Weiguo Li during field data collection and thank all employees of the Xiao Tangshan National Precision Agriculture Research Center.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yang, B.; Pei, Z. Definition of crop condition and crop monitoring using remote sensing. Nongye Gongcheng Xuebao Trans. Chin. Soc. Agric. Eng. 1999, 15, 214–218. [Google Scholar]
  2. Li, X.; Zhang, Y.; Luo, J.; Jin, X.; Xu, Y.; Yang, W. Quantifification winter wheat LAI with HJ-1CCD image features over multiple growing seasons. Int. J. Appl. Earth Obs. Geoinf. 2016, 44, 104–112. [Google Scholar] [CrossRef]
  3. Liu, B.; Asseng, S.; Wang, A.; Wang, S.; Tang, L.; Cao, W.; Zhu, Y.; Liu, L. Modelling the effects of post-heading heat stress on biomass growth of winter wheat. Agric. For. Meteorol. 2017, 247, 476–490. [Google Scholar] [CrossRef]
  4. Huang, J.; Sedano, F.; Huang, Y.; Ma, H.; Li, X.; Liang, S.; Tian, L.; Zhang, X.; Fan, J.; Wu, W. Assimilating a synthetic Kalman fifilter leaf area index series into the WOFOST model to improve regional winter wheat yield estimation. Agric. For. Meteorol. 2016, 216, 188–202. [Google Scholar] [CrossRef]
  5. Launay, M.; Guerif, M. Assimilating remote sensing data into a crop model to improve predictive performance for spatial applications. Agric. Ecosyst. Environ. 2005, 111, 321–339. [Google Scholar] [CrossRef]
  6. Yue, J.; Feng, H.; Jin, X.; Yuan, H.; Li, Z.; Zhou, C.; Yang, G.; Tian, Q. A comparison of crop parameters estimation using images from UAV-mounted snapshot hyperspectral sensor and high-definition digital camera. Remote Sens. 2018, 10, 1138. [Google Scholar] [CrossRef] [Green Version]
  7. Atzberger, C.; Darvishzadeh, R.; Immitzer, M.; Schlerf, M.; Skidmore, A.; le Maire, G. Comparative analysis of different retrieval methods for mapping grassland leaf area index using airborne imaging spectroscopy. Int. J. Appl. Earth Obs. Geoinf. 2015, 43, 19–31. [Google Scholar] [CrossRef] [Green Version]
  8. Galvão, L.S.; Formaggio, A.R.; Tisot, D.A. Discrimination of sugarcane varieties in Southeastern Brazil with EO-1 Hyperion data. Remote Sens. Environ. 2005, 94, 523–534. [Google Scholar] [CrossRef]
  9. Mishra, S.; Mishra, D.R. Normalized difference chlorophyll index: A novel model for remote estimation of chlorophyll-a concentration in turbid productive waters. Remote Sens. Environ. 2012, 117, 394–406. [Google Scholar] [CrossRef]
  10. Meroni, M.; Rossini, M.; Guanter, L.; Alonso, L.; Rascher, U.; Colombo, R.; Moreno, J. Remote sensing of solar-induced chlorophyll fluorescence: Review of methods and applications. Remote Sens. Environ. 2009, 113, 2037–2051. [Google Scholar] [CrossRef]
  11. Bacour, C.; Baret, F.; Béal, D.; Weiss, M.; Pavageau, K. Neural network estimation of LAI, fAPAR, fCover and LAI×Cab, from top of canopy MERIS reflflectance data: Principles and validation. Remote Sens. Environ. 2006, 105, 313–325. [Google Scholar] [CrossRef]
  12. Li, W.; Weiss, M.; Waldner, F.; Defourny, P.; Demarez, V.; Morin, D.; Hagolle, O.; Baret, F. A generic algorithm to estimate LAI, FAPAR and FCOVER variables from SPOT4_HRVIR and landsat sensors: Evaluation of the consistency and comparison with ground measurements. Remote Sens. 2015, 7, 15494–15516. [Google Scholar] [CrossRef] [Green Version]
  13. Maimaitijiang, M.; Ghulam, A.; Sidike, P.; Hartling, S.; Maimaitiyiming, M.; Peterson, K.; Shavers, E.; Fishman, J.; Peterson, J.; Kadam, S.; et al. Unmanned Aerial System (UAS)-based phenotyping of soybean using multi-sensor data fusion and extreme learning machine. ISPRS J. Photogramm. Remote Sens. 2017, 134, 43–58. [Google Scholar] [CrossRef]
  14. Zaman-Allah, M.; Vergara, O.; Araus, J.; Tarekegne, A.; Magorokosho, C.; Zarco-Tejada, P.; Hornero, A.; Albà, A.; Das, B.; Craufurd, P.; et al. Unmanned aerial platform-based multi-spectral imaging for field phenotyping of maize. Plant Methods. 2015, 11, 35. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Jin, X.; Liu, S.; Baret, F.; Hemerlé, M.; Comar, A. Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery. Remote Sens. Environ. 2017, 198, 105–114. [Google Scholar] [CrossRef] [Green Version]
  16. Everaerts, J. The use of unmanned aerial vehicles (UAVs) for remote sensing and mapping. Remote Sens. Spat. Inf. Sci. 2008, 144, 1187–1191. [Google Scholar]
  17. Zhou, X.; Zheng, H.B.; Xu, X.Q.; He, J.Y.; Ge, X.K.; Yao, X.; Cheng, T.; Zhu, Y.; Cao, W.X.; Tian, Y.C. Predicting grain yield in rice using multi-temporal vegetation indices from UAV-based multispectral and digital imagery. ISPRS J. Photogramm. Remote Sens. 2017, 130, 246–255. [Google Scholar] [CrossRef]
  18. Jakob, G.; Johanna, L.; Wilhelm, C. Combined Spectral and Spatial Modeling of Corn Yield Based on Aerial Images and Crop Surface Models Acquired with an Unmanned Aircraft System. Remote Sens. 2014, 6, 10335–10355. [Google Scholar]
  19. Zhang, C.; Kovacs, J.M. The application of small unmanned aerial systems for precision agriculture: A review. Precis. Agric. 2012, 13, 693–712. [Google Scholar] [CrossRef]
  20. Yu, N.; Li, L.; Schmitz, N.; Tian, L.F.; Greenberg, J.A.; Diers, B.W. Development of methods to improve soybean yield estimation and predict plant maturity with an unmanned aerial vehicle based platform. Remote Sens. Environ. 2016, 187, 91–101. [Google Scholar] [CrossRef]
  21. Bendig, J.; Yu, K.; Aasen, H.; Bolten, A.; Bennertz, S.; Broscheit, J.; Gnyp, M.L.; Bareth, G. Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley. Int. J. Appl. Earth Obs. Geoinf. 2015, 39, 79–87. [Google Scholar] [CrossRef]
  22. Bendig, J.; Bolten, A.; Bennertz, S.; Broscheit, J.; Eichfuss, S.; Bareth, G. Estimating biomass of barley using crop surface models (CSMs) derived from UAV-based RGB imaging. Remote Sens. 2014, 6, 10395–10412. [Google Scholar] [CrossRef] [Green Version]
  23. Berger, K.; Atzberger, C.; Danner, M.; D’Urso, G.; Mauser, W.; Vuolo, F.; Hank, T. Evaluation of the PROSAIL model capabilities for future hyperspectral model environments: A review study. Remote Sens. 2018, 10, 85. [Google Scholar] [CrossRef] [Green Version]
  24. Taniguchi, K.; Obata, K.; Yoshioka, H. Derivation and approximation of soil isoline equations in the red–near-infrared reflflectance subspace. J. Appl. Remote Sens. 2014, 8, 083621. [Google Scholar] [CrossRef] [Green Version]
  25. Koetz, B.; Baret, F.; Poilvé, H.; Hill, J. Use of coupled canopy structure dynamic and radiative transfer models to estimate biophysical canopy characteristics. Remote Sens. Environ. 2005, 95, 115–124. [Google Scholar] [CrossRef]
  26. Broge, N.H.; Leblanc, E. Comparing prediction power and stability of broadband and hyperspectral vegetation indices for estimation of green leaf area index and canopy chlorophyll density. Remote Sens. Environ. 2001, 76, 156–172. [Google Scholar] [CrossRef]
  27. Osborne, S.L.; Schepers, J.S.; Francis, D.D.; Schlemmer, M.R. Crop ecology management & quality-use of spectral radiance to estimate in-season biomass and grain yield in nitrogen- and water-stressed corn. Crop Sci. 2002, 42, 165–171. [Google Scholar]
  28. Serrano, L.; Filella, I.; Peñuelas, J. Remote sensing of biomass and yield of winter wheat under different nitrogen supplies. Crop Sci. 2000, 40, 723–731. [Google Scholar] [CrossRef] [Green Version]
  29. Thenkabail, P.S.; Smith, R.B.; Pauw, E.D. Hyperspectral Vegetation Indices and Their Relationships with Agricultural Crop Characteristics. Remote Sens. Environ. 2000, 71, 158–182. [Google Scholar] [CrossRef]
  30. Ma, B.L.; Dwyer, L.M.; Costa, C.; Cober, E.R.; Morrison, M.J. Early prediction of soybean yield from canopy reflectance measurements. Agron. J. 2001, 93, 1227–1234. [Google Scholar] [CrossRef] [Green Version]
  31. Yue, J.; Feng, H.; Yang, G.; Li, Z. A comparison of regression techniques for estimation of above-ground winter wheat biomass using near-surface spectroscopy. Remote Sens. 2018, 10, 66. [Google Scholar] [CrossRef] [Green Version]
  32. Liang, L.; Di, L.; Zhang, L.; Deng, M.; Qin, Z.; Zhao, S.; Lin, H. Estimation of crop LAI using hyperspectral vegetation indices and a hybrid inversion method. Remote Sens. Environ. 2015, 165, 123–134. [Google Scholar] [CrossRef]
  33. Koppe, W.; Gnyp, M.L.; Hennig, S.D.; Li, F.; Miao, Y.; Chen, X.; Jia, L.; Bareth, G. Multi-temporal hyperspectral and radar remote sensing for estimating winter wheat biomass in the north China plain. Photogramm. Fernerkund. Geoinf. 2012, 18, 281–298. [Google Scholar] [CrossRef]
  34. Jin, X.; Yang, G.; Xu, X.; Yang, H.; Feng, H.; Li, Z.; Shen, J.; Lan, Y.; Zhao, C. Combined Multi-temporal optical and radar parameters for estimating LAI and biomass in winter wheat using HJ and RADARSAR-2 data. Remote Sens. 2015, 7, 13251–13272. [Google Scholar] [CrossRef] [Green Version]
  35. Bareth, G.; Aasen, H.; Bendig, J.; Gnyp, L.; Bolten, A.; Jung, A.; Michels, R.; Soukkamäki, J. Low-weight and UAV-based Hyperspectral Full-frame Cameras for Monitoring Crops: Spectral Comparison with Portable Spectroradiometer Measurements. Photogramm. Fernerkund. Geoinf. 2015, 1, 69–79. [Google Scholar] [CrossRef]
  36. Horler, D.N.H.; Dockray, M.; Barber, J. The red edge of plant leaf reflectance. Int. J. Remote Sens. 1983, 4, 273–288. [Google Scholar] [CrossRef]
  37. Lucieer, A.; Malenovský, Z.; Veness, T.; Wallace, L. HyperUAS-Imaging spectroscopy from a multirotor unmanned aircraft system. J. Field Robot. 2014, 31, 571–590. [Google Scholar] [CrossRef] [Green Version]
  38. Turner, D.; Lucieer, A.; Wallace, L. Direct georeferencing of ultrahigh-resolution UAV imagery. IEEE. Trans. Geosci. Remote Sens. 2014, 52, 2738–2745. [Google Scholar] [CrossRef]
  39. Rama Rao, N.; Garg, P.K.; Ghosh, S.K.; Dadhwal, V.K. Estimation of leaf total chlorophyll and nitrogen concentrations using hyperspectral satellite imagery. J. Agric. Sci. 2008, 146, 65–75. [Google Scholar] [CrossRef]
  40. Datt, B. A new reflectance index for remote sensing of chlorophyll content in higher plants: Tests using Eucalyptus leaves. J. Plant Physiol. 1999, 154, 30–36. [Google Scholar] [CrossRef]
  41. Blackburn, G.A. Quantifying chlorophylls and carotenoids at leaf and canopy scales: An evaluation of some hyperspectral approaches. Remote Sens. Environ. 1998, 66, 273–285. [Google Scholar] [CrossRef]
  42. Chappelle, E.W.; Kim, M.S.; McMurtrey, J.E. Ratio analysis of reflflectance spectra (RARS): An algorithm for the remote estimation of the concentrations of chlorophyll A, chlorophyll B, and carotenoids in soybean leaves. Remote Sens. Environ. 1992, 39, 239–247. [Google Scholar] [CrossRef]
  43. Stamatiadis, S.; Taskos, D.; Tsadilas, C.; Christofifides, C.; Tsadila, E.; Schepers, J.S. Relation of ground-sensor canopy reflflectance to biomass production and grape color in two merlot vineyards. Am. J. Enol. Vitic. 2006, 57, 415–422. [Google Scholar]
  44. Wu, C.; Niu, Z.; Tang, Q.; Huang, W. Estimating chlorophyll content from hyperspectral vegetation indices: Modeling and validation. Agric. For. Meteorol. 2008, 148, 1230–1241. [Google Scholar] [CrossRef]
  45. Penuelas, J.; Isla, R.; Filella, I.; Araus, J. Visible and near-infrared reflectance assessment of salinity effects on barley. Crop Sci. 1997, 37, 198–202. [Google Scholar] [CrossRef]
  46. Baret, F.; Guyot, G.; Major, D.J. TSAVI: A vegetation index which minimizes soil brightness effects on LAI and APAR estimation. Symp. Remote Sens. Geosci. Remote Sens. Symp. 1989, 3, 1355–1358. [Google Scholar]
  47. Merzlyak, M.N.; Gitelson, A.A.; Chivkunova, O.B.; Rakitin, V.Y.U. Non-destructive optical detection of pigment changes during leaf senescence and fruit ripening. Physiol. Plant. 1999, 106, 135–141. [Google Scholar] [CrossRef] [Green Version]
  48. Peñuelas, J.; Gamon, J.A.; Fredeen, A.L.; Merino, J.; Field, C.B. Reflectance indices associated with physiological changes in nitrogen- and water-limited sunflower leaves. Remote Sens. Environ. 1994, 48, 135–146. [Google Scholar] [CrossRef]
  49. Zarco-Tejada, P.J.; Berjón, A.; López-Lozano, R.; Miller, J.R.; Martín, P.; Cachorro, V.; González, M.R.; De Frutos, A. Assessing vineyard condition with hyperspectral indices: Leaf and canopy reflflectance simulation in a row-structured discontinuous canopy. Remote Sens. Environ. 2005, 99, 271–287. [Google Scholar] [CrossRef]
  50. Rondeaux, G.; Steven, M.; Baret, F. Optimization of soil-adjusted vegetation indices. Remote Sens Environ. 1996, 55, 95–107. [Google Scholar] [CrossRef]
  51. Roujean, J.L.; Breon, F.M. Estimating PAR absorbed by vegetation from bidirectional reflectance measurements. Remote Sens. Environ. 1995, 51, 375–384. [Google Scholar] [CrossRef]
  52. Merton, R.; Huntington, J. Early Simulation Results of the Aries-1 Satellite Sensor for Multi-Temporal Vegetation Research Derived from Aviris. In Proceedings of the Eighth Annual JPL Airborne Earth Science Workshop, Pasadena, CA, USA, 9–11 February 1999; pp. 1–10. [Google Scholar]
  53. Jiang, Z.; Huete, A.R.; Didan, K.; Miura, T. Development of a two-band enhanced vegetation index without a blue band. Remote Sens. Environ. 2008, 112, 3833–3845. [Google Scholar] [CrossRef]
  54. Haboudane, D.; Miller, J.R.; Tremblay, N.; Zarco-Tejada, P.J.; Dextraze, L. Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture. Remote Sens. Environ. 2002, 81, 416–426. [Google Scholar] [CrossRef]
  55. Vincini, M.; Frazzi, E. Angular dependence of maize and sugar beet VIs from directional CHRIS/Proba data. Cuore. 2005, 5–9. [Google Scholar]
  56. Dawson, T.P.; Curran, P.J. Technical note a new technique for interpolating the reflectance red edge position. Int. J. Remote Sens. 1998, 19, 2133–2139. [Google Scholar] [CrossRef]
  57. Feng, W.; Zhu, Y.; Yao, X.; Tian, Y.; Cao, W.; Guo, T. Monitoring nitrogen accumulation in wheat leaf with red edge characteristics parameters. Nongye Gongcheng Xuebao/Trans. Chin. Soc. Agric. Eng. 2009, 25, 194–201. [Google Scholar]
  58. Filella, I.; Penuelas, J. The red edge position and shape as indicators of plant chlorophyll content, biomass and hydric status. Int. J. Remote Sens. 1994, 15, 1459–1470. [Google Scholar] [CrossRef]
  59. Darvishzadeh, R.; Skidmore, A.; Schlerf, M.; Atzberger, C.; Corsi, F.; Cho, M. Lai and chlorophyll estimation for a heterogeneous grassland using hyperspectral measurements. Isprs J. Photogramm. Remote Sens. 2008, 63, 409–426. [Google Scholar] [CrossRef]
  60. Nguy-Robertson, A.; Gitelson, A.; Peng, Y.; Viña, A.; Arkebauer, T.; Rundquist, D. Green leaf area index estimation in maize and soybean: Combining vegetation indices to achieve maximal sensitivity. Agron. J. 2012, 104, 1336–1347. [Google Scholar] [CrossRef] [Green Version]
  61. Gao, L.; Yang, G.; Yu, H.; Xu, B.; Zhao, X.; Dong, J.; Ma, Y. Retrieving winter wheat leaf area index based on unmanned aerial vehicle hyperspectral remote sensing. Nongye Gongcheng Xuebao/Trans. Chin. Soc. Agric. Eng. 2016, 32, 113–120. [Google Scholar]
  62. Curran, P.J.; Dungan, J.L.; Macler, B.A.; Plummer, S.E. The effect of a red leaf pigment on the relationship between red edge and chlorophyll concentration. Remote Sens. Environ. 1991, 35, 69–76. [Google Scholar] [CrossRef]
  63. Clevers, J.G.P.W.; Gitelson, A.A. Remote estimation of crop and grass chlorophyll and nitrogen content using red-edge bands on Sentine l-2 and -3. Int. J. Appl. Earth Obs. Geoinf. 2013, 23, 344–351. [Google Scholar] [CrossRef]
  64. Quan, X.; He, B.; Yebra, M.; Yin, C.; Liao, Z.; Zhang, X.; Li, X. A radiative transfer model-based method for the estimation of grassland aboveground biomass. Int. J. Appl. Earth Obs. Geoinf. 2017, 54, 159–168. [Google Scholar] [CrossRef]
  65. Yue, J.; Yang, G.; Li, C.C.; Li, Z.H.; Wang, Y.J.; Feng, H.K.; Xu, B. Estimation of winter wheat above-ground biomass using unmanned aerial vehicle-based snapshot hyperspectral sensor and crop height improved models. Remote Sens. 2017, 9, 708. [Google Scholar] [CrossRef] [Green Version]
  66. Fan, L.; Zhao, J.; Xu, X.; Liang, D.; Yang, G.; Feng, H.; Yang, H.; Wang, Y.; Chen, g.; Wei, P. Hyperspectral-based estimation of leaf nitrogen content in corn using optimal selection of multiple spectral variables. Sensors 2019, 19, 2898. [Google Scholar] [CrossRef] [Green Version]
Sensors 20 01296 g001 550
Figure 1. Location of the test area. (a) location of Changping District in Beijing; (b) image of test area acquired by unmanned aerial vehicle (UAV).
Figure 1. Location of the test area. (a) location of Changping District in Beijing; (b) image of test area acquired by unmanned aerial vehicle (UAV).
Sensors 20 01296 g001
Sensors 20 01296 g002 550
Figure 2. Experimental design. ZM175: winter-wheat variety Zhongmai 175; J9843: winter-wheat variety Jingmai 9843. N1, N2, N3, and N4 represent nitrogen treatments of 0, 195, 390, and 780 kg/ha, respectively.
Figure 2. Experimental design. ZM175: winter-wheat variety Zhongmai 175; J9843: winter-wheat variety Jingmai 9843. N1, N2, N3, and N4 represent nitrogen treatments of 0, 195, 390, and 780 kg/ha, respectively.
Sensors 20 01296 g002
Sensors 20 01296 g003 550
Figure 3. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on vegetation indices (VIs) and stepwise regression (SWR): (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); and (h) LAI (filling stage). R2: coefficient of determination; RMSE: root-mean-square error; NRMSE: normalized RMSE.
Figure 3. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on vegetation indices (VIs) and stepwise regression (SWR): (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); and (h) LAI (filling stage). R2: coefficient of determination; RMSE: root-mean-square error; NRMSE: normalized RMSE.
Sensors 20 01296 g003
Sensors 20 01296 g004 550
Figure 4. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on VIs and PLSR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); and (h) LAI (filling stage).
Figure 4. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on VIs and PLSR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); and (h) LAI (filling stage).
Sensors 20 01296 g004
Sensors 20 01296 g005 550
Figure 5. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values based on a combination of VIs and red-edge parameters (RPs) and SWR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); (h) LAI (filling stage).
Figure 5. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values based on a combination of VIs and red-edge parameters (RPs) and SWR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); (h) LAI (filling stage).
Sensors 20 01296 g005
Sensors 20 01296 g006 550
Figure 6. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on a combination of VIs and RPs and PLSR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); (h) LAI (filling stage).
Figure 6. Relationship between ground-measured values of AGB (kg/m2) and LAI (m2/m2) in different growth stages of winter wheat and the values predicted based on a combination of VIs and RPs and PLSR: (a) AGB (jointing stage); (b) AGB (flagging stage); (c) AGB (flowering stage); (d) AGB (filling stage); (e) LAI (jointing stage); (f) LAI (flagging stage); (g) LAI (flowering stage); (h) LAI (filling stage).
Sensors 20 01296 g006
Sensors 20 01296 g007 550
Figure 7. Maps showing the distribution of the estimated values of AGB (kg/m2) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (a) jointing stage; (b) flagging stage; (c) flowering stage.
Figure 7. Maps showing the distribution of the estimated values of AGB (kg/m2) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (a) jointing stage; (b) flagging stage; (c) flowering stage.
Sensors 20 01296 g007
Sensors 20 01296 g008 550
Figure 8. Maps showing the distribution of the estimated values of LAI (m2/m2) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (a) jointing stage; (b) flagging stage; (c) flowering stage.
Figure 8. Maps showing the distribution of the estimated values of LAI (m2/m2) in the 48 study plots obtained using a combination of VIs and RPs and using the PLSR method. (a) jointing stage; (b) flagging stage; (c) flowering stage.
Sensors 20 01296 g008
Table
Table 1. Main attributes of the Ultra high definition (UHD) 185-Firefly hyperspectral sensor.
Table 1. Main attributes of the Ultra high definition (UHD) 185-Firefly hyperspectral sensor.
Country of OriginGermany
Dimensions195 mm × 67 mm × 60 mm
Weight470 kg
Spectral range450–950 nm
Number of channels125
Spectral sampling interval4 nm
Table
Table 2. Vegetation indices used in this study.
Table 2. Vegetation indices used in this study.
Vegetation IndicesDefinitionReferences
PBI (plant biochemical index)R810/R560[39]
LCI (linear combination index)(R850 − R710)/(R850 + R670)1/2[40]
PSSR (pigment-specific simple ratio)R800/R500[41]
RARS (ratio analysis of reflectance spectra)R760/R500[42]
WDRVI (modified wide dynamic range vegetation index)(0.1 × R800 − R670)/(0.1 × R800 + R670)[43]
PSND (pigment-specific normalized difference)(R800 − R470)/(R800 + R470)[41]
MSR (modified simple ratio index)(R800/R760 − 1)/(R800/R670 + 1)1/2[44]
NDVI (normalized difference vegetation index)(R800 − R680)/(R800 + R680)[45]
SR (simple ratio vegetation index)R750/R550[46]
PSRI (plant senescence reflectance index)(R680 − R500)/R750[47]
NPCI (normalized pigment chlorophyll ratio index)(R670 − R460)/(R670 + R460)[48]
GI (greenness index)R554/R677[49]
OSAVI (optimized soil adjusted vegetation index)1.16×(R800 − R670)/(R800 + R670 + 0.16)[50]
RDVI (renormalized difference vegetation index)(R800 − R670)/(R800 + R670)1/2[51]
RVSI (red-edge vegetation stress index)[(R712 + R752)/2] − R732[52]
EVI2 (two-band enhanced vegetation index)2.5 × (R800 − R670)/(R800 + 2.4 × R670 + 1)[53]
TCARI (transformed chlorophyll absorption ratio index)3 × [(R700 − R670) − 0.2 × (R700 − R550)(R700/R670)][54]
SPVI (spectral polygon vegetation index)0.4 × [3.7(R800 − R670) − 1.2 × |R530 − R670|][55]
TVI (triangular vegetation index)0.5 × [120(R750 − R550) − 200 × (R670 − R550)][26]
MCARI (modified chlorophyll absorption ratio index)((R700 − R670) − 0.2 × (R700 − R550))(R700/R670)[54]
Note: R is spectral reflectance.
Table
Table 3. Correlation coefficients between crop growth parameters (the above-ground biomass [AGB] and leaf area index [LAe metrics for the estimates of winter-wheat growth parameters (AGB I]) and vegetation indices and red-edge parameters (RPs) for the four growth stages of winter wheat.
Table 3. Correlation coefficients between crop growth parameters (the above-ground biomass [AGB] and leaf area index [LAe metrics for the estimates of winter-wheat growth parameters (AGB I]) and vegetation indices and red-edge parameters (RPs) for the four growth stages of winter wheat.
Spectral ParameterLAIAGB
Jointing Flagging Flowering Filling Jointing Flagging Flowering Filling
VIPBI0.7130.7220.8280.8260.7080.7610.8350.700
LCI0.6950.7360.7760.8170.6720.7840.7720.703
PSSR0.6830.7310.8050.8090.6710.7480.8190.681
RARS0.6750.7250.8000.8060.6620.7450.8180.677
WDRVI0.6690.7170.7680.8120.6400.7660.7840.679
PSND0.6680.6920.7650.7810.6440.7360.7640.670
MSR0.6640.7250.7810.8120.6390.7640.8000.680
NDVI0.6540.6960.7210.7760.6210.7590.7250.660
SR0.6500.7300.7970.8090.6310.7540.8200.676
PSRI−0.632−0.682−0.648−0.741−0.593−0.767−0.641−0.624
NPCI−0.622−0.708−0.716−0.800−0.578−0.752−0.748−0.666
GI0.5290.6740.6710.7480.4840.7050.7030.608
OSAVI0.4940.6830.7570.7750.4410.7380.7740.677
RDVI0.4160.6550.7640.7710.3650.7030.7850.680
RVSI0.3640.2030.338−0.2260.4070.1380.253−0.306
EVI20.3480.6420.7690.7700.2950.6860.7950.684
TCARI−0.278−0.3670.1230.026−0.309−0.3670.2020.067
SPVI0.2480.5960.7690.7450.2010.6320.7980.678
TVI0.2010.5080.7100.7190.1500.5460.7480.641
MCARI0.0640.0130.3980.4210.0130.0510.4850.376
RPREP0.6800.4450.5110.6640.6960.4540.4730.593
Dr0.2730.5790.7660.7660.2240.6280.7950.701
SDr0.1100.5620.7510.7440.1510.6020.7860.670
Drmin−0.493−0.532−0.217−0.404−0.501−0.542−0.133−0.243
Dr/Drmin0.6450.6880.5790.8090.6930.7250.5360.651
Note: REP: red edge position; Dr: red edge amplitude; SDr: red edge area; Drmin: minimum red-edge amplitude.
Table
Table 4. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using the optimal vegetation indices for different growth stages.
Table 4. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using the optimal vegetation indices for different growth stages.
Growth StageGrowth ParameterOptimal VIModelingValidation
R2RMSE NRMSE (%)R2RMSE NRMSE (%)
Jointing AGBPBI0.470.0520.540.600.0414.22
LAIPBI0.550.6217.650.620.5714.99
Flagging AGBLCI0.610.1018.860.670.0814.76
LAILCI0.541.1324.750.710.6318.41
Flowering AGBPBI0.700.1114.190.720.0912.02
LAIPBI0.650.7220.760.770.4816.59
Filling AGBLCI0.450.2119.300.650.1514.18
LAIPBI0.630.5632.550.780.3425.90
Table
Table 5. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using the optimal red-edge parameters for different growth stages.
Table 5. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using the optimal red-edge parameters for different growth stages.
Growth StageGrowth ParameterOptimal RPModelingValidation
R2RMSE NRMSE (%)R2RMSE NRMSE (%)
Jointing AGBREP0.490.0622.570.450.0416.87
LAIREP0.570.6117.240.410.7218.74
Flagging AGBDr/Drmin0.560.1020.050.500.0918.33
LAIDr/Drmin0.511.1625.370.540.8023.29
Flowering AGB Dr0.620.1316.040.700.1012.46
LAIDr 0.550.8223.460.680.5819.81
Filling AGBDr 0.450.2019.290.480.1917.32
LAIDr/Drmin0.660.5331.090.580.4836.11
Table
Table 6. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using a combination of the optimal vegetation index and the optimal red-edge parameter for different growth stages.
Table 6. Performance metrics for the estimates of winter-wheat growth parameters (AGB and LAI) obtained using a combination of the optimal vegetation index and the optimal red-edge parameter for different growth stages.
Growth StageGrowth ParameterOptimal VI, RPModelingValidation
R2RMSE NRMSE (%)R2RMSE NRMSE (%)
Jointing AGBPBI, REP0.520.0519.460.580.0414.78
LAIPBI, REP0.610.5816.420.560.8221.34
Flagging AGBLCI, Dr/Drmin0.620.0918.650.630.0917.02
LAILCI, Dr/Drmin0.551.1124.330.661.2034.76
Flowering AGBPBI, Dr 0.710.1014.060.730.1113.84
LAIPBI, Dr 0.650.7220.720.770.5518.80
Filling AGBLCI, Dr 0.500.1818.420.530.1917.91
LAIPBI, Dr/Drmin0.690.5129.940.720.4029.74
Table
Table 7. Performance metrics for the estimation of winter-wheat AGB and LAI obtained using seven vegetation indices (modeling dataset) and either the stepwise regression (SWR) or partial least squares regression (PLSR) method for the four growth stages.
Table 7. Performance metrics for the estimation of winter-wheat AGB and LAI obtained using seven vegetation indices (modeling dataset) and either the stepwise regression (SWR) or partial least squares regression (PLSR) method for the four growth stages.
MethodGrowth StageAGBLAI
R2RMSE (kg/m2)NRMSE (%)R2RMSENRMSE (%)
SWRJointing 0.550.0518.850.580.6017.11
Flagging 0.680.0917.020.551.1124.41
Flowering 0.740.1113.320.700.6619.04
Filling 0.550.1917.530.680.5230.21
PLSRJointing 0.560.0518.580.610.5816.48
Flagging 0.690.0916.740.641.0021.92
Flowering 0.780.1012.260.710.6518.76
Filling 0.600.1816.530.750.5026.81
Table
Table 8. Performance metrics for the estimation of winter-wheat AGB and LAI obtained using a combination of vegetation indices and red-edge parameters (modeling dataset) for the four growth stages.
Table 8. Performance metrics for the estimation of winter-wheat AGB and LAI obtained using a combination of vegetation indices and red-edge parameters (modeling dataset) for the four growth stages.
MethodGrowth StageAGBLAI
R2RMSE (kg/m2)NRMSE (%)R2RMSENRMSE (%)
SWRJointing 0.570.0518.470.620.5716.12
Flagging 0.700.0816.380.641.0021.82
Flowering 0.770.1012.410.720.6518.50
Filling 0.600.1816.510.710.4928.63
PLSRJointing 0.590.0517.990.640.5615.76
Flagging 0.720.0816.020.670.9621.07
Flowering 0.800.0911.670.750.6117.58
Filling 0.750.1513.110.760.4526.17

Share and Cite

MDPI and ACS Style

Tao, H.; Feng, H.; Xu, L.; Miao, M.; Long, H.; Yue, J.; Li, Z.; Yang, G.; Yang, X.; Fan, L. Estimation of Crop Growth Parameters Using UAV-Based Hyperspectral Remote Sensing Data. Sensors 2020, 20, 1296. https://doi.org/10.3390/s20051296

AMA Style

Tao H, Feng H, Xu L, Miao M, Long H, Yue J, Li Z, Yang G, Yang X, Fan L. Estimation of Crop Growth Parameters Using UAV-Based Hyperspectral Remote Sensing Data. Sensors. 2020; 20(5):1296. https://doi.org/10.3390/s20051296

Chicago/Turabian Style

Tao, Huilin, Haikuan Feng, Liangji Xu, Mengke Miao, Huiling Long, Jibo Yue, Zhenhai Li, Guijun Yang, Xiaodong Yang, and Lingling Fan. 2020. "Estimation of Crop Growth Parameters Using UAV-Based Hyperspectral Remote Sensing Data" Sensors 20, no. 5: 1296. https://doi.org/10.3390/s20051296

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop