Nothing Special   »   [go: up one dir, main page]
Next Article in Journal
Application of Luojia 1-01 Nighttime Images for Detecting the Light Changes for the 2019 Spring Festival in Western Cities, China
Next Article in Special Issue
An UAV and Satellite Multispectral Data Approach to Monitor Water Quality in Small Reservoirs
Previous Article in Journal
Integrated Landscape Change Analysis of Protected Areas and their Surrounding Landscapes: Application in the Brazilian Cerrado
Previous Article in Special Issue
Automated Inundation Mapping Over Large Areas Using Landsat Data and Google Earth Engine
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Remote Sensing
Volume 12
Issue 9
10.3390/rs12091414
remotesensing-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Integrating National Ecological Observatory Network (NEON) Airborne Remote Sensing and In-Situ Data for Optimal Tree Species Classification

by
Victoria M. Scholl
1,2,*,
Megan E. Cattau
1,3,
Maxwell B. Joseph
1 and
Jennifer K. Balch
1,2
1
Earth Lab, University of Colorado Boulder, 4001 Discovery Drive, Suite S348 611 UCB, Boulder, CO 80303, USA
2
Department of Geography, University of Colorado Boulder, GUGG 110, 260 UCB, Boulder, CO 80309, USA
3
Human-Environment Systems, ERB 4153, 1215 W University Drive, Boise State University, Boise, ID 83706, USA
*
Author to whom correspondence should be addressed.
Remote Sens. 2020, 12(9), 1414; https://doi.org/10.3390/rs12091414
Submission received: 30 March 2020 / Revised: 24 April 2020 / Accepted: 28 April 2020 / Published: 30 April 2020
(This article belongs to the Special Issue She Maps)
Browse Figures
Graphical abstract
"> Figure 1
<p>Map showing the location of the Niwot Ridge Mountain Research Station (NIWO) site in NEON Domain 13, Southern Rockies and Colorado, in the United States. Latitude: 40.05425, Longitude: –105.58237.</p> "> Figure 2
<p>Map showing the extent of the NEON NIWO site and distributed sampling plots. Inset zoomed view shows an example of individual tree locations along with their associated species for a single sampling plot.</p> "> Figure 3
<p>Comparison of raster data products from each of the three NEON Airborne Observation Platform (AOP) instruments at the Niwot Ridge Mountain Research Station site: hyperspectral true-color composite with 1 m pixel size using three of the available 426 NEON Imaging Spectrometer (NIS) bands at approximate wavelengths of 450 nm, 555 nm, and 620 nm (<b>left</b>), discrete Light Detection And Ranging (LiDAR)-derived canopy height model with 1 m pixel size, where black indicates ground and brighter pixels represent taller canopy height above ground (<b>center</b>), and digital camera RGB composite with 10 cm pixel size (<b>right</b>).</p> "> Figure 4
<p>“Raw” reference data sets created using all of the input woody vegetation measurements at the NIWO_015 distributed base plot with dimensions of 20 × 20 m, located at 451146 m East, 4432366 m North: (<b>A</b>) Tree stem points. (<b>B</b>) Circular polygons created with half the maximum crown diameter for each tree. (<b>C</b>) Circular polygons created with the maximum crown diameter for each tree. (<b>D</b>) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons, as well as the presence of multi-bole entries which appear opaque where multiple identical polygons are present. The base layer is RGB image data collected by the AOP with 10 cm spatial resolution.</p> "> Figure 5
<p>“Clipped” reference data sets generated using the proposed preprocessing workflow to filter out small tree crowns and clip overlapping crowns to preserve taller trees at the NIWO_015 distributed based plot: (<b>A</b>) Tree stem points corresponding to the clipped half-diameter polygons. (<b>B</b>) Clipped half-diameter polygons. (<b>C</b>) Clipped maximum-diameter polygons. (<b>D</b>) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons. Note that there is no longer overlap between adjacent polygons, and multi-bole entries have been removed. The base layer is RGB image data collected by the AOP with 0.1 m spatial resolution.</p> "> Figure 6
<p>Mean hyperspectral reflectance per species from 380 to 2510 nm, extracted from all polygons with half the max crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.</p> "> Figure 7
<p>Mean hyperspectral reflectance from 380 to 2510 nm, extracted from all polygons with half the maximum crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Reflectance curves for all four species are overlaid here to compare and contrast their mean and standard deviation values. Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.</p> "> Figure 8
<p>Predictor variable importance ranked by two metrics, Mean Decrease in Accuracy (MDA) and Mean Decrease in Gini Index (MDG) for the Random Forest models trained using the half-diameter clipped polygons. See <a href="#remotesensing-12-01414-t002" class="html-table">Table 2</a> for remote sensing-derived variable definitions.</p> ">
Review Reports Versions Notes

Abstract

:
Accurately mapping tree species composition and diversity is a critical step towards spatially explicit and species-specific ecological understanding. The National Ecological Observatory Network (NEON) is a valuable source of open ecological data across the United States. Freely available NEON data include in-situ measurements of individual trees, including stem locations, species, and crown diameter, along with the NEON Airborne Observation Platform (AOP) airborne remote sensing imagery, including hyperspectral, multispectral, and light detection and ranging (LiDAR) data products. An important aspect of predicting species using remote sensing data is creating high-quality training sets for optimal classification purposes. Ultimately, manually creating training data is an expensive and time-consuming task that relies on human analyst decisions and may require external data sets or information. We combine in-situ and airborne remote sensing NEON data to evaluate the impact of automated training set preparation and a novel data preprocessing workflow on classifying the four dominant subalpine coniferous tree species at the Niwot Ridge Mountain Research Station forested NEON site in Colorado, USA. We trained pixel-based Random Forest (RF) machine learning models using a series of training data sets along with remote sensing raster data as descriptive features. The highest classification accuracies, 69% and 60% based on internal RF error assessment and an independent validation set, respectively, were obtained using circular tree crown polygons created with half the maximum crown diameter per tree. LiDAR-derived data products were the most important features for species classification, followed by vegetation indices. This work contributes to the open development of well-labeled training data sets for forest composition mapping using openly available NEON data without requiring external data collection, manual delineation steps, or site-specific parameters.

Graphical Abstract">

Graphical Abstract

1. Introduction

Mapping and monitoring the tree species composition of Earth’s forests using remote sensing technologies is a challenging task that has motivated an active research community over the past three decades [1,2,3,4,5,6,7]. In between the global coverage and long-standing historical records of satellite platforms [8,9,10] and the flexibility and high spatial resolution achieved by unmanned aircraft systems [11,12,13], airborne platforms provide a valuable intermediate scale of local to regional ecosystem monitoring capabilities [3,14,15,16,17]. Passive optical (multispectral [10] and hyperspectral [18]) and active (such as Light Detection and Ranging (LiDAR) [19]) remote sensing systems have each been used to map tree species on their own with varying levels of success, but combining spectral and structural remote sensing data has been shown to generally improve tree species detection abilities compared to using any of them alone [2,3,14,20,21,22]. For instance, the combination of hyperspectral and LiDAR data has the ability to differentiate between species with similar reflectance properties but different mean heights [3].
These remotely sensed spectral and structural characteristics of trees are used to predict species using a variety of pixel-based and object-based classification approaches [6,23,24,25]. Three commonly used classification approaches are non-parametric machine learning techniques including Support Vector Machines (SVM), Random Forest (RF), and neural networks [6,26,27,28]. SVM and RF tend to perform similarly in terms of classification accuracy and training time [29,30,31]. Neural networks are increasingly used in ecological remote sensing studies for their ability to identify trends and patterns from data, model complex relationships, accept a wide variety of input predictor data, and produce high accuracies, at the expense of requiring large amounts of training data [13,32,33,34]. Tree species classification accuracies reported throughout the literature vary widely from approximately 60% to 95%, along with the type and number of sensors used, biodiversity within forests, and classification methods utilized [6]. Many studies highlight the value of deriving metrics such as texture to quantify crown-internal shadows and foliage properties [35], calculating vegetation indices and employing dimensionality reduction when working with hyperspectral data [36], and removing dark or non-green pixel outliers that may contain shadows or soil [37] when preparing remote sensing image features for species classification [6]. Other factors that impact tree species classification accuracy include tree species complexity [38], and the time of acquisition within a year or season, especially for deciduous trees with distinctive phenological patterns [27].
Large amounts of open ecological and remote sensing data are becoming increasingly available in recent years to enable and motivate advancements in tree species classification efforts [6,39]. A notable source of these data is the National Ecological Observatory Network (NEON), a National Science Foundation (NSF) funded Grand Challenge project awarded with the purpose of measuring ecological change for a span of 30 years [40]. NEON provides publicly available data at 81 field sites in 20 distinct eco-climatic domains across the continental United States, Alaska, Hawaii and Puerto Rico [41]. NEON collects airborne remote sensing observations at a subset of these sites every year from the Airborne Observation Platform (AOP). The AOP sensor suite includes multispectral, hyperspectral, and LiDAR instruments to map regional land cover at high spatial resolutions, ranging from 0.1 to 1 m. [42]. NEON generates a series of publicly available image data products from the AOP data and provides documents with detailed descriptions of their standardized data collection protocols and processing algorithms. Within the extent of AOP coverage, NEON field technicians collect terrestrial field-based plant measurements towards the aim of monitoring changes in biodiversity, species abundance, and productivity [41]. In-situ measurements of individual trees are collected at stratified random plot locations at vegetated NEON sites every 1–3 years, including stem locations, species, and crown diameter [43].
NEON data has enabled a new wave of tree detection and classification research, in addition to a need for integrative and reproducible analysis and synthesis [34,37,44,45]. This research has been further accelerated by an ecological data science competition that has tasked research groups with tree crown segmentation, alignment of data, and species classification at the open canopy longleaf pine ecosystem at the Ordway-Swisher Biological Station in Florida [37,46]. A second iteration of this competition is currently underway with the focus of developing methods that generalize to other NEON sites. Preparing accurate training data that connects field-based ground truth species measurements with remote sensing observations is a critical, yet challenging, aspect of these efforts [37,47]). One recent study proposed a new approach to create tree crown training data using a consumer-grade GPS and tablet to spatially match individual trees measured in the field directly onto an AOP-derived image [47]. Another recent study leveraged existing unsupervised algorithms to delineate tree crown boundaries based on AOP LiDAR canopy height data, and refined these boundaries using almost 3000 hand-annotated bounding boxes drawn around individual trees using AOP multispectral imagery collected at the San Joaquin Experimental Range (SJER) NEON site in California [28]. These studies are making exciting progress towards creating high-quality, high-volume tree species training data at NEON sites. Ultimately, manually creating training data is an expensive and time-consuming task that introduces human decision making and/or may require external data sets or information beyond what is provided publicly within NEON data products and protocols.
Our work explores training data set preparation using openly available NEON data without requiring external data collection or manual delineation steps. We integrate in-situ vegetation measurements with multisensor AOP remote sensing data at the Niwot Ridge Mountain Research Station (NIWO) subalpine forest NEON site in Colorado to evaluate the impact of our hands-off training data preparation approaches on tree species classification accuracy. We create a series of training data sets by representing individual trees as points and circular polygons with various sizes based on in-situ crown diameter measurements. We propose a preprocessing workflow to remove small, suppressed trees and clip areas of overlap between neighboring tree crown polygons in layered canopies to give preference to taller trees that are more likely to be seen by the airborne remote sensing platform. To assess the impact of training data preparation on species classification accuracy, we train random forest (RF) models to predict tree species using each training set. We also evaluate variable importance to assess the contribution of each AOP remote sensing data product for species classification. This work contributes to the open development of forest composition mapping efforts using NEON data without the need for manual delineation or external data sources. We explored the following objectives:
  • Evaluate which training set preparation approach yields the most accurate tree species classification accuracy. We expected smaller tree polygons would capture more valuable variation in canopy features than using stem location points, and capture less noise and neighboring materials than larger circular polygons.
  • Evaluate the value added of our proposed tree crown polygon clipping workflow, which removes tree crown polygons with small area values and clips overlapping tree crown regions based on associated in-situ tree height measurements.
  • Assess the tree species classification accuracies achievable for the four dominant subalpine conifer species in a region of the Southern Rockies, Colorado, USA using the proposed NEON training data preparation approaches.
  • Determine which NEON AOP imagery-derived features are the most important for predicting tree species to help inform overarching tree species classification efforts. We anticipated the hyperspectral imagery to be the most important compared to RGB or LiDAR-derived features.
  • Contribute open reproducible tools so that the NEON data user community can use and build upon these techniques across diverse vegetated ecosystems.

2. Materials and Methods

2.1. Study Area and Field Data

The NIWO NEON site is located on the eastern slope of the Colorado Front Range, in the Southern Rockies Domain, 27 km west of Boulder, Colorado and 6 km east of the Colorado Continental Divide (Figure 1). The high-elevation (3000 m) Rocky Mountain ecosystems present here include alpine tundra and subalpine coniferous forests near the treeline dominated by subalpine fir (Abies lasiocarpa), lodgepole pine (Pinus contorta), Engelmann spruce (Picea engelmannii), and limber pine (Pinus flexilis).
At partially forested sites such as NIWO, field technicians collect in-situ vegetation measurements from distributed and tower plots every one to three years following the Terrestrial Organismal Sampling protocol for Measurement of Vegetation Structure (described in NEON.DOC.000987). Distributed plots are measured using the vegetation structure protocol but tower plots are not, because most of the tower airshed is above tree line at NIWO. Field data collected within each 20 m × 20 m sampling plot include the location and species of tree stems (Figure 2), total stem height, and maximum crown diameter. These data are provided in the Woody Plant Vegetation Structure data product (NEON data product ID: DP1.10098.001). An offset mapping technique is used to determine the within-plot location of mapped tree stems relative to permanent plot reference points with precisely known spatial coordinates. A TruPulse 360R laser rangefinder (30 cm accuracy) is used to measure the distance and azimuth of each stem relative to the permanent plot reference point. Crown diameter is measured to the nearest 10 cm using the laser rangefinder.
We downloaded woody vegetation structure data from the NEON Data Portal [48]. The most recent woody plant vegetation structure data available at the NIWO site at this time were collected during late summer/early fall of 2015 and 2016, and consist of 699 individual trees with stem coordinates and crown measurements (Table 1).

2.2. Airborne Remote Sensing Data

NEON’s Airborne Observation Platform (AOP) consists of three remote sensing instruments mounted into a DeHavilland DHC-6 Twin Otter aircraft to collect hyperspectral, multispectral, and LiDAR imagery [41]. Coincident capture of these three data facilitates high spatial resolution ecosystem monitoring. During its annual flight campaign, the AOP surveys 75% of core NEON sites on a rotating basis throughout the country. The AOP flight season runs from March to October. NEON terrestrial sites are scheduled to be flown during periods of at least 90% peak vegetation greenness for phenological consistency. The aircraft is flown at an altitude of 1000 m above ground level and a speed of 100 knots to achieve meter-scale hyperspectral and LiDAR raster data products and sub-meter multispectral imagery (described in NEON document NEON.DOC.002236). The data products are publicly available on NEON’s data portal as both flight lines and 1 km by 1 km mosaic tiles. When multiple flight lines cover a given tile, the most-nadir pixels are selected for the final mosaic. We utilized the mosaic data products in this study.
The NEON Imaging Spectrometer (NIS) is a pushbroom collection-style instrument that measures reflected light energy with 426 spectral bands, spanning the visible (380 nm) to shortwave infrared (2510 nm) wavelengths in 5 nm increments. The NIS instantaneous field of view (IFOV) is 1 mrad, which yields a ground sample distance (GSD) of 1 m at the reported flight altitude of 1000 m above ground level (described in NEON document NEON.DOC.001290). The NIS-derived raster data products are generated at a 1 m spatial resolution. NEON implements calibration and atmospheric corrections to convert at-sensor radiance to surface reflectance. In addition to 426-band hyperspectral surface reflectance (NEON data product ID: DP3.30006.001), NEON also provides vegetation indices (NEON data product ID: DP3.30026.001), a collection of seven spectral indices that are known to be indicators of plant health: Normalized Difference Vegetation Index (NDVI), Enhanced Vegetation Index (EVI), Atmospherically Resistant Vegetation Index (ARVI), Photochemical Reflectance Index (PRI), Normalized Difference Canopy Lignin Index (NDLI), Normalized Difference Nitrogen Index (NDNI), and Soil-Adjusted Vegetation Index (SAVI). These vegetation indices are calculated using well-known equations from the scientific literature, using NIS surface reflectance data as the inputs.
Discrete and waveform LiDAR were collected using the Optech ALTM Gemini system at a spatial resolution of approximately 1–4 points/waveforms per square meter, using a near-infrared laser wavelength of 1064 nm. Using the discrete return point cloud data, NEON creates Digital Terrain Model (DTM) and Digital Surface Model (DSM) raster data products each with a spatial resolution of 1 m to match that of the NIS imagery. From the DTM, NEON generates Slope and Aspect raster data products to characterize the underlying bare ground terrain surface (NEON data product ID: DP3.30025.001). Slope is determined as the angle between a plane tangential to the local terrain surface and a plane tangential to the local geoid surface, reported in degrees. Aspect is the direction of the steepest slope, given in degrees referenced to grid north. Using the DTM and DSM, NEON also generates the Ecosystem Structure data product, a Canopy Height Model (CHM) raster where each pixel value quantifies the height of the top of the canopy above the ground (NEON data product ID: DP3.30015.001). We used the Slope, Aspect, and Ecosystem Structure raster data products in our study to capture vegetation structure and topographic characteristics.
The AOP payload also includes an Optech D8900 commercial off-the-shelf digital camera that measures 8-bit light intensity reflected in the red, green, and blue (RGB) visible wavelengths. With a 70 mm focal length lens, the digital camera has a 42.1 deg cross-track field-of-view (FOV) and achieves a GSD of 0.086 m at a flight altitude of 1000 m. The raw RGB images are corrected for color balance and exposure, orthorectified to reduce geometric and topographic distortions and map the RGB imagery to the same geographic projection as the NIS and LiDAR imagery, and ultimately resampled to a spatial resolution of 0.1 m (NEON data product ID: DP3.30010.001), the digital camera imagery can aid in identifying fine features such as boundaries of individual tree crowns in dense canopy that are not as visible in the other airborne data products.
Together, these three AOP instruments capture spectral and structural characteristics of ecosystems present at NEON sites (Figure 3). The closest date of available airborne remote sensing data products to the in-situ vegetation measurements was September 2017 [48].

2.3. Proposed Reference Data Preprocessing

The in-situ woody vegetation structure data include tree location and crown diameter measurements for each mapped tree stem within NEON sampling plots. We generated three different “raw” reference data sets to investigate their influence on species classification: (1) tree stem point locations, (2) circular polygons with the maximum crown diameter of each tree, and (3) circular polygons with half of the maximum crown diameter of each tree to serve as an intermediate step between points and large polygons (Figure 4). Many of the points and polygons are overlapping, so that multiple trees will be associated with individual pixel locations. Also, there are duplicate polygons in some locations, which are generated as a result of multi-bole entries present in the reference data. We approximated tree crowns as circles in this study due to the lack of more specific crown shape measurements. In reality, tree crowns at NIWO are often irregularly shaped and asymmetrical due to wind, sun exposure, and proximity of neighboring vegetation.
To investigate the potential value of preprocessing these “raw” reference data, we designed an experimental workflow to remove small polygons and clip overlapping polygons to preserve the taller trees, which are more likely visible in the airborne imagery. In this workflow, we first identified identical multi-bole entries and removed any duplicate points or polygons from each raw data set. We then applied an area threshold (two square meters) to remove small trees. We selected this threshold with the coarser resolution of the AOP-derived imagery in mind, where one pixel has an area of one square meter. By preserving the trees with larger crowns, we believed that we could extract purer spectra for the training sets as opposed to extracting mixed pixel spectra containing signals from neighboring vegetation and other background materials. “Occluded” tree crown polygons, those which are associated with shorter heights and completely within the boundaries of other tree crown polygons, are also present in the initial reference data sets (Figure 4). Since they likely cannot be observed from the airborne perspective, we identified and removed “occluded” polygons from subsequent analysis. We checked the remaining polygons for overlap with neighboring polygons. Each polygon had an associated height value, as this is one of the measurements collected in the in-situ protocol. For each overlapping pair of polygons, we clipped the shorter polygons. If the remaining clipped area was smaller than the aforementioned area threshold, we removed the polygon from subsequent analysis. After following these steps, we generated a collection of “clipped” polygons to reduce the occurrence of multiple trees being associated with a single pixel in the remote sensing imagery (Figure 5).
We created the following six sets of reference data to evaluate species classification accuracy at the NEON NIWO site in this study: (1) points for all mapped tree stems (Figure 4A), (2) polygons generated using the respective maximum crown diameter for all of the tree stems (Figure 4C), (3) polygons generated using half of the respective maximum crown diameter for all of the tree stems (Figure 4B), (4) “clipped” half-diameter polygons (Figure 5B), (5) “clipped” maximum-diameter polygons (Figure 5C), and (6) points for mapped tree stems corresponding to the center locations of the clipped half-diameter polygons (Figure 5A).

2.4. Remote Sensing Feature Extraction

To train the tree species classifiers, we utilized NEON AOP-derived images that describe the spectral, structural, and environmental characteristics of vegetation at the NIWO site (Table 2). The NIS captures hyperspectral surface reflectance in 426 bands throughout the visible, near infrared, and shortwave infrared wavelengths. We removed water-vapor absorption bands (1340 to 1445 nm and 1790 to 1955 nm), yielding 372 individual wavelength bands. We used principal component analysis (PCA) to reduce the dimensionality of the hyperspectral data with many highly correlated bands. PCA is a commonly used technique to transform large data sets with correlated dimensions into a new set of orthogonal dimensions or principal components [6,49]. The first two principal components explained a cumulative proportion of 0.96 of the total variance, so we included the first two principal components (“PC1” and “PC2”) as features, similarly as [15]. In addition to including the first two principal components, we also included all seven of the Vegetation Indices calculated by NEON as descriptive features since they capture spectral differences between specific wavelengths that relate to vegetation health and chemical composition.
We spatially resampled the multispectral digital camera RGB intensity bands from their initial 10 cm spatial resolution to match the 1 m grid size of the other remote sensing data products. Within each 1 m by 1 m grid cell, we calculated the aggregated mean and standard deviation of RGB intensities. The RGB imagery captures fine-scale canopy variations such as shadows. The mean plus standard deviation for each of the RGB channels were included as features to capture the average spectral intensity along with variation in intensity per pixel. From the LiDAR-derived CHM, we included the height above ground at each pixel location. Although canopy height alone has limited value for species classification due to its dependence on individual tree age [30], it has been found to improve classification accuracies in some studies [20] and is useful for filtering non-canopy pixels. The slope and aspect products describe the orientation and steepness of the underlying “bare earth” surface, which are important microclimate characteristics that influence species survival within a given environment [56]. For each 1 km by 1 km tile, we combined all of these coincident airborne remote sensing data layers into raster stacks. We excluded any pixels with a height of 0 m in the canopy height model, as we assumed they contain signal from the ground. We then used reference data set to extract features from the remote sensing data stacks by determining which pixels intersect with each of the points or polygons. We extracted spectral reflectance curves from the AOP hyperspectral data for the points and polygons within each reference set to see how spectrally similar each of the tree species appear. For subsequent tree species classification, each AOP pixel was a sample described by the remote sensing-derived spectral and structural features.

2.5. Random Forest Classification

Random forests (RF) are a non-parametric supervised classifiers that use ensembles of decision trees, also known as “bootstrap aggregated” or “bagged” decision trees [57]. Each decision tree in the “forest” considers a random subset of features and only has access to a random set of the training data samples (approximately two-thirds of the collected data). The remaining one-third of the data is then used to predict upon using the previously created decision tree. Whereas using a single decision tree is known to lead to overfitting on the training set, building multiple decision trees by iteratively resampling data from the training set reduces the occurrence of overfitting for greater stability and accuracy. Each decision tree within the ensemble “votes” for a final outcome value and the class with the greatest number of votes is assigned in the end. As a form of data-splitting, this Out-Of-Bag (OOB) bootstrap-resampling procedure can provide a reliable estimate of accuracy for unseen data, although a completely independent test set is recommended as the “a gold standard for tree species classification studies” [6]. There are two hyperparameters that may be tuned when constructing an RF classifier—the number of decision trees (ntree) and the number of variables sampled randomly as each split or stage to grow a single tree (mtry). The Mean Decrease in Accuracy (MDA) and Mean Decrease in Gini (MDG) metrics are commonly used to rank RF predictor variable importance [15,20]. Assessing variable importance is a valuable step for downstream feature selection and model interpretation.
We chose to use RF classification because it handles high-dimensionality data well, requires few user-defined parameters, has a low sensitivity to overfitting and the number of input variables, and provides an intuitive derivation of accuracy and variable importance [29]. We used the randomForest R package to classify tree species, providing AOP-derived spectral and structural features as input and the “taxon ID” label as output [58]. We trained six random forest classifiers, each using a different set of reference data. We initially excluded a random 20% of pixels within the half-diameter polygons, and then trained each of the six RF models using the remaining data within each set. Each RF model was then used to predict species of the 20% independent validation set. We set ntree to 5000 to ensure that each one of the input samples was used multiple times during training, and left the mtry parameter at its default value, the square root of the number of features. We evaluated each classifier’s performance based on internal out of bag error estimates, and overall accuracy of the independent validation set predictions. In addition, we created confusion matrices to assess user’s and producer’s classification accuracies for each of the four species [59]. We calculated Cohen’s Kappa coefficient as well, which takes into account the possibility of classification accuracy by chance [60]. We ranked the AOP-derived descriptive features in order of importance based on the Mean Decrease in Accuracy (MDA) and Mean Decrease in Gini (MDG) metrics for the RF models.
As a result of the filtering and clipping operations, the clipped polygon data sets contained less than half of the number of pixels as the initial NEON data sets. To reduce the influence of sample size and sampling bias on the classification results, we reduced the trees within each “raw” data set to include the same tree IDs present in each corresponding clipped set. All code required to reproduce the analysis is available at https://github.com/earthlab/neon-veg.

3. Results

The AOP hyperspectral reflectance curves appear very similar across all four tree species, including the characteristic green peak (550 nm) within the visible wavelength region and the steep slope at the edge between the red and near-infrared regions (750 nm) and the shoulder or flattening off into the near-infrared region (800 nm) (Figure 6). To compare reflectance magnitudes in different wavelength regions, we overlaid all four mean spectral reflectance curves with standard deviation shading (Figure 7). The overlaid mean reflectance curves extracted within the clipped half-diameter polygons have very similar shapes across the conifer species but they appear to be biased or separated vertically to varying degrees. The relationship between reflectance magnitude across species curves differs across wavelength regions. Features and biases in reflectance may aid in differentiating between species during classification.
When we compared the overall classification accuracies for each of the RF models trained using each a different training set (Table 3), the clipped half-diameter polygon training set yielded the highest overall accuracy (OA) values of 69.3% and 60.4% for out-of-bag and independent validation evaluations, respectively.
The user’s and producer’s accuracies for the clipped half-diameter polygon RF model varied greatly across the four species, from 32.6% to 94.9% (Table 4). Pinus flexilis (Limber pine) is consistently the most accurately classified species, while Abies lasiocarpa (Subalpine fir) and Picea engelmannii (Engelmann spruce) were less accurately classified. Abies lasiocarpa is often incorrectly predicted as Picea engelmannii (Engelmann spruce). The confusion matrices of the other five training data sets demonstrate analogous species-specific classification performance.
When we ranked the AOP-derived descriptive features in order of importance (Figure 8), the structural features derived from the LiDAR data (aspect, slope, and canopy height) were ranked as the top three most important variables. Variable importance appeared to taper off after this, with the following multispectral- and hyperspectral-derived features listed as the next most important across the MDA and MDG metrics: blue intensity from the digital camera, ARVI (Atmospherically Resistant Vegetation Index), PRI (Photochemical Refelectance Index), and NDVI (Normalized Difference Vegetation Index).

4. Discussion

We built an open reproducible workflow to create training data sets using NEON data without the need for manual delineation or external data sources. We represented individual trees as points and circular polygons with various sizes based on in-situ crown diameter measurements, and we implemented a clipping workflow to give preference to larger, taller trees that are more likely to be seen in layered canopies by the airborne remote sensing platform. We trained RF models to predict species using each training set paired with AOP remote sensing features, and determined which remote sensing data products were most important for species identification. Our results show that 60–69% overall classification accuracies are achievable at the NIWO site without any manual refinement of the training data or incorporation of data beyond the NEON collection protocols. These accuracy values fall within the lower end of the reported range of 65–95% for studies utilizing combined sensor systems (spectral and structural data) [6]. Based on the extracted spectra, the mean and standard deviation of reflectance for the four coniferous tree species appear to be very similar (Figure 7).
Accuracy values were highest when half-diameter circular polygons were used, rather than points or maximum-diameter polygons (Table 3). This is useful information for creating future training data sets using NEON in-situ measurements. Minimum crown diameter is also measured, and could be used to approximate circular crown size, as there are no other measurements that give a more specific indication of crown shape in the NEON data collection protocol. After applying the proposed clipping workflow, classification accuracy increased slightly (no more than 2%) between each pair of reference data sets. We expected a larger accuracy increase, under the assumption that removing tree crowns with small area values and clipping overlap between neighboring crown polygons would yield a purer spectral and structural signal for each species.
Accuracy values varied across each of the four coniferous species in our study area (Table 4). The worst classification results were obtained for Subalpine fir (ABLAL) and Engelmann spruce (PIEN), while the best classification results were obtained for limber pine (PIFL2). Based on the spectral reflectance curves in Figure 7, PIFL2 appears to be noticeably better separated from the other three species across the longer wavelengths, from 1500 nm out to 2500 m, and this spectral separation may help explain why PIFL2 was classified most accurately.
Besides the clipping workflow and using the CHM to remove pixels associated with a canopy height of zero, points and polygons derived from the in-situ tree measurements were used as-is, without any site-specific parameters, manual quality assessment, or alignment procedures. Our visualizations indicate that some stem locations and polygons extend beyond the actual location and boundaries of tree crowns in the AOP imagery (Figure 4). This could result from field measurement errors and uncertainties, georectification and image formation artifacts introduced during the creation of the remote sensing data products, and/or asymmetric crowns.
We performed pixel-based classification, but existing studies show potential for improved results using manual and automated tree crown delineation to refine the selection of pixels within their reference data sets and perform object-based classification [28,47,61]. We recognize that individual tree detection and segmentation are complicated tasks that often require site-specific tuning parameters to avoid under/over segmentation [5]. Tree detection methods often struggle with transferability across geographies and vegetation types. We aimed to create and evaluate a training data processing method that takes full advantage of standardized NEON-collected tree measurements, and avoids being site-specific. We are aware of other studies such as [62] who are making impressive strides towards creating transferable methods for large-scale tree detection across NEON sites. Note that methods like this one utilize tens of thousands of hand-annotated tree crowns for model training.
Beyond using the CHM to identify canopy pixels, additional spectral data can be used such as an NDVI threshold to isolate forest pixels and eliminate shadow pixels [36]. An NDVI threshold could also be used to identify pixels with trees that have died since the collection of the field data, as there was a time difference of 1–2 years between the in-situ and remote sensing data collections in this study. Incorporating additional steps to refine the reference data sets, ensure alignment with the remote sensing imagery, and delineate individual crown boundaries instead of assuming perfectly circular crowns may improve upon the accuracies achieved here. We anticipate that employing outlier removed steps may further separate the mean spectral reflectance curves and reduce the standard deviation of hyperspectral reflectance per species that are presented in Figure 6 and Figure 7.
We found that the LiDAR-derived remote sensing features of aspect, slope, and canopy height were consistently ranked as the most important for species classification (Figure 8). This is interesting, as canopy height on its own is typically limited for robust species classification as it is dependent on tree age [6]. In addition to using the CHM, other studies have found that calculating metrics related to the vertical distribution, density and intensity of individual LiDAR returns improved classification results, so these metrics may be promising to incorporate in the future [6,15,63]. Incorporating LiDAR point cloud-based metrics per pixel and/or tree crown object may improve species classifier performance in the future. Aspect and slope are important drivers of microclimate conditions such as temperature, moisture, and sun and wind exposure, so their importance has ecological merit in the mountainous landscape of the Southern Rockies. The importance of aspect and slope in our variable assessment may indicate that this classifier is not just learning how to identify trees using inter-species spectral variability, but also incorporating spectral information from the habitat or niche where each species resides. Future work would be required to assess the consistency of these observations with documented patterns of species distributions, but this highlights an interesting potential avenue for assessing how species habitats may shift in mountainous regions across the 30 year duration of the NEON project.
Following the LiDAR-derived variables, the ranking of RGB and NIS-derived variable importance varied slightly between importance metrics (Figure 8). These variable importance rankings may be useful for iterative variable selection in future classification efforts, such as backwards feature selection [36]. In addition, performing a sensitivity analysis would be valuable to fine-tune the ntree and mtry RF parameters in subsequent analyses to potentially achieve higher species classification accuracies.
From the AOP hyperspectral imagery, we utilized a series of vegetation indices and the first two principal components (PCs) in our RF models. To further improve the utility of the hyperspectral data, we consider employing other dimensionality reduction techniques and including additional features in future work. We incorporated the first two PCs, which explained 96% of the hyperspectral data. Including additional PCs to explain additional variance may improve our classification results in future work. PCA and Minimum Noise Fraction (MNF) were the most commonly used dimensionality reduction methods in a recent tree species classification review [6]. There is also potential for MNF to improve classification results, and this would be an interesting comparison to make in future research. Hyper-dimensional image data volume may also be reduced by selecting specific spectral bands that are shown to successfully discriminate species [15]. There are specific wavelengths that have been shown to vary as a function of vegetation type and health, the foundation for vegetation indices as well, such as reflectance at 550 nm (the green peak within the visible wavelengths) [64] and reflectance at 750 nm (at the NIR shoulder) [65]. Additionally, spectral separability analysis could be useful to analyze our extracted reflectance curves presented in Figure 6 and Figure 7. Separability metrics such as the Jeffries–Matusita distance and transformed divergence have been used to identify wavelengths that play a significant role in vegetation classification [66]. Regarding the contribution of the RGB imagery, we consider using texture metrics in future analyses to quantify spatial patterns within tree crowns such as shadows and other foliage characteristics to potentially improve classification results [35]. Calculating explicit texture metrics may also help to ensure that the RGB data is not adding redundant information that is already described by the visible bands within the hyperspectral data.
This analysis can also be performed at other NEON sites to generate additional training data sets for regional species classification. However, the types of vegetation and topography vary among NEON domains, and we expect this to influence the resulting variable importance rankings and species classification accuracies. For instance, the LiDAR-derived features of slope and aspect describe the underlying terrain steepness and orientation. These two variables were found to be important for species classification at the mountainous NIWO site in the Southern Rockies in our study. However, the Ordway–Swisher Biological Station (OSBS) site in north-central Florida is relatively flat. We do not expect the slope and aspect variables to be as useful for species classification at a site such as OSBS where slope and aspect are relatively constant across space.
We expect overall species classification to be influenced by the diversity and tree canopy complexity at different ecosystems across NEON sites. For instance, San Joaquin Experimental Range (SJER) in central California features open woodland dominated by large oak trees, pine trees, and scattered shrubs and grasses. Harvard Forest (HARV) in Massachusetts features primarily closed-canopy mixed forest composed of both coniferous and hardwood trees, densely packed with overlapping crowns. We expect greater species classification accuracies to be achieved at SJER compared to at HARV, because an open woodland offers simpler canopy structure and clearer separation between neighboring tree crowns. In addition, open woodland enables more accurate GPS measurements to be collected at plot corner locations as opposed to in dense, closed-canopy tree cover.
Incorporating additional training data and/or implementing a more complex classification model may improve our results. Complete field data entries for just 699 trees were available at the NIWO site for our analysis. Deep learning methods are gaining traction in the forest remote sensing field for their ability to perform complicated tasks such as tree detection and species classification, although they require large volumes of training data [32]. Deep learning methods may also enable more effective transferability of species classification methods across geographies and vegetation types. When a recently developed deep learning classification method was applied across multiple NEON sites, tree detection was the least successful at the NIWO site compared to three other NEON sites with oak woodland, mixed pine, and dense deciduous forest types [62]. Taking both our results and the findings of [62] into consideration, species classification may objectively be a difficult task at the NIWO site due to the spectral similarity and structural characteristics of the coniferous vegetation species present there.

5. Conclusions

In this study, we created a series of training data sets using NEON in-situ vegetation measurements and used each one to train a random forest model to classify tree species at the NIWO subalpine site. The highest classification accuracies, 69% and 60% based on internal out-of-bag error and an independent validation set, respectively, were achieved using circular polygons created with half the maximum crown diameter per tree after applying the proposed clipping workflow. The LiDAR-derived raster data products of aspect, slope, and canopy height were found to be the most important AOP remote sensing data-derived features, followed by vegetation indices. Refining the reference data alignment with remote sensing imagery, incorporating additional variables from the LiDAR point cloud, and performing object-based classification on crown segments, rather than individual pixels, are all promising directions for subsequent analyses at NIWO and in subalpine coniferous forests more generally. Scaling this species classification method to other NEON sites will also be informative of the proposed workflow’s robustness. This work contributes to the open development of well-labeled training data sets for forest composition mapping using openly available NEON data without requiring external data collection, manual delineation steps, or site-specific parameters.

Author Contributions

V.M.S., M.E.C., and J.K.B. conceived of project design. All authors collaboratively developed and refined the methodology. V.M.S. performed the analysis and wrote the text. All authors contributed to reviewing and editing the text. All authors have read and agreed to the published version of the manuscript.

Funding

Funding for this work was provided by Earth Lab, through CU Boulder’s Grand Challenge Initiative, and the CIRES at CU Boulder. Additional funding was provided by National Aeronautics and Space Administration (NASA) New Investigator Program (NIP) grant 80NSSC18K0750 to M. E. Cattau.

Acknowledgments

The National Ecological Observatory Network is a program sponsored by the National Science Foundation and operated under cooperative agreement by Battelle Memorial Institute. This material is based in part upon work supported by the National Science Foundation through the NEON Program.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
NEONNational Ecological Observatory Network
AOPNEON’s Airborne Observation Platform
NIWONiwot Ridge Mountain Research Station NEON site
LiDARLight Detection and Ranging
CHMCanopy Height Model
NISNEON Imaging Spectrometer
RGBRed, Green, Blue multispectral imagery
RFRandom Forest classification

References

  1. Martin, M.; Newman, S.; Aber, J.; Congalton, R. Determining forest species composition using high spectral resolution remote sensing data. Remote Sens. Environ. 1998, 65, 249–254. [Google Scholar] [CrossRef]
  2. Anderson, J.E.; Plourde, L.C.; Martin, M.E.; Braswell, B.H.; Smith, M.L.; Dubayah, R.O.; Hofton, M.A.; Blair, J.B. Integrating waveform lidar with hyperspectral imagery for inventory of a northern temperate forest. Remote Sens. Environ. 2008, 112, 1856–1870. [Google Scholar] [CrossRef]
  3. Dalponte, M.; Bruzzone, L.; Gianelle, D. Fusion of hyperspectral and LIDAR remote sensing data for classification of complex forest areas. IEEE Trans. Geosci. Remote Sens. 2008, 46, 1416–1427. [Google Scholar] [CrossRef] [Green Version]
  4. Asner, G.P.; Martin, R.E.; Knapp, D.; Tupayachi, R.; Anderson, C.; Sinca, F.; Vaughn, N.; Llactayo, W. Airborne laser-guided imaging spectroscopy to map forest trait diversity and guide conservation. Science 2017, 355, 385–389. [Google Scholar] [CrossRef]
  5. Kaartinen, H.; Hyyppä, J.; Yu, X.; Vastaranta, M.; Hyyppä, H.; Kukko, A.; Holopainen, M.; Heipke, C.; Hirschmugl, M.; Morsdorf, F.; et al. An international comparison of individual tree detection and extraction using airborne laser scanning. Remote Sens. 2012, 4, 950–974. [Google Scholar] [CrossRef] [Green Version]
  6. Fassnacht, F.E.; Latifi, H.; Stereńczak, K.; Modzelewska, A.; Lefsky, M.; Waser, L.T.; Straub, C.; Ghosh, A. Review of studies on tree species classification from remotely sensed data. Remote Sens. Environ. 2016, 186, 64–87. [Google Scholar] [CrossRef]
  7. Wang, K.; Wang, T.; Liu, X. A review: Individual tree species classification using integrated airborne LiDAR and optical imagery with a focus on the urban environment. Forests 2019, 10, 1. [Google Scholar] [CrossRef] [Green Version]
  8. Hansen, M.C.; Potapov, P.V.; Moore, R.; Hancher, M.; Turubanova, S.; Tyukavina, A.; Thau, D.; Stehman, S.; Goetz, S.; Loveland, T.R.; et al. High-resolution global maps of 21st-century forest cover change. Science 2013, 342, 850–853. [Google Scholar] [CrossRef] [Green Version]
  9. Stavros, E.N.; Schimel, D.; Pavlick, R.; Serbin, S.; Swann, A.; Duncanson, L.; Fisher, J.B.; Fassnacht, F.; Ustin, S.; Dubayah, R.; et al. ISS observations offer insights into plant function. Nat. Ecol. Evol. 2017, 1, 0194. [Google Scholar] [CrossRef]
  10. He, Y.; Yang, J.; Caspersen, J.; Jones, T. An Operational Workflow of Deciduous-Dominated Forest Species Classification: Crown Delineation, Gap Elimination, and Object-Based Classification. Remote Sens. 2019, 11, 2078. [Google Scholar] [CrossRef] [Green Version]
  11. Anderson, K.; Gaston, K.J. Lightweight unmanned aerial vehicles will revolutionize spatial ecology. Front. Ecol. Environ. 2013, 11, 138–146. [Google Scholar] [CrossRef] [Green Version]
  12. Sankey, T.; Donager, J.; McVay, J.; Sankey, J.B. UAV lidar and hyperspectral fusion for forest monitoring in the southwestern USA. Remote Sens. Environ. 2017, 195, 30–43. [Google Scholar] [CrossRef]
  13. Nezami, S.; Khoramshahi, E.; Nevalainen, O.; Pölönen, I.; Honkavaara, E. Tree Species Classification of Drone Hyperspectral and RGB Imagery with Deep Learning Convolutional Neural Networks. Remote Sens. 2020, 12, 1070. [Google Scholar] [CrossRef] [Green Version]
  14. Asner, G.P.; Knapp, D.E.; Boardman, J.; Green, R.O.; Kennedy-Bowdoin, T.; Eastwood, M.; Martin, R.E.; Anderson, C.; Field, C.B. Carnegie Airborne Observatory-2: Increasing science data dimensionality via high-fidelity multi-sensor fusion. Remote Sens. Environ. 2012, 124, 454–465. [Google Scholar] [CrossRef]
  15. Liu, L.; Coops, N.C.; Aven, N.W.; Pang, Y. Mapping urban tree species using integrated airborne hyperspectral and LiDAR remote sensing data. Remote Sens. Environ. 2017, 200, 170–182. [Google Scholar] [CrossRef]
  16. Shen, X.; Cao, L. Tree-species classification in subtropical forests using airborne hyperspectral and LiDAR data. Remote Sens. 2017, 9, 1180. [Google Scholar] [CrossRef] [Green Version]
  17. Krzystek, P.; Serebryanyk, A.; Schnörr, C.; Červenka, J.; Heurich, M. Large-Scale Mapping of Tree Species and Dead Trees in Šumava National Park and Bavarian Forest National Park Using Lidar and Multispectral Imagery. Remote Sens. 2020, 12, 661. [Google Scholar] [CrossRef] [Green Version]
  18. Wietecha, M.; Jełowicki, Ł.; Mitelsztedt, K.; Miścicki, S.; Stereńczak, K. The capability of species-related forest stand characteristics determination with the use of hyperspectral data. Remote Sens. Environ. 2019, 231, 111232. [Google Scholar] [CrossRef]
  19. Lin, Y.; Hyyppä, J. A comprehensive but efficient framework of proposing and validating feature parameters from airborne LiDAR data for tree species classification. Int. J. Appl. Earth Obs. Geoinf. 2016, 46, 45–55. [Google Scholar] [CrossRef]
  20. Naidoo, L.; Cho, M.A.; Mathieu, R.; Asner, G. Classification of savanna tree species, in the Greater Kruger National Park region, by integrating hyperspectral and LiDAR data in a Random Forest data mining environment. ISPRS J. Photogramm. Remote Sens. 2012, 69, 167–179. [Google Scholar] [CrossRef]
  21. Yu, X.; Hyyppä, J.; Litkey, P.; Kaartinen, H.; Vastaranta, M.; Holopainen, M. Single-sensor solution to tree species classification using multispectral airborne laser scanning. Remote Sens. 2017, 9, 108. [Google Scholar] [CrossRef] [Green Version]
  22. Budei, B.C.; St-Onge, B.; Hopkinson, C.; Audet, F.A. Identifying the genus or species of individual trees using a three-wavelength airborne lidar system. Remote Sens. Environ. 2018, 204, 632–647. [Google Scholar] [CrossRef]
  23. Immitzer, M.; Atzberger, C.; Koukal, T. Tree species classification with random forest using very high spatial resolution 8-band WorldView-2 satellite data. Remote Sens. 2012, 4, 2661–2693. [Google Scholar] [CrossRef] [Green Version]
  24. Ballanti, L.; Blesius, L.; Hines, E.; Kruse, B. Tree species classification using hyperspectral imagery: A comparison of two classifiers. Remote Sens. 2016, 8, 445. [Google Scholar] [CrossRef] [Green Version]
  25. Wu, Y.; Zhang, X. Object-Based Tree Species Classification Using Airborne Hyperspectral Images and LiDAR Data. Forests 2020, 11, 32. [Google Scholar] [CrossRef] [Green Version]
  26. Hauglin, M.; Ørka, H.O. Discriminating between Native Norway Spruce and Invasive Sitka Spruce—A comparison of multitemporal Landsat 8 imagery, aerial images and airborne laser scanner data. Remote Sens. 2016, 8, 363. [Google Scholar] [CrossRef] [Green Version]
  27. Osińska-Skotak, K.; Radecka, A.; Piórkowski, H.; Michalska-Hejduk, D.; Kopeć, D.; Tokarska-Guzik, B.; Ostrowski, W.; Kania, A.; Niedzielko, J. Mapping Succession in Non-Forest Habitats by Means of Remote Sensing: Is the Data Acquisition Time Critical for Species Discrimination? Remote Sens. 2019, 11, 2629. [Google Scholar] [CrossRef] [Green Version]
  28. Weinstein, B.G.; Marconi, S.; Bohlman, S.; Zare, A.; White, E. Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sens. 2019, 11, 1309. [Google Scholar] [CrossRef] [Green Version]
  29. Pal, M. Random forest classifier for remote sensing classification. Int. J. Remote Sens. 2005, 26, 217–222. [Google Scholar] [CrossRef]
  30. Ghosh, A.; Fassnacht, F.E.; Joshi, P.K.; Koch, B. A framework for mapping tree species combining hyperspectral and LiDAR data: Role of selected classifiers and sensor across three spatial scales. Int. J. Appl. Earth Obs. Geoinf. 2014, 26, 49–63. [Google Scholar] [CrossRef]
  31. Piiroinen, R.; Heiskanen, J.; Maeda, E.; Viinikka, A.; Pellikka, P. Classification of tree species in a diverse African agroforestry landscape using imaging spectroscopy and laser scanning. Remote Sens. 2017, 9, 875. [Google Scholar] [CrossRef] [Green Version]
  32. Zhu, X.X.; Tuia, D.; Mou, L.; Xia, G.S.; Zhang, L.; Xu, F.; Fraundorfer, F. Deep learning in remote sensing: A comprehensive review and list of resources. IEEE Geosci. Remote Sens. Mag. 2017, 5, 8–36. [Google Scholar] [CrossRef] [Green Version]
  33. Maxwell, A.E.; Warner, T.A.; Fang, F. Implementation of machine-learning classification in remote sensing: An applied review. Int. J. Remote Sens. 2018, 39, 2784–2817. [Google Scholar] [CrossRef] [Green Version]
  34. Fricker, G.A.; Ventura, J.D.; Wolf, J.A.; North, M.P.; Davis, F.W.; Franklin, J. A convolutional neural network classifier identifies tree species in mixed-conifer forest from hyperspectral imagery. Remote Sens. 2019, 11, 2326. [Google Scholar] [CrossRef] [Green Version]
  35. Franklin, S.; Hall, R.; Moskal, L.; Maudie, A.; Lavigne, M. Incorporating texture into classification of forest species composition from airborne multispectral images. Int. J. Remote Sens. 2000, 21, 61–79. [Google Scholar] [CrossRef]
  36. Maschler, J.; Atzberger, C.; Immitzer, M. Individual tree crown segmentation and classification of 13 tree species using airborne hyperspectral data. Remote Sens. 2018, 10, 1218. [Google Scholar] [CrossRef] [Green Version]
  37. Marconi, S.; Graves, S.J.; Gong, D.; Nia, M.S.; Le Bras, M.; Dorr, B.J.; Fontana, P.; Gearhart, J.; Greenberg, C.; Harris, D.J.; et al. A data science challenge for converting airborne remote sensing data into ecological information. PeerJ 2019, 6, e5843. [Google Scholar] [CrossRef] [Green Version]
  38. Ghiyamat, A.; Shafri, H.Z.M.; Shariff, A.R.M. Influence of tree species complexity on discrimination performance of vegetation Indices. Eur. J. Remote Sens. 2016, 49, 15–37. [Google Scholar] [CrossRef] [Green Version]
  39. Michener, W.K. Ecological data sharing. Ecol. Inform. 2015, 29, 33–44. [Google Scholar] [CrossRef] [Green Version]
  40. Keller, M.; Schimel, D.S.; Hargrove, W.W.; Hoffman, F.M. A continental strategy for the National Ecological Observatory Network. Front. Ecol. Environ. 2008, 6, 282–284. [Google Scholar] [CrossRef]
  41. Kampe, T.U.; Johnson, B.R.; Kuester, M.A.; Keller, M. NEON: The first continental-scale ecological observatory with airborne remote sensing of vegetation canopy biochemistry and structure. J. Appl. Remote Sens. 2010, 4, 043510. [Google Scholar] [CrossRef]
  42. Johnson, B.R.; Kuester, M.A.; Kampe, T.U.; Keller, M. National ecological observatory network (NEON) airborne remote measurements of vegetation canopy biochemistry and structure. In Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium, Honolulu, HI, USA, 25–30 July 2010; IEEE: Piscataway, NJ, USA, 2010; pp. 2079–2082. [Google Scholar]
  43. Kao, R.H.; Gibson, C.M.; Gallery, R.E.; Meier, C.L.; Barnett, D.T.; Docherty, K.M.; Blevins, K.K.; Travers, P.D.; Azuaje, E.; Springer, Y.P.; et al. NEON terrestrial field observations: Designing continental-scale, standardized sampling. Ecosphere 2012, 3, 1–17. [Google Scholar] [CrossRef]
  44. Balch, J.K.; Nagy, R.C.; Halpern, B.S. NEON is seeding the next revolution in ecology. Front. Ecol. Environ. 2020, 18, 3. [Google Scholar] [CrossRef] [Green Version]
  45. Hampton, S.E.; Jones, M.B.; Wasser, L.A.; Schildhauer, M.P.; Supp, S.R.; Brun, J.; Hernandez, R.R.; Boettiger, C.; Collins, S.L.; Gross, L.J.; et al. Skills and knowledge for data-intensive environmental research. BioScience 2017, 67, 546–557. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Carpenter, J. May the Best Analyst Win. Science 2011, 331, 698–699. [Google Scholar] [CrossRef]
  47. Graves, S.; Gearhart, J.; Caughlin, T.T.; Bohlman, S. A digital mapping method for linking high-resolution remote sensing images to individual tree crowns. PeerJ Prepr. 2018, 6, e27182v1. [Google Scholar]
  48. National Ecological Observatory Network. Data Products NEON.DP1.10098.001, NEON.DP3.30006.001, NEON.DP3.30026.001, NEON.DP3.30015.001, NEON.DP3.30025.001, NEON.DP3.30010.001. 2019. Available online: http://data.neonscience.org (accessed on 31 January 2019).
  49. Bajorski, P. Statistical inference in PCA for hyperspectral images. IEEE J. Sel. Top. Signal Process. 2011, 5, 438–445. [Google Scholar] [CrossRef]
  50. Rouse, J.; Haas, R.; Schell, J.; Deering, D. Monitoring vegetation systems in the Great Plains with ERTS. NASA Spec. Publ. 1974, 351, 309. [Google Scholar]
  51. Huete, A.; Didan, K.; Miura, T.; Rodriguez, E.P.; Gao, X.; Ferreira, L.G. Overview of the radiometric and biophysical performance of the MODIS vegetation indices. Remote Sens. Environ. 2002, 83, 195–213. [Google Scholar] [CrossRef]
  52. Kaufman, Y.J.; Tanre, D. Atmospherically resistant vegetation index (ARVI) for EOS-MODIS. IEEE Trans. Geosci. Remote Sens. 1992, 30, 261–270. [Google Scholar] [CrossRef]
  53. Gamon, J.; Penuelas, J.; Field, C. A narrow-waveband spectral index that tracks diurnal changes in photosynthetic efficiency. Remote Sens. Environ. 1992, 41, 35–44. [Google Scholar] [CrossRef]
  54. Serrano, L.; Penuelas, J.; Ustin, S.L. Remote sensing of nitrogen and lignin in Mediterranean vegetation from AVIRIS data: Decomposing biochemical from structural signals. Remote Sens. Environ. 2002, 81, 355–364. [Google Scholar] [CrossRef]
  55. Huete, A.R. A soil-adjusted vegetation index (SAVI). Remote Sens. Environ. 1988, 25, 295–309. [Google Scholar] [CrossRef]
  56. Walsh, S.J. Coniferous tree species mapping using Landsat data. Remote Sens. Environ. 1980, 9, 11–26. [Google Scholar] [CrossRef]
  57. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  58. Liaw, A.; Wiener, M. Classification and regression by randomForest. R News 2002, 2, 18–22. [Google Scholar]
  59. Congalton, R.G.; Green, K. Assessing the Accuracy Of Remotely Sensed Data: Principles and Practices; CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar]
  60. Cohen, J. A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 1960, 20, 37–46. [Google Scholar] [CrossRef]
  61. Koch, B.; Kattenborn, T.; Straub, C.; Vauhkonen, J. Segmentation of forest to tree objects. In Forestry Applications of Airborne Laser Scanning; Springer: Berlin/Heidelberg, Germany, 2014; pp. 89–112. [Google Scholar]
  62. Weinstein, B.G.; Marconi, S.; Bohlman, S.A.; Zare, A.; White, E.P. Cross-site learning in deep learning RGB tree crown detection. Ecol. Inform. 2020, 56, 101061. [Google Scholar] [CrossRef]
  63. Alonzo, M.; Bookhagen, B.; Roberts, D.A. Urban tree species mapping using hyperspectral and lidar data fusion. Remote Sens. Environ. 2014, 148, 70–83. [Google Scholar] [CrossRef]
  64. Haboudane, D.; Miller, J.R.; Pattey, E.; Zarco-Tejada, P.J.; Strachan, I.B. Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture. Remote Sens. Environ. 2004, 90, 337–352. [Google Scholar] [CrossRef]
  65. Vescovo, L.; Wohlfahrt, G.; Balzarolo, M.; Pilloni, S.; Sottocornola, M.; Rodeghiero, M.; Gianelle, D. New spectral vegetation indices based on the near-infrared shoulder wavelengths for remote detection of grassland phytomass. Int. J. Remote Sens. 2012, 33, 2178–2195. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Jollineau, M.; Howarth, P. Mapping an inland wetland complex using hyperspectral imagery. Int. J. Remote Sens. 2008, 29, 3609–3631. [Google Scholar] [CrossRef]
Remotesensing 12 01414 g001 550
Figure 1. Map showing the location of the Niwot Ridge Mountain Research Station (NIWO) site in NEON Domain 13, Southern Rockies and Colorado, in the United States. Latitude: 40.05425, Longitude: –105.58237.
Figure 1. Map showing the location of the Niwot Ridge Mountain Research Station (NIWO) site in NEON Domain 13, Southern Rockies and Colorado, in the United States. Latitude: 40.05425, Longitude: –105.58237.
Remotesensing 12 01414 g001
Remotesensing 12 01414 g002 550
Figure 2. Map showing the extent of the NEON NIWO site and distributed sampling plots. Inset zoomed view shows an example of individual tree locations along with their associated species for a single sampling plot.
Figure 2. Map showing the extent of the NEON NIWO site and distributed sampling plots. Inset zoomed view shows an example of individual tree locations along with their associated species for a single sampling plot.
Remotesensing 12 01414 g002
Remotesensing 12 01414 g003 550
Figure 3. Comparison of raster data products from each of the three NEON Airborne Observation Platform (AOP) instruments at the Niwot Ridge Mountain Research Station site: hyperspectral true-color composite with 1 m pixel size using three of the available 426 NEON Imaging Spectrometer (NIS) bands at approximate wavelengths of 450 nm, 555 nm, and 620 nm (left), discrete Light Detection And Ranging (LiDAR)-derived canopy height model with 1 m pixel size, where black indicates ground and brighter pixels represent taller canopy height above ground (center), and digital camera RGB composite with 10 cm pixel size (right).
Figure 3. Comparison of raster data products from each of the three NEON Airborne Observation Platform (AOP) instruments at the Niwot Ridge Mountain Research Station site: hyperspectral true-color composite with 1 m pixel size using three of the available 426 NEON Imaging Spectrometer (NIS) bands at approximate wavelengths of 450 nm, 555 nm, and 620 nm (left), discrete Light Detection And Ranging (LiDAR)-derived canopy height model with 1 m pixel size, where black indicates ground and brighter pixels represent taller canopy height above ground (center), and digital camera RGB composite with 10 cm pixel size (right).
Remotesensing 12 01414 g003
Remotesensing 12 01414 g004 550
Figure 4. “Raw” reference data sets created using all of the input woody vegetation measurements at the NIWO_015 distributed base plot with dimensions of 20 × 20 m, located at 451146 m East, 4432366 m North: (A) Tree stem points. (B) Circular polygons created with half the maximum crown diameter for each tree. (C) Circular polygons created with the maximum crown diameter for each tree. (D) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons, as well as the presence of multi-bole entries which appear opaque where multiple identical polygons are present. The base layer is RGB image data collected by the AOP with 10 cm spatial resolution.
Figure 4. “Raw” reference data sets created using all of the input woody vegetation measurements at the NIWO_015 distributed base plot with dimensions of 20 × 20 m, located at 451146 m East, 4432366 m North: (A) Tree stem points. (B) Circular polygons created with half the maximum crown diameter for each tree. (C) Circular polygons created with the maximum crown diameter for each tree. (D) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons, as well as the presence of multi-bole entries which appear opaque where multiple identical polygons are present. The base layer is RGB image data collected by the AOP with 10 cm spatial resolution.
Remotesensing 12 01414 g004
Remotesensing 12 01414 g005 550
Figure 5. “Clipped” reference data sets generated using the proposed preprocessing workflow to filter out small tree crowns and clip overlapping crowns to preserve taller trees at the NIWO_015 distributed based plot: (A) Tree stem points corresponding to the clipped half-diameter polygons. (B) Clipped half-diameter polygons. (C) Clipped maximum-diameter polygons. (D) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons. Note that there is no longer overlap between adjacent polygons, and multi-bole entries have been removed. The base layer is RGB image data collected by the AOP with 0.1 m spatial resolution.
Figure 5. “Clipped” reference data sets generated using the proposed preprocessing workflow to filter out small tree crowns and clip overlapping crowns to preserve taller trees at the NIWO_015 distributed based plot: (A) Tree stem points corresponding to the clipped half-diameter polygons. (B) Clipped half-diameter polygons. (C) Clipped maximum-diameter polygons. (D) All of these points and polygons are displayed together. Polygons are displayed with 50% opacity to help illustrate the areas of overlap between adjacent polygons. Note that there is no longer overlap between adjacent polygons, and multi-bole entries have been removed. The base layer is RGB image data collected by the AOP with 0.1 m spatial resolution.
Remotesensing 12 01414 g005
Remotesensing 12 01414 g006 550
Figure 6. Mean hyperspectral reflectance per species from 380 to 2510 nm, extracted from all polygons with half the max crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.
Figure 6. Mean hyperspectral reflectance per species from 380 to 2510 nm, extracted from all polygons with half the max crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.
Remotesensing 12 01414 g006
Remotesensing 12 01414 g007 550
Figure 7. Mean hyperspectral reflectance from 380 to 2510 nm, extracted from all polygons with half the maximum crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Reflectance curves for all four species are overlaid here to compare and contrast their mean and standard deviation values. Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.
Figure 7. Mean hyperspectral reflectance from 380 to 2510 nm, extracted from all polygons with half the maximum crown diameter at the NEON NIWO site for each of the dominant tree species: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine). Reflectance curves for all four species are overlaid here to compare and contrast their mean and standard deviation values. Shading illustrates +/− one standard deviation in reflectance per wavelength. Gaps in the spectra at approximately 1350 nm and 1800 nm are where “bad bands” were removed where there is high atmospheric absorption.
Remotesensing 12 01414 g007
Remotesensing 12 01414 g008 550
Figure 8. Predictor variable importance ranked by two metrics, Mean Decrease in Accuracy (MDA) and Mean Decrease in Gini Index (MDG) for the Random Forest models trained using the half-diameter clipped polygons. See Table 2 for remote sensing-derived variable definitions.
Figure 8. Predictor variable importance ranked by two metrics, Mean Decrease in Accuracy (MDA) and Mean Decrease in Gini Index (MDG) for the Random Forest models trained using the half-diameter clipped polygons. See Table 2 for remote sensing-derived variable definitions.
Remotesensing 12 01414 g008
Table
Table 1. Tree species recorded at the NIWO NEON site for all sampling plots combined in the woody vegetation structure data product.
Table 1. Tree species recorded at the NIWO NEON site for all sampling plots combined in the woody vegetation structure data product.
Scientific Name (Common Name)Species CodeNumber of Mapped Trees
Abies lasiocarpa (Subalpine fir)ABLAL249
Pinus contorta (Lodgepole pine)PICOL112
Picea engelmannii (Engelmann spruce)PIEN264
Pinus flexilis (Limber pine)PIFL274
Table
Table 2. Remote-sensing-derived features to train random forest models for species classification.
Table 2. Remote-sensing-derived features to train random forest models for species classification.
Feature NameDescriptionInputs/EquationsReference
PC1, PC21st and 2nd principal
components		426-band Hyperspectral reflectance
(372 after removing bad bands
due to atmospheric absorption)
381–2509 nm with 5 nm spacing		 [49]
Hyperspectral reflectance bands:
Normalized Difference
Vegetation Index (NDVI)		 N D V I = λ 860 − λ 650 λ 860 + λ 650 [50]
Enhanced Vegetation
Index (EVI)		 E V I = 2.5 × ( λ 860 − λ 650 ) ( λ 860 + ( 6 × λ 650 ) − ( 7.5 × λ 470 ) + 1 ) [51]
Atmospherically Resistant
Vegetation Index (ARVI)		 A R V I = λ 860 − [ λ 650 − γ ( λ 470 − λ 650 ) ] λ 860 + [ λ 650 − γ ( λ 470 − λ 650 ) ] [52]
Vegetation
Indices		Canopy Xanthophyll, or
Photochemical Reflectance
Index (PRI)		 P R I = λ 531 − λ 570 λ 531 + λ 570 [53]
Normalized Difference
Lignin Index (NDLI)		 N D L I = l o g ( 1 λ 1754 ) − l o g ( 1 λ 1680 ) l o g ( 1 λ 1754 ) + l o g ( 1 λ 1680 ) [54]
Normalized Difference
Nitrogen Index (NDNI)		 N D N I = l o g ( 1 λ 1510 ) − l o g ( 1 λ 1680 ) l o g ( 1 λ 1510 ) + l o g ( 1 λ 1680 ) [54]
Soil-Adjusted Vegetation
Index (SAVI)		 S A V I = ( 1 + L ) ( λ 850 − λ 650 ) λ 850 + λ 650 + L [55]
CHMHeight of canopy
above the ground		LiDAR-derived
Digital Surface Model (DSM) –
Digital Terrain Model (DTM) with
modified data pit filling algorithm		 [20]
SlopeSteepness of bare earth
surface		DTM bare earth elevation
ratio: height over distance		 [56]
AspectCompass direction of
steepest slope		DTM bare earth elevation
degrees clockwise from North		 [56]
rgb_mean_sd_RMean plus standard
rgb_mean_sd_Gdeviation of red, green,RGB multispectral bands [35]
rgb_mean_sd_Band blue (RGB) image
intensity values
Where λ n is reflectance at the specified wavelength in units of nanometers. γ is a weighting constant based on aerosol type and atmospheric compensation for ARVI. L is a correction factor to account for different soil conditions for SAVI.
Table
Table 3. Evaluation metrics for each random forest model using a different training data set.
Table 3. Evaluation metrics for each random forest model using a different training data set.
Training SetOOB AccuracyIV AccuracyKappa
Points0.6820.4580.538
Polygons-half diameter0.6900.5970.573
Polygons-max diameter0.6240.5900.490
Points-half diam clipped0.5980.5280.434
Polygons-half diam clipped0.6930.6040.578
Polygons-max diam clipped0.6450.6110.516
Note: The evaluation metrics are: Out-of-Bag estimate of accuracy internal to the random forest classifier (OOB Accuracy), overall accuracy of the Independent Validation set predictions (IV Accuracy), and Cohen’s Kappa coefficient (Kappa). The individual ID’s in each of the “raw” polygon sets were reduced to match those within each of the corresponding clipped data sets. Bold text highlights the row with the highest overall accuracy based on OOB and IV accuracies.
Table
Table 4. Confusion matrix with User’s Accuracy (UA) and Producer’s Accuracy (PA) per species for the training set that yielded the highest overall accuracy.
Table 4. Confusion matrix with User’s Accuracy (UA) and Producer’s Accuracy (PA) per species for the training set that yielded the highest overall accuracy.
Predicted Species
ABLALPICOLPIENPIFL2PA %
ABLAL281831932.6
PICOL4110381167.5
True speciesPIEN8301111966.1
PIFL212514994.9
UA %68.368.860.079.3
Note: Species codes correspond to: ABLAL (Subalpine fir), PICOL (Lodgepole pine), PIEN (Engelmann spruce), and PIFL2 (Limber pine).

Share and Cite

MDPI and ACS Style

Scholl, V.M.; Cattau, M.E.; Joseph, M.B.; Balch, J.K. Integrating National Ecological Observatory Network (NEON) Airborne Remote Sensing and In-Situ Data for Optimal Tree Species Classification. Remote Sens. 2020, 12, 1414. https://doi.org/10.3390/rs12091414

AMA Style

Scholl VM, Cattau ME, Joseph MB, Balch JK. Integrating National Ecological Observatory Network (NEON) Airborne Remote Sensing and In-Situ Data for Optimal Tree Species Classification. Remote Sensing. 2020; 12(9):1414. https://doi.org/10.3390/rs12091414

Chicago/Turabian Style

Scholl, Victoria M., Megan E. Cattau, Maxwell B. Joseph, and Jennifer K. Balch. 2020. "Integrating National Ecological Observatory Network (NEON) Airborne Remote Sensing and In-Situ Data for Optimal Tree Species Classification" Remote Sensing 12, no. 9: 1414. https://doi.org/10.3390/rs12091414

APA Style

Scholl, V. M., Cattau, M. E., Joseph, M. B., & Balch, J. K. (2020). Integrating National Ecological Observatory Network (NEON) Airborne Remote Sensing and In-Situ Data for Optimal Tree Species Classification. Remote Sensing, 12(9), 1414. https://doi.org/10.3390/rs12091414

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop