Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Pest identification via hyperspectral image and deep learning

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Crops are attacked by a variety of pests and diseases during their growth. Different pests have different control measures, and being able to accurately identify pests has become the key to pest control. Traditional methods have relatively low accuracy in pest identification due to the complexity of their algorithms and their susceptibility to environmental interference. This paper proposes an end-to-end pest identification network that combines deep learning and hyperspectral imaging technology. This method can identify common pests for the purposes of effective pest control. Noise and redundant information in the hyperspectral image (HSI) spectral space are treated by one-dimensional convolution and the attention mechanism between spectral channels to design a spectral feature extraction module for the efficient use of spectral information. The three-dimensional convolution branch structure of different resolutions in parallel is used as the HSI feature extractor to secure rich spectral–spatial information. The output feature map maintains high resolution throughout its usage. To further enhance the feature extraction capabilities of the network, an adaptive spectral–spatial feature extraction module is inserted into each branch to dynamically weight different information, thereby reducing the HSI’s undue influence. A hyperspectral imaging system was used to collect pest HSI, and a dataset containing nine kinds of common pests was constructed accordingly. The above method is used to test on this dataset, and the experimental results prove that this method has higher pest identification accuracy and is more suitable for pest identification tasks than other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Strange, R.N., Scott, P.R.: Plant disease: a threat to global food security. Ann. Rev. Phytopathol. 43(1), 83–116 (2005). https://doi.org/10.1146/anurev.phyto.43.113004.133839

    Article  Google Scholar 

  2. Gowen, A.A., O’Donnell, C.P., Cullen, P.J., Downey, G., Frias, J.M.: Hyperspectral imaging—an emerging process analytical tool for food quality and safety control. Trends Food Sci. Technol. 18(12), 590–598 (2007). https://doi.org/10.1016/j.tifs.2007.06.001

    Article  Google Scholar 

  3. Du, Q.D., Zhang, L.Z., Zhang, B.Z., Tong, X.T., Chanussot, J.C.: Foreword to the special issue on hyperspectral remote sensing: theory, methods, and applications. IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. 6(2), 459–465 (2013). https://doi.org/10.1109/JSTARS.2013.2257422

    Article  Google Scholar 

  4. Zhu, H., Chu, B., Zhang, C., Liu, F., Jiang, L., He, Y.: Hyperspectral imaging for presymptomatic detection of tobacco disease with successive projections algorithm and machine-learning classifiers. Sci. Rep. 7(1), 4125 (2017). https://doi.org/10.1038/s41598-017-04501-2

    Article  Google Scholar 

  5. Liu, Z.Y., Qi, J.G., Wang, N.N., Zhu, Z.R., Luo, J., Liu, L.J.: Hyperspectral discrimination of foliar biotic damages in rice using principal component analysis and probabilistic neural network. Precis. Agric. 19, 973–991 (2018). https://doi.org/10.1007/s11119-018-9567-4

    Article  Google Scholar 

  6. Nagasubramanian, K., Jones, S., Singh, A.K., Sarkar, S., Singh, A., Ganapathysubramanian, B.: Plant disease identification using explainable 3d deep learning on hyperspectral images. Plant Methods 15(1), 98 (2019). https://doi.org/10.1186/s13007-019-0479-8

    Article  Google Scholar 

  7. Zhao, J., Fang, Y., Chu, G., Yan, H., Hu, L., Huang, L.: Identification of leaf-scale wheat powdery mildew (blumeria graminis f. sp. tritici) combining hyperspectral imaging and an SVM classifier. Plants 9(8), 936 (2020). https://doi.org/10.3390/plants9080936

    Article  Google Scholar 

  8. Hughes, G.: On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory 14(1), 55–63 (2003). https://doi.org/10.1109/TIT.1968.1054102

    Article  Google Scholar 

  9. Samat, A., Li, J., Liu, S., Du, P., Miao, Z., Luo, J.: Improved hyperspectral image classification by active learning using pre-designed mixed pixels. Pattern Recognit. 51(C), 43–58 (2016). https://doi.org/10.1016/j.patcog.2015.08.019

    Article  Google Scholar 

  10. Chen, Y., Lin, Z., Xing, Z., Gang, W., Gu, Y.: Deep learning-based classification of hyperspectral data. IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. 7(6), 2094–2107 (2017). https://doi.org/10.1109/JSTARS.2014.2329330

    Article  Google Scholar 

  11. Li, Y., Xie, W., Li, H.: Hyperspectral image reconstruction by deep convolutional neural network for classification. Pattern Recogn. 63, 371–383 (2017). https://doi.org/10.1016/j.patcog.2016.10.019

    Article  Google Scholar 

  12. Li, J., Zhao, X., Li, Y., Du, Q., Xi, B., Hu, J.: Classification of hyperspectral imagery using a new fully convolutional neural network. IEEEGeosci. Remote Sens. Lett. 15(2), 292–296 (2018). https://doi.org/10.1109/LGRS.2017.2786272

    Article  Google Scholar 

  13. Tran, D., Bourdev, L., Fergus, R., Torresani, L., Paluri, M.: Learning spatiotemporal features with 3D convolutional networks. In: IEEE International Conference on Computer Vision (ICCV). pp. 4489–4497(2051). https://doi.org/10.1109/ICCV.2015.510

  14. Audebert, N., Saux, B.L., Lefèvre, S.: Deep learning for classification of hyperspectral data: a comparative review. IEEE Geosci. Remote Sens. Mag. 7(2), 159–173 (2019). https://doi.org/10.1109/MGRS.2019.2912563

    Article  Google Scholar 

  15. Zhang, H., Li, Y., Zhang, Y., Shen, Q.: Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network. Remote Sens. Lett. 8(4–6), 438–447 (2017). https://doi.org/10.1080/2150704X.2017.1280200

    Article  Google Scholar 

  16. Chen, Y., Jiang, H., Li, C., Jia, X., Ghamisi, P.: Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 54(10), 6232–6251 (2016). https://doi.org/10.1109/TGRS.2016.2584107

    Article  Google Scholar 

  17. Roy, S.K., Krishna, G., Dubey, S.R., Chaudhuri, B.B.: Hybridsn: exploring 3d–2d CNN feature hierarchy for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 17(2), 277–281 (2020). https://doi.org/10.1109/LGRS.2019.2918719

    Article  Google Scholar 

  18. Zhong, Z., Li, J., Luo, Z., Chapman, M.: Spectral-spatial residual network for hyperspectral image classification: a 3-d deep learning framework. IEEE Trans. Geosci. Remote Sens. 56(2), 847–858 (2017). https://doi.org/10.1109/TGRS.2017.2755542

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Program for Innovative Research Team in University of Tianjin (No. TD13-5034) and the Natural Science Foundation of Tianjin City (No. 18JCYBJC15300).

Author information

Authors and Affiliations

  1. School of Life Sciences, Tiangong University, Tianjin, 300387, China

    Zhitao Xiao, Lei Geng, Fang Zhang & Yanbei Liu

  2. School of Electrical and Electronic Engineering, Tiangong University, Tianjin, 300387, China

    Kai Yin & Jun Wu

  3. Tianjin Key Laboratory of Optoelectronic Detection Technology and Systems, Tianjin, 300387, China

    Zhitao Xiao, Kai Yin, Lei Geng, Jun Wu, Fang Zhang & Yanbei Liu

Authors
  1. Zhitao Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kai Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Geng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yanbei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Geng.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiao, Z., Yin, K., Geng, L. et al. Pest identification via hyperspectral image and deep learning. SIViP 16, 873–880 (2022). https://doi.org/10.1007/s11760-021-02029-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-021-02029-7

Keywords

Search

Navigation