Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

ZS-DML: Zero-Shot Deep Metric Learning approach for plant leaf disease classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Automatic plant disease detection plays an important role in food security. Deep learning methods are able to detect precisely various types of plant diseases but at the expense of using huge amounts of resources (processors and data). Therefore, employing few-shot or zero-shot learning methods is unavoidable. Deep Metric Learning (DML) is a widely used technique for few/zero shot learning. Existing DML methods extract features from the last hidden layer of a pre-trained deep network, which increases the dependence of the specific features on the observed classes. In this paper, the general discriminative feature learning method is used to learn general features of plant leaves. Moreover, a proxy-based loss is utilized that learns the embedding without sampling phase while having a higher convergence rate. The network is trained on the Plant Village dataset where the images are split into 32 and 6 classes as source and target, respectively. The knowledge learned from the source domain is transferred to the target in a zero-shot setting. A few samples of the target domain are presented to the network as a gallery. The network is then evaluated on the target domain. The experimental results show that by presenting few or even only one sample of new classes to the network without fine-tuning step, our method can achieve a classification accuracy of 99%/80.64% for few/one image(s) per class.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

The dataset used in the experiments is publicly available and can be downloaded from the following link: https://github.com/spMohanty/PlantVillage-Dataset/tree/master/raw/color.

Notes

  1. https://github.com/dichotomies/proxy-nca

  2. Normalized Mutual Information

References

  1. Fina F et al (2013) Automatic plant pest detection and recognition using k-means clustering algorithm and correspondence filters. Int J Adv Biotechnol Res 4(2):189–199

    Google Scholar 

  2. Li L, Zhang S, Wang B (2021) Plant Disease Detection and Classification by Deep Learning—A Review. IEEE Access 9:56683–56698

    Article  Google Scholar 

  3. Ebrahimi M et al (2017) Vision-based pest detection based on SVM classification method. Comput Electron Agric 137:52–58

    Article  Google Scholar 

  4. Grinblat GL et al (2016) Deep learning for plant identification using vein morphological patterns. Comput Electron Agric 127:418–424

    Article  Google Scholar 

  5. Dyrmann M, Karstoft H, Midtiby HS (2016) Plant species classification using deep convolutional neural network. Biosyst Eng 151:72–80

    Article  Google Scholar 

  6. Abade A, Ferreira PA, de Barros Vidal F (2021) Plant diseases recognition on images using convolutional neural networks: A systematic review. Comput Electron Agric 185:106125

    Article  Google Scholar 

  7. Kamilaris A, Prenafeta-Boldú FX (2018) Deep learning in agriculture: A survey. Comput Electron Agric 147:70–90

    Article  Google Scholar 

  8. Argüeso D et al (2020) Few-Shot Learning approach for plant disease classification using images taken in the field. Comput Electron Agric 175:105542

    Article  Google Scholar 

  9. Wang Y et al (2020) Generalizing from a few examples: A survey on few-shot learning. ACM Comput Surv (CSUR) 53(3):1–34

    Article  Google Scholar 

  10. Yao H et al (2019) Deep representation learning with part loss for person re-identification. IEEE Trans Image Process 28(6):2860–2871

    Article  MathSciNet  Google Scholar 

  11. Abbas A et al (2021) Tomato plant disease detection using transfer learning with C-GAN synthetic images. Comput Electron Agric 187:106–279

    Article  Google Scholar 

  12. Espejo-Garcia B et al (2021) Combining generative adversarial networks and agricultural transfer learning for weeds identification. Biosyst Eng 204:79–89

    Article  Google Scholar 

  13. Bedi P, Gole P (2021) Plant disease detection using hybrid model based on convolutional autoencoder and convolutional neural network. Artificial Intell Agri 5:90–101

    Google Scholar 

  14. Yang M-M, Nayeem A, Shen L-L (2017) Plant classification based on stacked autoencoder. in 2017 IEEE 2nd Information Technology, Networking,Electronic and Automation Control Conference (ITNEC). Chengdu, China: IEEE

  15. Li Y, Yang J (2021) Meta-learning baselines and database for few-shot classification in agriculture. Comput Electron Agric 182:106055

    Article  Google Scholar 

  16. Zhai D et al. (2022) Rectified meta-learning from noisy labels for robust image-based plant disease diagnosis. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM). 18.1s: p. 1-17

  17. Hoffer E, Ailon N (2015) Deep metric learning using triplet network. in International workshop on similarity-based pattern recognition. Copenhagen, Denmark: Springer

  18. Wang B, Wang D (2019) Plant leaves classification: A few-shot learning method based on siamese network. IEEE Access 7:151754–151763

    Article  Google Scholar 

  19. Zabihzadeh D, Alitbi Z, Mousavirad SJ (2021) Ensemble of Loss Functions to Improve Generalizability of Deep Metric Learning methods. arXiv preprint arXiv:2107.01130 (2021)

  20. Liang X (2021) Few-shot cotton leaf spots disease classification based on metric learning. Plant Methods 17:1–11

    Article  Google Scholar 

  21. Hu G et al (2019) A low shot learning method for tea leaf’s disease identification. Comput Electron Agric 163:104852

    Article  Google Scholar 

  22. Zhong F et al (2020) Zero-and few-shot learning for diseases recognition of Citrus aurantium L. using conditional adversarial autoencoders. Comput Electron Agric 179:105828

    Article  Google Scholar 

  23. Lin H et al. (2022) The Positive Effect of Attention Module in Few-Shot Learning for Plant Disease Recognition, in 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI). IEEE. p. 114-120

  24. Janarthan S et al (2020) Deep metric learning based citrus disease classification with sparse data. IEEE Access 8:162588–162600

    Article  Google Scholar 

  25. Schuler J et al (2022) Color-Aware Two-Branch DCNN for Efficient Plant Disease Classificat. MENDEL 28(1):55–62

    Article  Google Scholar 

  26. Qian Q et al. (2019) Softtriple loss: Deep metric learning without triplet sampling. in Proceedings of the IEEE International Conference on Computer Vision

  27. Movshovitz-Attias Y et al. (2017) No fuss distance metric learning using proxies. in Proceedings of the IEEE International Conference on Computer Vision

  28. Al-Kaabi K, Monsefi R, Zabihzadeh D (2022) A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks. Applied Intelligence, p. 1-19

  29. Szegedy C et al. (2016) Rethinking the inception architecture for computer vision. in Proceedings of the IEEE conference on computer vision and pattern recognition

  30. Shen T et al. (2018) Disan: Directional self-attention network for rnn/cnn-free language understanding. in Proceedings of the AAAI Conference on Artificial Intelligence

  31. Kim S et al. (2020) Proxy anchor loss for deep metric learning. in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

  32. Hughes D, Salathé M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint arXiv:1511.08060

  33. Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9(11):2579–2605

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Engineering Department, Hakim Sabzevari University, Sabzevar, 9617976487, Iran

    Davood Zabihzadeh & Mina Masoudifar

Authors
  1. Davood Zabihzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mina Masoudifar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mina Masoudifar.

Ethics declarations

Conflicts of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zabihzadeh, D., Masoudifar, M. ZS-DML: Zero-Shot Deep Metric Learning approach for plant leaf disease classification. Multimed Tools Appl 83, 54147–54164 (2024). https://doi.org/10.1007/s11042-023-17136-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17136-5

Keywords

Search

Navigation