Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

Pixel-Level Weed Classification Using Evolutionary Selection of Local Binary Pattern in a Stochastic Optimised Ensemble

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

In the early growth stages of young crops, weeds compete for living resources while often grow close together and with overlaps. Conventional weeding techniques such as mechanical weeding and herbicide application are not precision methods. To allow for high precision target and spraying of weeds, autonomous field robots equipped with computer vision systems could be deployed to manage and control the weeds in the crop line. The robots are therefore required to classify weeds at pixel-level accuracy with high recall rates. This paper presents a pixel-level weed classification model using rotation-invariant uniform local binary pattern (LBP) features. The model design is based on an ensemble with a two-level optimisation structure. The first-level leverages on Genetic Algorithm (GA) optimisation to select the best rotation-invariant uniform LBP configurations. The second level utilises covariance matrix adaptation evolution strategy (CMA-ES) in the Neural Network (NN) ensemble to select the best combinations of voting weights of the predicted outcome for each classifier. This model design allows for different feature inputs selected by GA for each of the NN classifiers in the ensemble, unlike classical ensembles which share the same input data. For ensemble weight optimisation, we compared differential evolution, particle swarm optimisation, and CMA-ES. A crop/weed field image dataset public dataset consisting of 60 images of weeds and carrots at early true leaf stage was used for validation with existing works. The results demonstrated that our LBP-based pixel-level classifier exhibits excellent predictive capability with high recall and F1 scores when compared to the literature. It was found that CMA-ES optimised ensemble gave the best configuration and demonstrated a classification accuracy of 87.9%, which exceeded the existing statistical feature classification of 85.9%. This highlights some potentialities for chip-based application-specific integrated circuit LBP pixel-level weed classification in smart agriculture applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ahmad J, Muhammad K, Ahmad I, Ahmad W, Smith ML, Smith LN, Jain DK, Wang H, Mehmood I. Visual features based boosted classification of weeds for real-time selective herbicide sprayer systems. Comput Ind. 2018;98:23–33.

    Article  Google Scholar 

  2. Ahmed F, Bari AH, Shihavuddin A, Al-Mamun HA, Kwan P. A study on local binary pattern for automated weed classification using template matching and support vector machine. In: 2011 IEEE 12th International Symposium on computational intelligence and informatics (CINTI). IEEE; 2011. pp. 329–34.

  3. Ahmed F, Kabir MH, Bhuyan S, Bari H, Hossain E. Automated weed classification with local pattern-based texture descriptors. Int Arab J Inf Technol. 2014;11(1):87–94. https://www.researchgate.net/publication/287956202_Automated_Weed_Classification_with_Local_Pattern-Based_Texture_Descriptors.

    Google Scholar 

  4. Bishop CM. Pattern recognition and machine learning. New York: Springer; 2006.

    MATH  Google Scholar 

  5. Boutellier J, Lundbom I, Janhunen J, Ylimäinen J, Hannuksela J. Application-specific instruction processor for extracting local binary patterns. In: Proceedings of the 2012 conference on design and architectures for signal and image processing. IEEE; 2012. pp. 1–8. https://ieeexplore.ieee.org/document/6385363.

  6. Deep K, Singh KP, Kansal ML, Mohan C. A real coded genetic algorithm for solving integer and mixed integer optimization problems. Appl Math Comput. 2009;212(2):505–18.

    MathSciNet  MATH  Google Scholar 

  7. Deep K, Thakur M. A new crossover operator for real coded genetic algorithms. Appl Math Comput. 2007;188(1):895–911.

    MathSciNet  MATH  Google Scholar 

  8. Deep K, Thakur M. A new mutation operator for real coded genetic algorithms. Appl Math Comput. 2007;193(1):211–30.

    MathSciNet  MATH  Google Scholar 

  9. Kennedy, J, Eberhart, R. Particle swarm optimization. In: Proceedings of ICNN’95 - International Conference on Neural Networks, vol. 4, pp. 1942–48. 1995. https://doi.org/10.1109/ICNN.1995.488968.

  10. Fumera G, Roli F. A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Trans Pattern Anal Mach Intell. 2005;27(6):942–56.

    Article  Google Scholar 

  11. Hansen N. References to CMA-ES applications. http://www.cmap.polytechnique.fr/~nikolaus.hansen/cmaapplications.pdf. 2009.

  12. Hansen N, Müller SD, Koumoutsakos P. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol Comput. 2003;11(1):1–18.

    Article  Google Scholar 

  13. Haug S, Michaels A, Biber P, Ostermann J. Plant classification system for crop/weed discrimination without segmentation. In: Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on. IEEE; 2014. pp. 1142–49. https://doi.org/10.1109/WACV.2014.6835733.

  14. Haug S., Ostermann J. (2015) A Crop/Weed Field Image Dataset for the Evaluation of Computer Vision Based Precision Agriculture Tasks. In: Agapito L., Bronstein M., Rother C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science, vol 8928. Springer, Cham. https://doi.org/10.1007/978-3-319-16220-1_8.

  15. Hu MC, Ng KS, Chen PY, Hsiao YJ, Li CH. Local binary pattern circuit generator with adjustable parameters for feature extraction. IEEE Trans Intell Transp Syst. 2017;19(8):2582–91. https://doi.org/10.1109/TITS.2017.2758387.

    Article  Google Scholar 

  16. Jin H, Liu Q, Lu H, Tong X. Face detection using improved LBP under Bayesian framework. In: Third International Conference on Image and Graphics (ICIG’04). IEEE; 2004. pp. 306–09. https://doi.org/10.1109/ICIG.2004.62.

  17. Kittler J. Combining classifiers: a theoretical framework. Pattern Anal Appl. 1998;1(1):18–27.

    Article  Google Scholar 

  18. Kittler J, Hatef M, Duin RP, Matas J. On combining classifiers. IEEE Trans Pattern Anal Mach Intell. 1998;20(3):226–39.

    Article  Google Scholar 

  19. Koza JR, Koza JRJR. Genetic programming: on the programming of computers by means of natural selection. Cambridge: MIT Press; 1992.

    MATH  Google Scholar 

  20. Kuncheva LI. Combining pattern classifiers: methods and algorithms. New York: Wiley; 2014.

    MATH  Google Scholar 

  21. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436.

    Article  Google Scholar 

  22. Liu L, Fieguth P, Zhao G, Pietikäinen M, Hu D. Extended local binary patterns for face recognition. Inf Sci. 2016;358:56–72.

    Article  Google Scholar 

  23. Mäenpää T, Pietikäinen M. Texture analysis with local binary patterns. In: Handbook of pattern recognition and computer vision. World Scientific; 2005. pp. 197–16. https://doi.org/10.1142/9789812775320_0011.

  24. McCool C, Perez T, Upcroft B. Mixtures of lightweight deep convolutional neural networks: Applied to agricultural robotics. IEEE Robot Autom Lett. 2017;2(3):1344–51.

    Article  Google Scholar 

  25. Md. Jan Z, Verma B. Evolutionary classifier and cluster selection approach for ensemble classification. ACM Trans Knowl Discov Data (TKDD). 2019;14(1):1–18.

    Google Scholar 

  26. Møller MF. A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 1993;6(4):525–33.

    Article  Google Scholar 

  27. Ojala T, Pietikäinen M, Mäenpää T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell. 2002;7:971–87.

    Article  MATH  Google Scholar 

  28. Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9(1):62–6.

    Article  Google Scholar 

  29. Paul S, Das S. Simultaneous feature selection and weighting-an evolutionary multi-objective optimization approach. Pattern Recogn Lett. 2015;65:51–9.

    Article  Google Scholar 

  30. Price K.V. (2013) Differential Evolution. In: Zelinka I., Snášel V., Abraham A. (eds) Handbook of Optimization. Intelligent Systems Reference Library, vol 38. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30504-7_8.

  31. Sylvester J, Chawla NV. Evolutionary ensembles: combining learning agents using genetic algorithms. In: AAAI Workshop on Multiagent Learning; 2005. pp. 46–51. https://www.aaai.org/Papers/Workshops/2005/WS-05-09/WS05-09-008.pdf.

  32. Tajeripour F, Kabir E, Sheikhi A. Fabric defect detection using modified local binary patterns. EURASIP J Adv Signal Process. 2008;2008:60.

    MATH  Google Scholar 

  33. Thornton P, Fawcett R, Dent J, Perkins T. Spatial weed distribution and economic thresholds for weed control. Crop Prot. 1990;9(5):337–42.

    Article  Google Scholar 

  34. Torres-Sospedra J, Nebot P. Two-stage procedure based on smoothed ensembles of neural networks applied to weed detection in orange groves. Biosyst Eng. 2014;123:40–55.

    Article  Google Scholar 

  35. Torres Sospedra J, et al. Ensembles of artificial neural networks: Analysis and development of design methods. Ph.D. thesis, Universitat Jaume I. 2011.

  36. Umamaheswari S, Arjun R, Meganathan D. Weed detection in farm crops using parallel image processing. In: 2018 Conference on Information and Communication Technology (CICT). IEEE; 2018. pp. 1–4.

  37. Zhao G, Pietikainen M. Local binary pattern descriptors for dynamic texture recognition. In: 18th International Conference on Pattern Recognition (ICPR’06), vol. 2. IEEE; 2006. pp. 211–14. https://doi.org/10.1109/ICPR.2006.768.

Download references

Acknowledgements

We thank the authors Lenin Gopal and Choo W. R. Chiong for their assistance in running the experiments to compare against non-evolutionary ensemble classifiers as recommended by the reviewers. They have also contributed to the literature review on ensemble design and evolutionary feature selection and the discussions on time complexity.

Author information

Authors and Affiliations

  1. Curtin University Malaysia, CDT 250, 98009, Miri, Sarawak, Malaysia

    Basil Andy Lease, W. K. Wong, Lenin Gopal & Choo W. R. Chiong

Authors
  1. Basil Andy Lease
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. W. K. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lenin Gopal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Choo W. R. Chiong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Basil Andy Lease.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lease, B.A., Wong, W.K., Gopal, L. et al. Pixel-Level Weed Classification Using Evolutionary Selection of Local Binary Pattern in a Stochastic Optimised Ensemble. SN COMPUT. SCI. 1, 337 (2020). https://doi.org/10.1007/s42979-020-00357-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-020-00357-y

Keywords

Search

Navigation