Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Deep neural network based date palm tree detection in drone imagery

Published: 01 January 2022 Publication History

Highlights

Automatic date palm tree detection algorithm in drone imagery.
Detecting crowded date palm trees using YOLO-V5.
Comparison of one-stage object detection methods for date palm tree detection.

Abstract

Date palm trees are an important economic crop in the Arabian Peninsula, Middle East, and North Africa. Counting the numbers and determining the locations of date palm trees are important for predicting the date production and plantation management. In this paper, we exploit the effective use of the state-of-the-art CNN, YOLO-V5, in detecting date palm trees in images captured by a camera onboard of a drone flying 122 m above farmlands in the Northern Emirates of the United Arab Emirates (UAE). In the dataset preparation process, we randomly selected 125 captured images and divided them into three datasets: training (60%), validation (20%), and testing (20%). The images of date palm trees in the training and validation datasets were manually annotated and those in the training dataset were used to train the four sub-versions of YOLO-V5 CNNs. The validation dataset was used during the training process to assess how well the network was performing during training. Finally, the images in the test dataset were used to evaluate the performance of the trained models. The results of using YOLO-V5 for date palm tree detection in drone imagery are compared with those obtainable with other popular CNN architectures, YOLO-V3, YOLO-V4, and SSD300, both quantitatively and qualitatively. The results show that for the amount of training data used, YOLO-V5m (medium depth) model records the highest accuracy, resulting in a mean average precision of 92.34%. Further it provides the ability to detect and localize date palm trees of different sizes, in crowded, overlapped environments and areas where the date palm tree distribution is sparse. Therefore, it is concluded that the method can be a useful component of an automated plantation management system and help forecast the quantities of date production and condition monitoring of the date palm trees.

References

[1]
Amanat Ali, M. Mostafa Waly, Mohamed Essa, Sankar Devaranjan, 26 Nutritional and medicinal, Dates: Prod., Proces., Food Med. Values (2012) 361.
[2]
I. Loutfy, EI-Juhany, “Degradation of date palm trees and date production in arab countries: causes and potential rehabilitation”, Aust. J. Basic Appl. Sci. 4 (8) (2010) 3998–4010.
[3]
F. Adam, M. Monks, T. Esch, M. Datcu, Cloud removal in high resolution multispectral satellite imagery: comparing three approaches, Multidisciplinary Digital Publ. Institu. Proc. 2 (7) (2018) 353.
[4]
Andrew P. Colefax, Paul A. Butcher, Brendan P. Kelaher, The potential for unmanned aerial vehicles (UAVs) to conduct marine fauna surveys in place of manned aircraft, ICES J. Marine Sci. 75 (1 (January/February)) (2018) 1–8.
[5]
A. Singh, D. Patil, S.N. Omkar, Eye in the sky: Real-time drone surveillance system (dss) for violent individuals identification using scatternet hybrid deep learning network, in: Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition Workshops , 2018, pp. 1629–1637.
[6]
M. Saqib, Sultan Daud Khan, Nabin Sharma, Paul Scully-Power, Paul Butcher, Andrew Colefax, Michael Blumenstein, Real-time drone surveillance and population estimation of marine animals from aerial imagery, in: 2018 International Conference on Image and Vision Computing New Zealand , 2018, pp. 1–6.
[7]
C. Sampedro, A. Rodriguez-Ramos, H. Bavle, A. Carrio, P. de la Puente, P. Campoy, A fully-autonomous aerial robot for search and rescue applications in indoor environments using learning-based techniques, J. Intell. Rob. Syst. 95 (2) (2019) 601–627.
[8]
B. Mishra, D. Garg, P. Narang, V. Mishra, Drone-surveillance for search and rescue in natural disaster, Comput. Commun. 156 (2020) 1–10.
[9]
V. Puri, A. Nayyar, L. Raja, Agriculture drones: a modern breakthrough in precision agriculture, J. Statistics Manag. Syst. 20 (4) (2017) 507–518.
[10]
Marek Kulbacki, Jakub Segen, Wojciech Kniec, Rayszard Klempouse, Konrad Kluwak, Jan Nikodem, Julita Kulbacka, Andrea Serester, Survey of drones for agriculture automation from planting to harvest, in: 2018 IEEE 22nd International Conference on Intelligent Engineering Systems (INES), 2018, pp. 353–358.
[11]
G. Ore, M.S. Alcantara, J.A. Goes, L.P. Oliveira, J. Yepes, B. Teruel, V. Castro, L.S. Bins, F. Castro, D. Luebeck, L.F. Moreira, L.H. Gabrielli, H.E. Hernandez-Figueroa, Crop growth monitoring with drone-borne DInSAR, Remote Sensing 12 (4) (2020) 615–632.
[12]
Y. Bazi, S. Malek, N. Alajlan, H. AlHichri, An automatic approach for palm tree counting in uav images, in: 2014 IEEE Geoscience and Remote Sensing Symposium , 2014, pp. 537–540.
[13]
A. Manandhar, L. Hoegner, U. Stilla, Palm tree detection using circular autocorrelation of polar shape matrix, ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Inform. Sci. 3 (2016) 465–472.
[14]
W. Li, H. Fu, Le Yu, A. Cracknell, Haohuan Fu, Le Yu, Arthur Cracknell, Deep learning based oil palm tree detection and counting for high-resolution remote sensing images, Remote Sensing 9 (1) (2017) 22,.
[15]
M. Zortea, M. Nery, B. Ruga, L.B. Carvalho, A.C. Bastos, Oil-palm tree detection in aerial images combining deep learning classifiers, in: IGARSS 2018 IEEE International Geoscience and Remote Sensing Symposium, 2018, pp. 657–660.
[16]
J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, in: Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 779–788.
[17]
R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in: Proceedings of the IEEE conference on computer vision and pattern recognition , 2014, pp. 580–587.
[18]
R. Girshick, Fast r-cnn, in: Proceedings of the IEEE international conference on computer vision , 2015, pp. 1440–1448.
[19]
S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: Towards real-time object detection with region proposal networks, in: Advances in neural information processing systems , 2015, pp. 91–99.
[20]
J. Redmon, A. Farhadi, Yolo9000: better, faster, stronger, in: Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 7263–7271.
[21]
Joseph Redmon and Ali Farhadi. 2018. “Yolov3: An incremental improvement,” arXiv preprintarXiv:1804.02767.
[22]
Y. Nie, P. Sommella, M. O’Nils, C. Liguori, J. Lundgren, Automatic detection of Melanoma with Yolo deep convolutional neural networks, in: 2019 E-Health and Bioengineering Conference (EHP), 2019, pp. 1–4.
[23]
S. Yao, Y. Chen, X. Tian, R. Jiang, S. Ma, An improved algorithm for detecting Pneumonia based on Yolov3, Appl. Sci. 10 (5) (2020) 1818–1833.
[24]
W. Liu, L. Ma, H.e. Chen, Arbitrary-oriented ship detection framework in optical remote sensing images, IEEE Geosci. Remote Sensing Lett. 15 (6) (2018) 937–941.
[25]
H. Ma, Y. Liu, Y. Ren, Y.u. Jingzian, Detection of collapsed buildings in post-earthquake remote sensing images based on the improved YOLOv3, Remote Sensing 12 (1) (2020) 44–62.
[26]
H. Zhang, L. Qin, J. Li, Y. Guo, Y.a. Zhou, J. Zhang, X.u. Zhi, Real-time detection method for small traffic signs based on Yolov3, IEEE Access 8 (2020) 64145–64156.
[27]
Bedada Bekele Dursa, and Kula Kekeba Tune. 2020. “Developing traffic congestion detection model using deep learning approach: a case study of Addis Ababa city road,” https://doi.org/10.21203/rs.3.rs-113234/v1.
[28]
Xue Yueju, Huang Ning, Tu ShuQin, Mao Liang, Yang AQing, Zhu XunMu, Yang XiaoFan, Chen PengFei, Immature mango detection based on improve Yolov2, Trans. Chinese Soci. Agric. Eng. 34 (7) (2018) 173–179.
[29]
Yunong Tian, Guodong Yang, Zhe Wang, Hao Wang, En Li, Zize Liang, Apple detection during different growth stages in orchards using the improved Yolo-v3 model, Comput. Electron. Agric. 157 (2019) 417–426.
[30]
G. Liu, Joseph Christian Nouaze, Philippe Lyonel Touko Mbouembe, Jae Ho Kim, Yolo-Tomato: A robust algorithm for tomato detection base on YOLOv3, Sensors 20 (7) (2020) 2145–2164.
[31]
Yuwen Chen, Chao Zhang, Tengfei Qiao, Jianlin Xiong, Bin Liu, Ship detection in optical sensing images based on YOLOv5, in: Twelfth International Conference on Graphics and Image Processing , 2021, p. 117200E.
[32]
Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Fu Cheng-Yang, Alexander CBerg, Ssd: Single shot multibox detector, in: European conference on computer vision, Springer, 2016, pp. 21–37.
[33]
Chien-Yao Wang, Hong-Yuan Mark Liao, Yueh-Hua Wu, Ping-Yang Chen, Jun-Wei Hsieh, I-Hau Yeh, CSPNet: A new backbone that can enhance learning capability of CNN, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, 2020, pp. 390–391.
[34]
Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, Jiaya Jia, Path aggregation network for instance segmentation, in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 8759–8768.
[35]
K. He, X. Zhang, S. Ren, J. Sub, Spatial pyramid pooling in deep convolutional networks for visual recognition, IEEE Trans. Pattern Anal. Mach. Intell. 37 (9) (2015) 1904–1916.
[36]
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollar, C. Lawrence Zitnick, Common objects in context, in: European conference on computer vision, Springer, 2014, pp. 740–755.
[37]
Joseph Nelson and Jacob Solawetz. 2020. YOLOv5 is here: state-of-the-art object detection at 140 fps, accessed: 2020-11-12. https://blog.roboflow.com/yolov5-is-here/.
[38]
Tzutalin. 2015. LabelImg, accessed: 2020-10-15. https://github.com/tzutalin/labelImg.
[39]
Bochkovskiy, A., Wang, C. Y., and Liao, H. Y. M. 2020. "Yolov4: optimal speed and accuracy of object detection," arXiv preprint arXiv:2004.10934.

Cited By

View all

Index Terms

  1. Deep neural network based date palm tree detection in drone imagery
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image Computers and Electronics in Agriculture
      Computers and Electronics in Agriculture  Volume 192, Issue C
      Jan 2022
      772 pages

      Publisher

      Elsevier Science Publishers B. V.

      Netherlands

      Publication History

      Published: 01 January 2022

      Author Tags

      1. Convolutional Neural Networks
      2. Date palm tree
      3. Object detection
      4. Drone imagery
      5. YOLO-V5

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 18 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)DenseViT-XGBNeurocomputing10.1016/j.neucom.2024.127976596:COnline publication date: 1-Sep-2024
      • (2024)Agricultural object detection with You Only Look Once (YOLO) AlgorithmComputers and Electronics in Agriculture10.1016/j.compag.2024.109090223:COnline publication date: 1-Aug-2024
      • (2023)Deep Learning Model for Automatic Detection of Oil Palm Trees in Indonesia with YOLO-V5Proceedings of the 8th International Conference on Sustainable Information Engineering and Technology10.1145/3626641.3626924(39-44)Online publication date: 24-Oct-2023
      • (2023)Detection of Oil Palm Trees Using Deep Learning Method with High-Resolution Aerial Image DataProceedings of the 8th International Conference on Sustainable Information Engineering and Technology10.1145/3626641.3626667(90-98)Online publication date: 24-Oct-2023
      • (2023)Hybrid Deep-Machine Learning Model for Modified Leader-Follower Consensus Tracking Control UAVs Flock StrategyProceedings of the 2023 International Conference on Frontiers of Artificial Intelligence and Machine Learning10.1145/3616901.3616997(252-255)Online publication date: 14-Apr-2023
      • (2023)Tomato 3D pose detection algorithm based on keypoint detection and point cloud processingComputers and Electronics in Agriculture10.1016/j.compag.2023.108056212:COnline publication date: 1-Sep-2023
      • (2023)Using lightweight deep learning algorithm for real-time detection of apple flowers in natural environmentsComputers and Electronics in Agriculture10.1016/j.compag.2023.107765207:COnline publication date: 1-Apr-2023
      • (2023)Detecting volunteer cotton plants in a corn field with deep learning on UAV remote-sensing imageryComputers and Electronics in Agriculture10.1016/j.compag.2022.107551204:COnline publication date: 1-Jan-2023
      • (2022)A Comparative Study of YOLOv5 models on American Sign Language DatasetProceedings of the 7th International Conference on Sustainable Information Engineering and Technology10.1145/3568231.3568233(3-7)Online publication date: 22-Nov-2022
      • (2022)LDS-YOLOComputers and Electronics in Agriculture10.1016/j.compag.2022.107035198:COnline publication date: 1-Jul-2022

      View Options

      View options

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media