Contrasting bean analysis system based on YOLOv5 and a neural network model using the interval type-2 fuzzy set approach
Authors: 
José L. Rodríguez-Álvarez, Jorge L. García-Alcaraz, Rita Puig i Vidal, Alondra Soto-CabralAuthors Info & Claims
Pages 18807 - 18824
Abstract
Beans are a legume that has historically been a cheap source of protein, in the daily human diet. Therefore, it is challenging that the quality of this legume be guaranteed. In this work, we propose a novelty system for evaluating the contrasting bean quality, combining an algorithm for detecting black variety bean kernels and a neural network model based on an interval type-2 fuzzy set approach for weight estimation. To perform the detection task, YOLOv5 was used, which achieved favorable results, with an accuracy of 0.998, recall of 0.997, mAP_0.5 of 0.995 and mAP_0.5:0.95 of 0.733. Meanwhile, a model based on artificial neural networks was developed to estimate the weight. However, since the current quality assessment system includes vagueness and uncertainty, to deal with this problem, the interval type-2 fuzzy set approach was used by converting the collected data to fuzzy numbers with trapezoidal membership to use them in the training and validation process. The model for weight estimation showed favorable results, with a variance explained by the model (R2) of 0.99, a mean squared error (MSE) of 0.02, mean absolute percentage error of 0.05, and a mean absolute error (MAE) of 0.12 g. Meanwhile, an MSE of 0.02 and MAE of 0.11 g were the results for data not included in the training and validation process. Finally, both models were incorporated into a graphical user interface to facilitate their use in a real quality assessment process. The experiments with the proposed system demonstrated its effectiveness in detecting and estimating weight dynamically and with acceptable accuracy.
References
[1]
Srivastava S and Mishra HN Detection of insect damaged rice grains using visible and near infrared hyperspectral imaging technique Chemom Intell Lab Sys 2022 221 104489
[2]
Kibar H and Kibar B Changes in some nutritional, bioactive and morpho-physiological properties of common bean depending on cold storage and seed moisture contents J Stored Prod Res 2019 84 101531
[3]
Mutari B, Sibiya J, Matova PM, Gasura E, and Simango K Drought stress impact on agronomic, shoot, physiological, canning and nutritional quality traits of navy beans (Phaseolus vulgaris L.) under field conditions in Zimbabwe Field Crops Res 2023 292 108826
[4]
Pujolà M, Farreras A, and Casañas F Protein and starch content of raw, soaked and cooked beans (Phaseolus vulgaris L.) Food Chem 2007 102 4 1034-1041
[5]
Assefa T et al. Pod harvest index as a selection criterion to improve drought resistance in white pea bean Field Crop Res 2013 148 24-33
[6]
Corzo-Ríos LJ, Sánchez-Chino XM, Cardador-Martínez A, Martínez-Herrera J, and Jiménez-Martínez C Effect of cooking on nutritional and non-nutritional compounds in two species of Phaseolus (P. vulgaris and P. coccineus) cultivated in Mexico Int J Gastronomy Food Sci 2020 20 100206
[7]
Estrada G, Guillén G, Olivares JE, Díaz C, Alvarado X, and Sánchez F La transformación genética y genómica del frijol Biotecnología 2007 14 3 281-290
[8]
n. d. NMX-FF-038-SCFI-2016, Productos alimenticios no industrializados para consumo humano–fabaceas–frijol (Phaseolus vulgaris L.)–Especificaciones y Métodos de prueba. Secretaría de Economía, México
[9]
(2021). Bean Inspection Handbook. Available: https://www.ams.usda.gov/sites/default/files/media/BeanHB.pdf
[10]
Salauddin Khan M et al. Comparison of multiclass classification techniques using dry bean dataset Int J Cognit Comput Eng 2023 4 6-20
[11]
Meenu M, Kurade C, Neelapu BC, Kalra S, Ramaswamy HS, and Yu Y A concise review on food quality assessment using digital image processing Trends Food Sci Technol 2021 118 106-124
[12]
Fujiyoshi H, Hirakawa T, and Yamashita T Deep learning-based image recognition for autonomous driving IATSS Res 2019 43 4 244-252
[13]
Barbedo JGA, Guarienti EM, and Tibola CS Detection of sprout damage in wheat kernels using NIR hyperspectral imaging Biosys Eng 2018 175 124-132
[14]
Delwiche SR, Yang IC, and Graybosch RA Multiple view image analysis of freefalling U.S. wheat grains for damage assessment Comput Electron Agric 2013 98 62-73
[15]
Jiang X et al. Study on method for on-line identification of wheat mildew by array fiber spectrometer Spectrosc Spectral Anal 2018 38 3729-3735
[16]
Xing J, Symons S, Shahin M, and Hatcher D Detection of sprout damage in Canada Western Red Spring wheat with multiple wavebands using visible/near-infrared hyperspectral imaging Biosys Eng 2010 106 2 188-194
[17]
Li C, Anwar S, Hou J, Cong R, Guo C, and Ren W Underwater image enhancement via medium transmission-guided multi-color space embedding Trans Image Process 2021 30 4985-5000
[18]
Li C et al. Low-light image and video enhancement using deep learning: a survey IEEE trans pattern anal mach intell 2021 44 12 9396-9416
[19]
Li C, Guo C, and Loy CC Learning to enhance low-light image via zero-reference deep curve estimation IEEE trans pattern anal mach intell 2021 44 8 4225-4238
[20]
Wang C et al. Study on pear flowers detection performance of YOLO-PEFL model trained with synthetic target images Front Plant Sci 2022 13 911473
[21]
Liu X et al (2018) Robust fruit counting: combining deep learning, tracking, and structure from motion. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 1045–1052
[22]
Zheng T, Jiang M, Li Y, and Feng M Research on tomato detection in natural environment based on RC-YOLOv4 Comput Electron Agric 2022 198 107029
[23]
Botelho BG, de Assis LP, and Sena MM Development and analytical validation of a simple multivariate calibration method using digital scanner images for sunset yellow determination in soft beverages Food Chem 2014 159 175-180
[24]
Franco MDOK, Suarez WT, dos Santos VB, and Resque IS A novel digital image method for determination of reducing sugars in aged and non-aged cachaças employing a smartphone Food Chem 2021 338 127800
[25]
Li L et al. Evaluation of black tea by using smartphone imaging coupled with micro-near-infrared spectrometer Spectrochim Acta Part A Mol Biomol Spectrosc 2021 246 118991
[26]
Minz PS, Sawhney IK, and Saini CS Algorithm for processing high definition images for food colourimetry Measurement 2020 158 107670
[27]
Rong J, Zhou H, Zhang F, Yuan T, and Wang P Tomato cluster detection and counting using improved YOLOv5 based on RGB-D fusion Comput Electron Agric 2023 207 107741
[28]
Cardellicchio A et al. Detection of tomato plant phenotyping traits using YOLOv5-based single stage detectors Comput Electron Agric 2023 207 107757
[29]
Liu YP, Yang CH, Ling H, Mabu S, Kuremoto T (2018) A visual system of citrus picking robot using convolutional neural networks In: 2018 5th international conference on systems and informatics (ICSAI), pp 344–349
[30]
Liu G, Nouaze JC, Touko Mbouembe PL, and Kim JH YOLO-tomato: a robust algorithm for tomato detection based on YOLOv3 Sensors 2020 20 7 2145
[31]
Tian Y, Yang G, Wang Z, Wang H, Li E, and Liang Z Apple detection during different growth stages in orchards using the improved YOLO-V3 model Comput Electron Agric 2019 157 417-426
[32]
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
[33]
Wang X and Liu J Tomato anomalies detection in greenhouse scenarios based on YOLO-Dense Front Plant Sci 2021
[34]
Wang D and He D Channel pruned YOLO V5s-based deep learning approach for rapid and accurate apple fruitlet detection before fruit thinning Biosys Eng 2021 210 271-281
[35]
Boogaard FP, Rongen KSAH, and Kootstra GW Robust node detection and tracking in fruit-vegetable crops using deep learning and multi-view imaging Biosys Eng 2020 192 117-132
[36]
Suo R et al. Improved multi-classes kiwifruit detection in orchard to avoid collisions during robotic picking Comput Electron Agric 2021 182 106052
[37]
Santos TT, De Souza LL, dos Santos AA, and Avila S Grape detection, segmentation, and tracking using deep neural networks and three-dimensional association Comput Electron Agric 2020 170 105247
[38]
Gai R, Chen N, and Yuan H A detection algorithm for cherry fruits based on the improved YOLO-v4 model Neural Comput Appl 2023 35 19 13895-13906
[39]
Fan S et al. Real-time defects detection for apple sorting using NIR cameras with pruning-based YOLOV4 network Comput Electron Agric 2022 193 106715
[40]
Lawal MO Tomato detection based on modified YOLOv3 framework Sci Rep 2021 11 1 1-11
[41]
Magalhães SA et al. Evaluating the single-shot multibox detector and YOLO deep learning models for the detection of tomatoes in a greenhouse Sensors 2021 21 10 3568
[42]
Zhang D-Y et al. Assessment of the levels of damage caused by Fusarium head blight in wheat using an improved YoloV5 method Comput Electron Agric 2022 198 107086
[43]
Zhao W, Liu S, Li X, Han X, and Yang H Fast and accurate wheat grain quality detection based on improved YOLOv5 Comput electron agric 2022 202 107426
[44]
Li J, Qiao Y, Liu S, Zhang J, Yang Z, and Wang M An improved YOLOv5-based vegetable disease detection method Comput Electron Agric 2022 202 107345
[45]
Aguilera J et al (2007) Computer vision for quality control in Latin American food industry, a case study. In: International conference on computer vision (ICCV2007): workshop on computer vision applications for developing countries, pp 1–8.
[46]
Kılıç K, Boyacı IH, Köksel H, and Küsmenoğlu İ A classification system for beans using computer vision system and artificial neural networks J Food Eng 2007 78 3 897-904
[47]
Laurent B, Ousman B, Dzudie T, Carl MM, and Emmanuel T Digital camera images processing of hard-to-cook beans J Eng Technol Res 2010 2 9 177-188
[48]
Venora G, Grillo O, Ravalli C, and Cremonini R Identification of Italian landraces of bean (Phaseolus vulgaris L.) using an image analysis system Sci Hortic 2009 121 4 410-418
[49]
Venora G, Grillo O, Ravalli C, and Cremonini R Tuscany beans landraces, on-line identification from seeds inspection by image analysis and linear discriminant analysis Agrochimica 2007 51 4–5 254-268
[50]
de Araújo SA, Pessota JH, and Kim HY Beans quality inspection using correlation-based granulometry Eng Appl Artif Intell 2015 40 84-94
[51]
Haykin S and Network N A comprehensive foundation Neural Netw 2004 2 2004 41
[52]
Rodríguez-Álvarez JL et al. Alternative method for determining basis weight in papermaking by using an interactive soft sensor based on an artificial neural network model Nord Pulp Pap Res J 2022 37 3 453-469
[53]
Zadeh LA Fuzzy sets Inf Control 1965 8 3 338-353
[54]
Sun S, Wu Q, Jiao L, Long Y, He D, and Song H Recognition of green apples based on fuzzy set theory and manifold ranking algorithm Optik 2018 165 395-407
[55]
Rodríguez-Álvarez JL, Lopez-Herrera R, Villalon-Turrubiates IE, Molina-Arredondo RD, Alcaraz JLG, and Hernández-Olvera ÓD Analysis and control of the paper moisture content variability by using fuzzy and traditional individual control charts Chemom Intell Lab Sys 2021 208 104211
[56]
Kaya İ and Turgut A Design of variable control charts based on type-2 fuzzy sets with a real case study Soft Comput 2021 25 1 613-633
[57]
Bochkovskiy A, Wang C-Y, Liao H-YM (2020). Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv: 10934
[58]
Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger [C]//Proceedings of the IEEE conference on computer vision and pattern recognition. In: YOLO9000: better, faster, stronger [C]//Proceedings of the IEEE conference on computer vision and pattern recognition
[59]
Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv preprint arXiv: 02767
[60]
Yu F et al. Improved YOLO-v5 model for boosting face mask recognition accuracy on heterogeneous IoT computing platforms Internet of Things 2023 23 100881
[61]
Karamichailidou D, Kaloutsa V, and Alexandridis A Wind turbine power curve modeling using radial basis function neural networks and tabu search Renew Energy 2021 163 2137-2152
[62]
Dayhoff JE (1990) Neural network architectures: an introduction. Van Nostrand Reinhold Co.,
[63]
Fausett LV Fundamentals of neural networks: architectures, algorithms and applications 2006 Hoboken Pearson Education India
[64]
Karayiannis N and Venetsanopoulos AN Artificial neural networks: learning algorithms, performance evaluation, and applications 1992 Berlin Springer Science & Business Media
[65]
Teuscher C Turing’s connectionism: an investigation of neural network architectures 2012 Berlin Springer Science & Business Media
[66]
Rosli N, Ibrahim R, Ismail I, Hassan SM, Chung TD (2016) Neural network architecture selection for efficient prediction model of gas metering system. In: 2016 2nd IEEE international symposium on robotics and manufacturing automation (ROMA), pp 1–5
[67]
Fath AH, Madanifar F, and Abbasi M Implementation of multilayer perceptron (MLP) and radial basis function (RBF) neural networks to predict solution gas-oil ratio of crude oil systems Petroleum 2020 6 1 80-91
[68]
Makesense.ai. Available: https://www.makesense.ai/
[69]
Hardt M, Recht B, Singer Y (2016) Train faster, generalize better: stability of stochastic gradient descent. In: International conference on machine learning, pp 1225–1234: PMLR
[70]
Ji W, Su X, Pang B, Li Y, Ren Z, and Deng S SGD-based optimization in modeling combustion kinetics: case studies in tuning mechanistic and hybrid kinetic models Fuel 2022 324 124560
[71]
Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: Proceedings of the IEEE international conference on computer vision, pp 1116–1124
[72]
Al-Janabi S, Alwan E (2017) Soft mathematical system to solve black box problem through development the FARB based on hyperbolic and polynomial functions. In: 2017 10th international conference on developments in esystems engineering (DeSE), pp 37–42: IEEE
[73]
Al-Janabi S, Rawat S, Patel A, and Al-Shourbaji I Design and evaluation of a hybrid system for detection and prediction of faults in electrical transformers Int J Electr Power Energy Sys 2015 67 324-335
[74]
Ali SH (2012) A novel tool (FP-KC) for handle the three main dimensions reduction and association rule mining. In: 2012 6th International conference on sciences of electronics, technologies of information and telecommunications (SETIT), pp 951–961: IEEE
[75]
Fazel Zarandi MH, Sadat Asl AA, Sotudian S, and Castillo O A state of the art review of intelligent scheduling Artif Intelle Rev 2020 53 501-593
[76]
Castillo O, Cervantes L, Soria J, Sanchez M, and Castro J A generalized type-2 fuzzy granular approach with applications to aerospace Inf Sci 2016 354 165-177
[77]
Cervantes L and Castillo O Type-2 fuzzy logic aggregation of multiple fuzzy controllers for airplane flight control Inf Sci 2015 324 247-256
[78]
Hidalgo D, Melin P, and Castillo O An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms Expert Syst Appl 2012 39 4 4590-4598
[79]
Sanchez MA, Castillo O, and Castro JR Generalized type-2 fuzzy systems for controlling a mobile robot and a performance comparison with interval type-2 and type-1 fuzzy systems Expert Syst Appl 2015 42 14 5904-5914
[80]
Castillo O, Amador-Angulo L, Castro JR, and Garcia-Valdez M A comparative study of type-1 fuzzy logic systems, interval type-2 fuzzy logic systems and generalized type-2 fuzzy logic systems in control problems Inf Sci 2016 354 257-274
[81]
Melin P, Gonzalez CI, Castro JR, Mendoza O, and Castillo O Edge-detection method for image processing based on generalized type-2 fuzzy logic IEEE Trans Fuzzy Syst 2014 22 6 1515-1525
[82]
Canario JP, Mello R, Curilem M, Huenupan F, and Rios R In-depth comparison of deep artificial neural network architectures on seismic events classification J Volcanol Geotherm Res 2020 401 106881
[83]
Géron A (2019) Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow: Concepts, tools, and techniques to build intelligent systems. O'Reilly Media
[84]
Napoli G and Xibilia MG Soft Sensor design for a topping process in the case of small datasets Comput Chem Eng 2011 35 11 2447-2456
[85]
Gadeo-Martos MA, Fernandez-Prieto JA, and Velasco JR An architecture for performance optimization in a collaborative knowledge-based approach for wireless sensor networks Sensors 2011 11 10 9136-9159
[86]
Vinoth B, Uma G, and Umapathy M Recurrent neural network based soft sensor for flow estimation in liquid rocket engine injector calibration Flow Meas Instrum 2022 83 102105
[87]
Volna E, Jarusek R, Kotyrba M, and Zacek J Training set fuzzification based on histogram to increase the performance of a neural network Appl Math Comput 2021 398 125994
[88]
Wang X, Huang J, Feng Q, and Yin D Winter wheat yield prediction at county level and uncertainty analysis in main wheat-producing regions of china with deep learning approaches Remote Sens 2020 12 11 1744
[89]
Coviello L, Cristoforetti M, Jurman G, and Furlanello C GBCNet: in-field grape berries counting for yield estimation by dilated CNNs Appl Sci 2020 10 14 4870
[90]
Lin T et al. DeepCropNet: a deep spatial-temporal learning framework for county-level corn yield estimation Environ Res Lett 2020 15 3 034016
[91]
Elavarasan D and Vincent PD Crop yield prediction using deep reinforcement learning model for sustainable agrarian applications IEEE access 2020 8 86886-86901
[92]
Oikonomidis A, Catal C, and Kassahun A Hybrid deep learning-based models for crop yield prediction Appl Artif Intell 2022 36 1 2031822
[93]
Rodríguez-Álvarez José L, García-Alcaraz JL, Puig i Vidal R, Cuevax-Jacques R, and Díaz-Reza JR Noninvasive system for weight estimation in cactus crops: a YOLOv5-decision tree approach based on interval type-2 fuzzy sets Chemom Intell Lab Sys 2024 245 105064
[94]
Wang F, Zheng J, Tian X, Wang J, Niu L, and Feng W An automatic sorting system for fresh white button mushrooms based on image processing Comput Electron Agric 2018 151 416-425
[95]
Song W, Jiang N, Wang H, and Vincent J Use of smartphone videos and pattern recognition for food authentication Sens Actuators B Chem 2020 304 127247
[96]
Liu Q, Zhang Y, and Yang G Small unopened cotton boll counting by detection with MRF-YOLO in the wild Comput Electron Agric 2023 204 107576
[97]
Bao W, Zhu Z, Hu G, Zhou X, Zhang D, and Yang X UAV remote sensing detection of tea leaf blight based on DDMA-YOLO Comput Electron Agric 2023 205 107637
[98]
Dang F, Chen D, Lu Y, and Li Z YOLOWeeds: a novel benchmark of YOLO object detectors for multi-class weed detection in cotton production systems Comput Electron Agric 2023 205 107655
[99]
Xu W et al. A lightweight SSV2-YOLO based model for detection of sugarcane aphids in unstructured natural environments Comput Electron Agric 2023 211 107961
[100]
Moreira G, Magalhães SA, Pinho T, Dos Santos FN, and Cunha M Benchmark of deep learning and a proposed HSV colour space models for the detection and classification of greenhouse tomato Agronomy 2022 12 2 356
[101]
Kumar P and Kumar N Drone-based apple detection: finding the depth of apples using YOLOv7 architecture with multi-head attention mechanism Smart Agric Technol 2023 5 100311
[102]
Saqib MA, Aqib M, Tahir MN, and Hafeez Y Towards deep learning based smart farming for intelligent weeds management in crops Front Plant Sci 2023 14 1211235
[103]
Gao J, French AP, Pound MP, He Y, Pridmore TP, and Pieters JG Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields Plant Methods 2020 16 1-12
[104]
Jin X, Sun Y, Che J, Bagavathiannan M, Yu J, and Chen Y A novel deep learning-based method for detection of weeds in vegetables Pest Manag Sci 2022 78 5 1861-1869
[105]
Yang B, Gao Z, Gao Y, and Zhu Y Rapid detection and counting of wheat ears in the field using yolov4 with attention module Agronomy 2021 11 6 1202
[106]
Bazame HC, Molin JP, Althoff D, and Martello M Detection, classification, and mapping of coffee fruits during harvest with computer vision Comput Electron Agri 2021 183 106066
[107]
Khan F, Zafar N, Tahir MN, Aqib M, Waheed H, and Haroon Z A mobile-based system for maize plant leaf disease detection and classification using deep learning Front Plant Sci 2023 14 1079366
[108]
Hu Y, Deng X, Lan Y, Chen X, Long Y, and Liu C Detection of rice pests based on self-attention mechanism and multi-scale feature fusion Insects 2023 14 3 280
[109]
Dai G and Fan J An industrial-grade solution for crop disease image detection tasks Front Plant Sci 2022 13 921057
Index Terms
- Contrasting bean analysis system based on YOLOv5 and a neural network model using the interval type-2 fuzzy set approach
Index terms have been assigned to the content through auto-classification.
Recommendations
Interval type-2 neuro-fuzzy system with implication-based inference mechanism
The system uses interval type-2 fuzzy sets in premises and consequences of rules.The system uses several interval type-2 fuzzy implications.The system applies logical interpretation to fuzzy rules.The paper is accompanied by numerical examples.The ...
Reduced-set vector-based interval type-2 fuzzy neural network
This paper describes an interval type-2 fuzzy modeling framework, reduced-set vector-based interval type-2 fuzzy neural network (RV-based IT2FNN), to characterize the representation in fuzzy logic inference procedure. The model proposed introduces the ...
Toward a Fuzzy Logic System Based on General Forms of Interval Type-2 Fuzzy Sets
Recent years have witnessed a widespread in the use of interval type-2 fuzzy logic systems (IT2 FLSs) in real-world applications. It has been shown recently that interval type-2 fuzzy sets (IT2 FSs) are more general than interval-valued fuzzy sets (IV FSs)...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 31 July 2024
Accepted: 12 July 2024
Received: 02 November 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Feb 2025