Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Deep learning models for digital image processing: a review

Published: 07 January 2024 Publication History

Abstract

Within the domain of image processing, a wide array of methodologies is dedicated to tasks including denoising, enhancement, segmentation, feature extraction, and classification. These techniques collectively address the challenges and opportunities posed by different aspects of image analysis and manipulation, enabling applications across various fields. Each of these methodologies contributes to refining our understanding of images, extracting essential information, and making informed decisions based on visual data. Traditional image processing methods and Deep Learning (DL) models represent two distinct approaches to tackling image analysis tasks. Traditional methods often rely on handcrafted algorithms and heuristics, involving a series of predefined steps to process images. DL models learn feature representations directly from data, allowing them to automatically extract intricate features that traditional methods might miss. In denoising, techniques like Self2Self NN, Denoising CNNs, DFT-Net, and MPR-CNN stand out, offering reduced noise while grappling with challenges of data augmentation and parameter tuning. Image enhancement, facilitated by approaches such as R2R and LE-net, showcases potential for refining visual quality, though complexities in real-world scenes and authenticity persist. Segmentation techniques, including PSPNet and Mask-RCNN, exhibit precision in object isolation, while handling complexities like overlapping objects and robustness concerns. For feature extraction, methods like CNN and HLF-DIP showcase the role of automated recognition in uncovering image attributes, with trade-offs in interpretability and complexity. Classification techniques span from Residual Networks to CNN-LSTM, spotlighting their potential in precise categorization despite challenges in computational demands and interpretability. This review offers a comprehensive understanding of the strengths and limitations across methodologies, paving the way for informed decisions in practical applications. As the field evolves, addressing challenges like computational resources and robustness remains pivotal in maximizing the potential of image processing techniques.

References

[1]
Aarthi R and Rishma G A Vision based approach to localize waste objects and geometric features exaction for robotic manipulation Int Conf Mach Learn Data Eng Procedia Comput Sci 2023 218 1342-1352
[2]
Abdar M, Samami M, Mahmoodabad SD, Doan T, Mazoure B, Hashemifesharaki R, Liu L, Khosravi A, Acharya UR, Makarenkov V, and Nahavandi S Uncertainty quantification in skin cancer classification using three-way decision-based Bayesian deep learning Comput Biol Med 2021 135 104418
[3]
Aggarwal A, Kuma M (2020) Image surface texture analysis and classification using deep learning. Multimed Tools Appl 80(1):1289–1309.
[4]
Ahammad SH, Rajesh V, Rahman MZU, and Lay-Ekuakille A A hybrid CNN-based segmentation and boosting classifier for real time sensor spinal cord injury data IEEE Sens J 2020 20 17 10092-10101
[5]
Ahmad S, Ullah T, Ahmad I, Al-Sharabi A, Ullah K, Khan RA, Rasheed S, Ullah I, Uddin MN, Ali MS (2022) A novel hybrid deep learning model for metastatic cancer detection". Comput Intell Neurosci 2022:14.
[6]
Ahmed I, Ahmad M, Khan FA, Asif M (2020) Comparison of deep-learning-based segmentation models: using top view person images”. IEEE Access 8:136361–136373.
[7]
Aish MA, Abu-Naser SS, and Abu-Jamie TN Classification of pepper using deep learning Int J Acad Eng Res (IJAER) 2022 6 1 24-31
[8]
Ashraf H, Waris A, Ghafoor MF et al (2022) Melanoma segmentation using deep learning with test-time augmentations and conditional random fields. Sci Rep 12:3948.
[9]
Bouteldja N, Klinkhammer BM, Bülow RD, et al. Deep learning based segmentation and quantification in experimental kidney histopathology J Am Soc Nephrol 2020
[10]
Cheng G, Xie X, Han J, Guo L, Xia G-S (2020) Remote sensing image scene classification meets deep learning: challenges, methods, benchmarks, and opportunities. IEEE J Select Topics Appl Earth Observ Remote Sens 13:3735–3756.
[11]
Devulapalli S, Potti A, Rajakumar Krishnan M, Khan S (2021) Experimental evaluation of unsupervised image retrieval application using hybrid feature extraction by integrating deep learning and handcrafted techniques. Mater Today: Proceed 81:983–988.
[12]
Dey S, Bhattacharya R, Malakar S, Schwenker F, Sarkar R (2022) CovidConvLSTM: a fuzzy ensemble model for COVID-19 detection from chest X-rays. Exp Syst Appl 206:117812.
[13]
Gao C, Zhou J, Wong WK, and Gao T Wong W Woven Fabric Defect Detection Based on Convolutional Neural Network for Binary Classification Artificial Intelligence on Fashion and Textiles AITA 2018 Advances in Intelligent Systems and Computing 2019 Cham Springer
[14]
Gao X, Zhang M, and Luo J Low-light image enhancement via retinex-style decomposition of denoised deep image prior Sensors 2022 22 5593
[15]
Gill HS, Murugesan G, Mehbodniya A, Sajja GS, Gupta G, Bhatt A (2023) Fruit Type Classification using Deep Learning and Feature Fusion. Comput Electronic Agric 211:107990
[16]
Gite S, Mishra A, and Kotecha K Enhanced lung image segmentation using deep learning Neural Comput and Appl 2022
[17]
Hasti VR, Shin D (2022) Denoising and fuel spray droplet detection from light-scattered images using deep learning. Energy and AI 7:100130.
[18]
Hedayati R, Khedmati M, Taghipour-Gorjikolaie M (2021) Deep feature extraction method based on ensemble of convolutional auto encoders: Application to Alzheimer’s disease diagnosis. Biomed Signal Process Control 66:102397.
[19]
Hussain E, Hasan M, Hassan SZ, Azmi TH, Rahman MA, Parvez MZ (2020) [IEEE 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA) - Kristiansand, Norway (2020.11.9–2020.11.13)] 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA) - Deep Learning Based Binary Classification for Alzheimerâ™s Disease Detection using Brain MRI Images. pp. 1115–1120.
[20]
Ibrahim AU, Ozsoz M, Serte S, Al-Turjman F, Yakoi PS (2021) Pneumonia Classifcation Using Deep Learning from Chest X ray Images During COVID 19. Cognitive Computation. Springer, Berlin.
[21]
Ismael SAA, Mohammed A, Hefny H (2020) An enhanced deep learning approach for brain cancer MRI images classification using residual networks. Artif Intell Med 102:101779.
[22]
Jalali Y, Fateh M, Rezvani M, Abolghasemi V, and Anisi MH ResBCDU-Net: a deep learning framework for lung CT image segmentation Sensors 2021
[23]
Jiang X, Zhu Y, Zheng B et al (2021) Images denoising for COVID-19 chest X-ray based on multi-resolution parallel residual CNN. July 2021 Machine Vision and Applications 32(4).
[24]
Jin D, Zheng H, Zhao Q, Wang C, Zhang M, and Yuan H Generation of vertebra micro-CT-like image from MDCT: a deep-learning-based image enhancement approach Tomography 2021 7 767-782
[25]
Kasongo SM, Sun Y (2020) A deep learning method with wrapper based feature extraction for wireless intrusion detection system. Comput Secur 92:101752.
[26]
Khullar V, Salgotra K, Singh HP, and Sharma DP Deep learning-based binary classification of ADHD using resting state MR images Augment Hum Res 2021
[27]
Kim K, Lee S, Cho S (2023) MSSNet: Multi-Scale-Stage Network for Single Image Deblurring. In: Karlinsky, L., Michaeli, T., Nishino, K. (eds) Computer Vision – ECCV 2022 Workshops. ECCV 2022. Lecture Notes in Computer Science, vol 13802. Springer, Cham.
[28]
Kim B and Ye JC Mumford-Shah Loss functional for image segmentation with deep learning IEEE Trans Image Process 2019
[29]
Kong Y, Ma X, Wen C (2022) A new method of deep convolutional neural network image classification based on knowledge transfer in small label sample environment. Sensors 22:898.
[30]
Li G, Yang Y, Xingda Q, Cao D, Li K (2021a) A deep learning based image enhancement approach for autonomous driving at night. Knowl-Based Syst 213:106617.
[31]
Li W, Raj ANJ, Tjahjadi T, Zhuang Z (2021b) Digital hair removal by deep learning for skin lesion segmentation”. Pattern Recog 117:107994.
[32]
Liu M, Zhou Z, Shang P, Xu D (2019) Fuzzified image enhancement for deep learning in iris recognition”. IEEE Trans Fuzzy Syst 2019:2912576.
[33]
Liu D, Wen B, Jiao J, Liu X, Wang Z, Huang TS (2020) Connecting image denoising and high-level vision tasks via deep learning. IEEE Trans Image Process 29:3695–3706.
[34]
Liu L, Tsui YY, and Mandal M Skin lesion segmentation using deep learning with auxiliary task J Imag 2021 7 67
[35]
Lorenzoni R, Curosu I, Paciornik S, Mechtcherine V, Oppermann M, and Silva F Semantic segmentation of the micro-structure of strain-hardening cement-based composites (SHCC) by applying deep learning on micro-computed tomography scans Cement Concrete Compos 2020 108 103551
[36]
Lu CT, Wang LL, Shen JH et al (2021) Image enhancement using deep-learning fully connected neural network mean filter. J Supercomput 77:3144–3164.
[37]
Ma S, Li L, Zhang C (2022) Adaptive Image denoising method based on diffusion equation and deep learning”. Internet of Robotic Things-Enabled Edge Intelligence Cognition for Humanoid Robots Volume 2022 | Article ID 7115551.
[38]
Magsi A, Mahar JA, Razzaq MA, Gill SH (2020) Date Palm Disease Identification Using Features Extraction and Deep Learning Approach. 2020 IEEE 23rd International Multitopic Conference (INMIC).
[39]
Mahajan K, Garg U, and Shabaz M CPIDM: a clustering-based profound iterating deep learning model for HSI segmentation Hindawi Wireless Commun Mobile Comput 2021 2021 12
[40]
Mahmoudi O, Wahab A, Chong KT (2020) iMethyl-deep: N6 methyladenosine identification of yeast genome with automatic feature extraction technique by using deep learning algorithm. Genes 2020, 11(5), 529;
[41]
Mehranian A, Wollenweber SD, Walker MD, et al. Deep learning–based time-of-flight (ToF) image enhancement of non-ToF PET scans Eur J Nucl Med Mol Imag 2022 49 3740-3749
[42]
Meng Y, Zhang J (2022) A novel gray image denoising method using convolutional neural network”. IEEE Access 10:49657–49676
[43]
Munadi K, Muchtar K, Maulina N (2020) And Biswajeet Pradhan”, image enhancement for tuberculosis detection using deep learning. IEEE Access 8:217897.
[44]
Niresi FK, Chi C-Y (2022) Unsupervised hyperspectral denoising based on deep image prior and least favorable distribution”. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing vol. 15, pp. 5967-5983, 2022.
[45]
Nurmaini S, Rachmatullah MN, Sapitri AI, Darmawahyuni A, Jovandy A, Firdaus F, Tutuko B, Passarella R (2020) Accurate detection of septal defects with fetal ultrasonography images using deep learning-based multiclass instance segmentation. IEEE Access 8:196160–196174.
[46]
Pang T, Zheng H, Quan Y, Ji H (2021) Recorrupted-to-Recorrupted: Unsupervised Deep Learning for Image Denoising” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
[47]
Park KH, Batbaatar E, Piao Y, Theera-Umpon N, Ryu KH (2021b) Deep learning feature extraction approach for hematopoietic cancer subtype classification. Int J Environ Res Public Health 18:2197.
[48]
Park D, Lee J, Lee J, Lee K (2021) Deep Learning based Food Instance Segmentation using Synthetic Data, IEEE, 18th International Conference on Ubiquitous Robots (UR).
[49]
Peng Z, Peng S, Lidan Fu, Binchun Lu, Tanga J, Wang Ke, Wenyuan Li, (2020) A novel deep learning ensemble model with data denoising for short-term wind speed forecasting”. Energy Convers Manag 207:112524.
[50]
Pérez-Borrero I, Marín-Santos D, Gegúndez-Arias ME, and Cortés-Ancos E A fast and accurate deep learning method for strawberry instance segmentation Comput Electron Agric 2020 178 105736
[51]
Picon A, San-Emeterio MG, Bereciartua-Perez A, Klukas C, Eggers T, Navarra-Mestre R (2022) Deep learning-based segmentation of multiple species of weeds and corn crop using synthetic and real image datasets. Comput Electron Agric 194:10671.
[52]
Quan Y, Lin P, Yong X, Nan Y, Ji H (2021) Nonblind image deblurring via deep learning in complex field. IEEE Trans Neural Netw Learn Syst 33(10):5387–5400.
[53]
Quan, Y., Chen, M., Pang, T. and Ji, H., 2020 “Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image”, IEEE 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - Seattle, WA, 2020, pp. 1887–1895.
[54]
Robiul Islam Md, Nahiduzzaman Md (2022) Complex features extraction with deep learning model for the detection of COVID19 from CT scan images using ensemble based machine learning approach. Exp Syst Appl 195:116554.
[55]
Saood A, Hatem I (2021) COVID-19 lung CT image segmentation using deep learning methods: U-Net versus SegNet”. BMC Med Imaging 21:19.
[56]
Sarki R, Ahmed K, Wang H et al (2020) Automated detection of mild and multi-class diabetic eye diseases using deep learning. Health Inf Sci Syst 8:32.
[57]
Shankar K, Perumal E, Tiwari P et al (2022) Deep learning and evolutionary intelligence with fusion-based feature extraction for detection of COVID-19 from chest X-ray images. Multimedia Syst 28:1175–1187.
[58]
Sharif M, Attique Khan M, Rashid M, Yasmin M, Afza F, and Tanik UJ Deep CNN and geometric features-based gastrointestinal tract diseases detection and classification from wireless capsule endoscopy images J Exp Theor Artif Intell 2019 33 1-23
[59]
Sharma A, Mishra PK (2022) Image enhancement techniques on deep learning approaches for automated diagnosis of COVID-19 features using CXR images. Multimed Tools Appl 81:42649–42690.
[60]
Sharma T, Nair R, and Gomathi S Breast cancer image classification using transfer learning and convolutional neural network Int J Modern Res 2022 2 1 8-16
[61]
Sharma, Harsh, Jain, Jai Sethia, Bansal, Priti, Gupta, Sumit (2020). [IEEE 2020 10th International Conference on Cloud Computing, Data Science and Engineering (Confluence) - Noida, India (2020.1.29–2020.1.31)] 2020 10th International Conference on Cloud Computing, Data Science and Engineering (Confluence) - Feature Extraction and Classification of Chest X-Ray Images Using CNN to Detect Pneumonia. pp. 227–231.
[62]
Simon P and Uma V Deep learning based feature extraction for texture classification Procedia Comput Sci 2020 171 1680-1687
[63]
Skouta A, Elmoufidi A, Jai-Andaloussi S, Ochetto O (2021) Automated Binary Classification of Diabetic Retinopathy by Convolutional Neural Networks. In: Saeed F, Al-Hadhrami T, Mohammed F, Mohammed E (eds) Advances on Smart and Soft Computing, Advances in Intelligent Systems and Computing. Springer, Singapore.
[64]
Sori WJ, Feng J, Godana AW et al (2021) DFD-Net: lung cancer detection from denoised CT scan image using deep learning. Front Comput Sci 15:152701.
[65]
Sungheetha A, Rajesh Sharma R (2021) Design an early detection and classification for diabetic retinopathy by deep feature extraction based convolution neural network. J Trends Comput Sci Smart Technol (TCSST) 3(2):81–94.
[66]
Tang H, Zhu H, Fei L, Wang T, Cao Y, and Xie C Low-Illumination image enhancement based on deep learning techniques: a brief review Photonics 2023 10 2 198
[67]
Tanseem N. Abu-Jamie, Samy S. Abu-Naser, Mohammed A. Alkahlout, Mohammed A. Aish,“Six Fruits Classification Using Deep Learning”, International Journal of Academic Information Systems Research (IJAISR) ISSN: 2643–9026. 6(1):1–8
[68]
Tawfik MS, Adishesha AS, Hsi Y, Purswani P, Johns RT, Shokouhi P, Huang X, Karpyn ZT (2022) Comparative study of traditional and deep-learning denoising approaches for image-based petrophysical characterization of porous media. Front Water 3:800369
[69]
Tian C, Xu Y, Fei L, and Yan K Pan JS, Lin JW, Sui B, and Tseng SP Deep Learning for Image Denoising: A Survey Genetic and Evolutionary Computing. ICGEC 2018. Advances in Intelligent Systems and Computing 2019 Singapore Springer
[70]
Tian C, Fei L, Zheng W, Xu Y, Zuof W, Lin CW (2020) Deep Learning on Image Denoising: An Overview. Neural Networks 131:251-275
[71]
Wang D, Su J, Yu H (2020) Feature Extraction and analysis of natural language processing for deep learning english language. IEEE Access 8:46335–46345.
[72]
Wang EK, Chen CM, Hassan MM, Almogren A (2020) A deep learning based medical image segmentation technique in Internet-of-Medical-Things domain. Future Gen Comput Syst 108:135–144.
[73]
Xiaowei Xu, Chen Y, Junfeng Zhang Y, Chen PA, Manickam A (2020) A novel approach for scene classification from remote sensing images using deep learning methods. Eur J Remote Sens 54:383–395.
[74]
Yan K, Chang L, Andrianakis M, Tornari V, Yu Y (2020) Deep learning-based wrapped phase denoising method for application in digital holographic speckle pattern interferometry. Appl Sci 10:4044.
[75]
Yang R, Luo F, Ren F, Huang W, Li Q, Du K, and Yuan D Identifying urban wetlands through remote sensing scene classification using deep learning: a case study of Shenzhen China ISPRS Int J Geo-Inf 2022 11 131
[76]
Yoshimura N, Kuzuno H, Shiraishi Y, and Morii M DOC-IDS: a deep learning-based method for feature extraction and anomaly detection in network traffic Sensors 2022 22 4405
[77]
Zhang W, Zhao C, and Li Y A novel counterfeit feature extraction technique for exposing face-swap images based on deep learning and error level analysis Entropy 2020 22 2 249
[78]
Zhou Y, Zhang C, Han X, and Lin Y Monitoring combustion instabilities of stratified swirl flames by feature extractions of time-averaged flame images using deep learning method Aerospace Sci Technol 2021 109 106443
[79]
Zhou X, Zhou H, Wen G, Huang X, Le Z, Zhang Z, Chen X (2022) A hybrid denoising model using deep learning and sparse representation with application in bearing weak fault diagnosis. Measurement 189:110633.

Index Terms

  1. Deep learning models for digital image processing: a review
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image Artificial Intelligence Review
        Artificial Intelligence Review  Volume 57, Issue 1
        Jan 2024
        569 pages

        Publisher

        Kluwer Academic Publishers

        United States

        Publication History

        Published: 07 January 2024
        Accepted: 17 December 2023

        Author Tags

        1. Image processing
        2. Deep learning models
        3. Convolutional neural networks (CNN)

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 0
          Total Downloads
        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 27 Jan 2025

        Other Metrics

        Citations

        View Options

        View options

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media