Artificial Intelligence in IR Thermal Imaging and Sensing for Medical Applications
<p>(<b>a</b>) Anatomy of the skin (from [<a href="#B10-sensors-25-00891" class="html-bibr">10</a>])—depth of burn; (<b>b</b>) three-layer structural model; (<b>c</b>) equivalent thermoelectric model [<a href="#B22-sensors-25-00891" class="html-bibr">22</a>].</p> "> Figure 2
<p>Electric equivalent circuit simulating thermal processes at the ROI surface, where U(x,y,t) is the voltage of a temperature value at a pixel x, y at time t; U—voltage sources representing ambient A, stimulation ST, and body B temperature (boundary conditions); Ri—thermal resistances; Ci—thermal capacitances [<a href="#B22-sensors-25-00891" class="html-bibr">22</a>].</p> "> Figure 3
<p>Block diagram of basic ADT/TSR/TT measurement procedure [<a href="#B22-sensors-25-00891" class="html-bibr">22</a>].</p> "> Figure 4
<p>Thermal Tomography procedure for reconstruction of a tested structure’s properties [<a href="#B22-sensors-25-00891" class="html-bibr">22</a>].</p> "> Figure 5
<p>Block diagram of the stand for research with the ADT, TSR, and TT methods [<a href="#B22-sensors-25-00891" class="html-bibr">22</a>].</p> "> Figure 6
<p>(<b>a</b>) Postoperative wound evaluation in cardiac surgery on the 3rd day after cardiac surgery; parametric images—according to Equation (2); photograph of the patient. (<b>b</b>) Postoperative wound evaluation in cardiac surgery patient on the 3rd day after cardiac surgery; TSR parametric images: first 6 parametric images of logarithmic coefficients a<sub>i</sub>—according to Equation (5); first row from left: a<sub>0</sub>, a<sub>1</sub>, a<sub>2</sub>; second row from the left: a<sub>3</sub>, a<sub>4</sub>, a<sub>5</sub>.</p> "> Figure 6 Cont.
<p>(<b>a</b>) Postoperative wound evaluation in cardiac surgery on the 3rd day after cardiac surgery; parametric images—according to Equation (2); photograph of the patient. (<b>b</b>) Postoperative wound evaluation in cardiac surgery patient on the 3rd day after cardiac surgery; TSR parametric images: first 6 parametric images of logarithmic coefficients a<sub>i</sub>—according to Equation (5); first row from left: a<sub>0</sub>, a<sub>1</sub>, a<sub>2</sub>; second row from the left: a<sub>3</sub>, a<sub>4</sub>, a<sub>5</sub>.</p> "> Figure 7
<p>Visualization of artificial intelligence concept relationships.</p> "> Figure 8
<p>Major steps in preparing a deep learning model for thermographic diagnostics.</p> "> Figure 9
<p>Steps in preparing a federated deep learning context for thermographic diagnostics.</p> ">
Abstract
:1. Introduction—Temperature and Heat Flows in Medical Applications
- (a)
- IEEE EMBS https://www.embs.org (accessed on 27 December 2024)—Engineering in Medicine and Biology Society, the largest organization of engineers in medicine, founded in 1952 and publishes several journals, including open access Engineering in Medicine and Biology;
- (b)
- QIRT http://qirt.gel.ulaval.ca (accessed on 27 December 2024)—Quantitative Infrared Thermography Organization, founded in 1992 and publishes the QIRT Journal;
- (c)
- EAT http://www.eurothermology.org (accessed on 27 December 2024)—European Association of Thermology, medical international society publishing Thermology International (open access), founded in 1990.
2. Advances in IR Thermal Imaging Methods in Medicine
- -
- Thermal detection, non-selective;
- -
- Photon detection, based on the direct excitation of photons into, e.g., electrons, with a long wavelength limit of sensitivity.
- ∘
- Single-element detectors, or detectors with only a few elements; a two-dimensional advanced mechanical scanner using mirrors or other solutions, e.g., prisms, was applied to generate a two-dimensional image.
- ∘
- Array detectors (FPA—focal plane array) that do not require any scanning mechanism for acquiring the two-dimensional picture. Nowadays, only this generation of cameras is in use for medical applications.
3. Problems of Thermal Image Acquisition and Reconstruction of Diagnostic Parameters
- Preparation of the Patient:
- ∘
- Patients should avoid stimulants and medications prior to the test.
- ∘
- Physical activities that could stimulate the body should be avoided.
- ∘
- The skin in the area of interest must be free of ointments, creams, or other substances.
- ∘
- Patients should remain in the waiting or examination room for at least 15 min before testing to allow stabilization of thermal conditions.
- ∘
- The areas of interest should be exposed during this period to achieve thermodynamic equilibrium.
- Technical Specifications of Diagnostic Equipment:
- ∘
- Use an appropriate infrared camera with specified geometric and thermal resolution (at least 0.1 K).
- ∘
- Camera positioning: perpendicular to the field of interest, at a minimum distance of 0.5 m.
- ∘
- Scan frequency: the rate at which images are recorded over a given period.
- Climatic Conditions in the Testing Room:
- ∘
- The room temperature should be maintained between 18 and 23 °C (maximum 25 °C), stabilized with an accuracy of at least 1 °C.
- ∘
- No ventilation, radiation sources, or heaters should influence the temperature of the patient’s body.
- ∘
- Controlled and constant humidity in the test room is essential.
- Databases and Image Cataloging:
- ∘
- Comprehensive databases and catalogs have been developed to standardize the conditions for storing and processing medical images of specific regions of interest (ROIs) on the patient’s body [16].
- ∘
- However, the DICOM (Digital Imaging and Communications in Medicine) standard for thermal imaging has not yet been implemented.
3.1. Theory
- Analytical Methods: Analytical solutions are applicable only to very simple structures with well-defined shapes. Due to their limitations in handling complex geometries, these methods are primarily used to provide rough estimates.
- Numerical Methods: Numerical approaches, often based on the Finite Element Method (FEM), are widely used for solving heat transfer problems. Several commercial software packages integrate FEM for heat flow analysis, offering features like model mesh generation and specialized thermal problem modules. Examples include general-purpose mathematical software such as ANSYS, COMSOL, MATLAB, and Mathematica.
3.2. Practice
Thermal Tomography Procedures
- Main Computer: Controls the entire operation, managing excitation sequences and acquiring data and reconstruction of thermal replacement model parameters.
- Driving Unit (Controller): Adjusts control signals, ensuring appropriate voltage levels and I/O current efficiency for operating excitation devices (e.g., cryotherapy equipment).
- Symmetrical Thermal Excitation System: Provides controlled thermal stimulation (in our case the cryotherapy CO2 units).
- Thermographic Camera: Captures thermal images of the region of interest (ROI).
- RGB Camera: Records visible-spectrum images for alignment and analysis.
- Additional equipment, such as a weather station for monitoring environmental conditions—temperature and air humidity.
3.3. Multimodal Data Fusion
4. Machine Learning and Artificial Intelligence Methods in IR Thermal Diagnostics
4.1. Common Data Processing in ML Approaches
4.2. Breast Cancer Diagnosis
4.3. Diabetic Foot Screening
4.4. Other Medical Applications of Thermography and DL/ML
4.5. Image Processing for Medical Applications of Thermography and DL/ML
- Super-Resolution via Generative Adversarial Networks (GANs) [96]
- Artifact Removal with Deep CNNs [97]
- Contrast Enhancement using DL-Based Image-to-Image Translation [98]
4.6. Medical Databases of Thermograms
- DMR-IR (Dynamic Infrared) Breast Thermography Database [101]—official “one-click” URL: http://visual.ic.uff.br/dmi (accessed on 25 January 2025). It is commonly obtained by emailing the original dataset authors or lab. It includes around 200–250 breast thermographic images from approximately 100 subjects (numbers can vary depending on the dataset version). It includes a mix of benign, malignant, and healthy cases. Annotations are as follows: typically accompanied by ROI markings indicating suspicious regions; metadata may include patient history, biopsy results, or clinical findings (depending on the version).
- BIR/DMR Database (Breast Thermography) [102]—ranges from 92 to 150+ thermographic images, focusing on breast cancer screening. Annotations are as follows: may include segmentation masks or bounding boxes around suspicious hot spots or recognized lesions, often validated by radiologists or breast specialists.
- STANDUP Thermographic Foot Ulcer Database [103]—a research database consisting of 415 multispectral images (thermal and RGB images) of the plantar foot from healthy (125 images) and diabetic subjects (290 images). The healthy subjects were members of two research laboratories (PRISME in France and IRF-SIC in Morocco). The second group was composed of type II diabetic patients who participated in an acquisition campaign at the Hospital Nacional Dos de Mayo in Lima, Peru, as part of a study on the early detection of ulcers in patients with diabetic foot.
- Breast Thermography Database, San Juan de Dios Hospital, Consultorio Rosado (Cali, Colombia) [104]. This dataset was acquired inside a medical office with dimensions at a temperature of 22–24 °C and relative humidity of 45–50 %. A FLIR A300 camera was used to capture the images. The American Academy of Thermology (AAT) protocol was used to prepare the patient and image capture. Images captured were from 119 patients. A set of three images was taken in the chest area of each patient. The ages of the patients ranged from 18 to 81 years. The pathologies related by each patient were benign (BP) and malignant (MP); otherwise, the breast status was normal (N). Each set of images (anterior, left, and right oblique positions) has the associated diagnosis of each breast and the weight, height, temperature, and age of the patient. The medical diagnosis was obtained from the pathology report obtained a few days after the thermography was performed.
5. Discussion and Practical Advice
- (1)
- Improved Accuracy and Sensitivity: Deep CNN architectures (e.g., ResNet, DenseNet) have significantly enhanced classification and lesion detection accuracy in small yet specialized thermographic datasets (breast, diabetic foot, musculoskeletal conditions, etc.). Transfer learning (pretraining on large image datasets like ImageNet) is widely used to overcome the data scarcity typical in thermographic imaging tasks. Explainability (e.g., via Grad-CAM) is increasingly important in medical contexts, building trust among clinicians.
- (2)
- Enhanced Image Quality and Feature Extraction: Autoencoders, GAN-based super-resolution, and denoising networks are improving thermogram clarity, making subtle temperature contrasts more detectable; ROI-based and segmentation-focused methods (e.g., U-Net variants) help zoom in on clinically significant areas, improving local lesion detection.
- (3)
- Growing Body of Proof-of-Concept Studies: Much of the literature consists of pilot or feasibility studies with relatively small datasets. Despite promising initial results, multicenter trials and standardized protocols remain limited.
- (4)
- Adoption Across Multiple Pathologies: While breast cancer and diabetic foot ulcers have been the most studied, recent work extends to arthritis, thyroid disorders, fever screening, and sports/musculoskeletal injuries—highlighting thermography’s versatility when combined with AI.
- (1)
- Data Scarcity and Heterogeneity: Most thermography studies rely on small, proprietary datasets with inconsistent acquisition protocols (room temperature, camera brand, etc.). The lack of standardized open-source datasets limits reproducibility and large-scale validation.
- (2)
- Variability in Imaging Protocols: Even slight changes in patient positioning, camera angle, or ambient temperature can affect thermographic readings, impacting model generalizability.
- (3)
- Regulatory and Clinical Acceptance: For thermography-based AI tools to become standard in clinical practice, they need extensive validation and compliance with medical device regulations.
- (4)
- Complexity of Models: Large models (ResNet50 and beyond) risk overfitting to limited thermal data, requiring extensive augmentation or additional data.
- (1)
- Federated Learning and Collaborative Data Sharing: To address small, fragmented datasets, federated learning will enable multiple clinics to train shared models without pooling sensitive data. This approach can increase dataset diversity, improving model robustness and generalization.
- (2)
- Multimodal Fusion: Combining thermography with conventional imaging (e.g., mammography, ultrasound) or even electronic health records could yield superior diagnostic confidence. Late-fusion or attention-based networks will combine different data sources while highlighting clinical insights.
- (3)
- Explainable AI (XAI) and Regulatory Push: As AI-based diagnostics near clinical deployment, interpretability will be paramount for regulatory approval and clinician trust.
- (4)
- Standardized Protocols and Larger Databases: We can expect a push toward standardizing thermographic acquisition (e.g., patient preparation, camera calibration) across multiple institutions. Also, the data format should be standardized, e.g., DICOM for thermography examination as a mandatory standard. Larger, well-annotated datasets—potentially released by research consortia—will pave the way for more robust AI models.
- (5)
- Real-time Monitoring and Telemedicine: Wearable or continuous thermographic sensors in hospitals or home environments could monitor temperature changes over time, detecting early warning signs of infection or inflammation. Telehealth may integrate these data streams, allowing remote specialists or AI systems to flag emerging issues.
- Progress in accuracy, resolution, and sensitivity of new equipment at lower prices.
- Scalable, privacy-preserving collaborations via federated learning.
- Real-time, embedded AI solutions on portable or wearable devices.
- Greater acceptance from clinicians and regulatory bodies as interpretability tools mature.
- The new medical-application-oriented market offering handy and versatile systems with software allowing the integration of multimodality images, including multispectral sensors and advanced data treatment.
Funding
Acknowledgments
Conflicts of Interest
References
- Woodhead, G.S.; Varrier-Jones, P.C. Clinical thermometry. Lancet 1916, 1, 173–180, 281–288, 338–340, 450–453, 495–502. [Google Scholar] [CrossRef]
- Barnes, R.B.; Gerson-Cohen, J. Thermography of the human body. Science 1963, 140, 870–877. [Google Scholar] [CrossRef] [PubMed]
- Diakides, M.; Bronzino, J.; Peterson, D. (Eds.) Medical Infrared Imaging: Principles and Practices; CRC Press: Boca Raton, FL, USA, 2012. [Google Scholar]
- Literature Research: Papers on Thermology or Temperature Measurement: 2011 to 2013, 2014 to 2018, 2019 to 2021. see e.g., Correspondence, Thermology International v. 27, 4, 2017, pp. 139–141. Available online: https://www.eurothermology.org/ThermInt/TI.html (accessed on 22 December 2024).
- Ammer, K. Medical Thermology 2018—A computer assisted literature review. Thermol. Int. 2019, 29, 7–39. [Google Scholar]
- Ring, E.F.J.; Ammer, K. Infrared thermal imaging in medicine. Physiol. Meas. 2012, 33, 33–46. [Google Scholar] [CrossRef]
- Bronzino, J.D. Medical Devices and Systems. In The Biomedical Engineering Handbook, 3rd ed.; CRC Taylor & Francis: Boca Raton, FL, USA, 2006. [Google Scholar]
- Ng, E.Y.K.; Etehadtavakol, M. (Eds.) Application of Infrared to Biomedical Sciences; Springer: Berlin/Heidelberg, Germany, 2017. [Google Scholar]
- Duck, F.A. Physical Properties of Tissues—A Comprehensive Reference; Ng, E.Y.K., Etehadtavakol, M., Eds.; Academic Press: Cambridge, MA, USA, 1990. [Google Scholar]
- Shitzer, A.; Eberhart, R.C. (Eds.) Analysis and Applications. In Heat Transfer in Medicine and Biology; Springer: Berlin/Heidelberg, Germany, 2012; Volume 2. [Google Scholar]
- Ring, E.F.J.; Jung, A.; Zuber, J. Infrared Imaging—A Casebook in Clinical Medicine; Institute of Physics Publishing: Bristol, UK, 2015. [Google Scholar]
- Koprowski, R. Processing of Hyperspectral Medical Images—Applications in Dermatology Using Matlab. In Studies in Computational Intelligence; Springer: Berlin/Heidelberg, Germany, 2017; p. 682. [Google Scholar]
- Koprowski, R. Processing Medical Thermal Images—Using Matlab. In Studies in Computational Intelligence; Springer: Berlin/Heidelberg, Germany, 2018; p. 716. [Google Scholar]
- Ammer, K.; Ring, E.F.J. Standard Procedures for Infrared Imaging in Medicine. In Medical Infrared Imaging; Diakides, N., Brozino, J.D., Eds.; CRC Press: Boca Raton, FL, USA, 2008; pp. 22.1–22.14. [Google Scholar]
- IEC 80601-2-59; Particular Requirements for the Basic Safety and Essential Performance of Screening Thermographs for Human Febrile Temperature Screening. International Electrotechnical Commission (IEC)/International Organization for Standardization (ISO): Geneva, Switzerland, 2017.
- Schaefer, G. Storage and Retrieval of Medical Thermograms. In Medical Infrared Imaging; Diakides, N., Brozino, J.D., Eds.; CRC Press: Boca Raton, FL, USA, 2008; pp. 23.1–23.15. [Google Scholar]
- Nowakowski, A.; Kaczmarek, M. Dynamic thermography as a quantitative medical diagnostic tool. Med. Biol. Eng. Comput. Incorp. Cell. Eng. 1999, 37 (Suppl. S1), 244–245. [Google Scholar]
- Rumiński, J.; Kaczmarek, M.; Nowakowski, A. Data visualization in dynamic thermography. J. Med. Inform. Technol. 2000, 5, IT29–IT36. [Google Scholar]
- Nowakowski, A.; Kaczmarek, M.; Rumiński, J.; Hryciuk, M.; Renkielska, A.; Grudziński, J.; Siebert, J.; Jagielak, D.; Rogowski, J.; Roszak, K.; et al. Medical applications of model based dynamic thermography. In Thermosense XIII; SPIE: Orlando, FL, USA, 2001; Volume 4360, pp. 492–503. [Google Scholar]
- Kaczmarek, M.; Nowakowski, A. Active IR-Thermal Imaging in Medicine. J. Nondestruct. Eval. 2016, 35, 19. [Google Scholar] [CrossRef]
- Nowakowski, A. Quantitative Active Dynamic Thermal Imaging and Thermal Tomography in Medical Diagnostics. In Medical Infrared Imaging; Diakides, N., Bronzino, J., Eds.; CRC: Boca Raton, FL, USA, 2008; pp. 7-1–7-29. [Google Scholar]
- Nowakowski, A. Problems of Active Dynamic Thermography measurement standardization in medicine. Pomiary Autom. Robot. 2021, 25, 51–56. [Google Scholar] [CrossRef]
- Pennes, H.H. Analysis of tissue and arterial blood temperatures in the resting human forearm. J. Appl. Physiol. 1948, 1, 93–122. [Google Scholar] [CrossRef]
- Balageas, D.L.; Roche, J.M.; Leroy, F.H.; Liu, W.; Gorbach, A. The thermographic signal reconstruction method: A powerful tool for the enhancement of transient thermographic images. Biocybern. Biomed. Eng. 2015, 35, 1–9. [Google Scholar] [CrossRef]
- Nowakowski, A.; Siondalski, P.; Moderhak, M.; Kaczmarek, M. A new diagnostic method for evaluation of cardiosurgery wound healing. QIRT Quant. InfraRed Thermogr. J. 2016, 13, 19–34. [Google Scholar] [CrossRef]
- Keyserlingk, J.R.; Ahlgren, P.D.; Yu, E.; Belliveau, N. Infrared imaging of the breast: Initial reappraisal using high resolution digital technology in 100 successive cases of stage I and II breast cancer. Breast J. 1998, 4, 245–251. [Google Scholar] [CrossRef] [PubMed]
- Bichinho, G.L.; Gariba, M.A.; Sanches, I.J.; Gamba, H.R.; Cruz, F.P.; Nohama, P. A computer tool for the fusion and visualization of thermal and magnetic resonance images. J. Digit. Imaging 2009, 22, 527–534. [Google Scholar] [CrossRef]
- Hoffmann, N.; Weidner, F.; Urban, P.; Meyer, T.; Schnabel, C.; Radev, Y.; Schackert, G.; Petersohn, U.; Koch, E.; Gumhold, S.; et al. Framework for 2D-3D image fusion of infrared thermography with preoperative MRI. Biomed. Eng./Biomed. Tech. 2017, 62, 599–607. [Google Scholar] [CrossRef]
- de Souza, M.A.; Bueno, A.P.; Magas, V.; Nogueira Neto, G.N.; Nohama, P. Imaging Fusion between Anatomical and Infrared Thermography of the Thyroid Gland. In Proceedings of the 2019 Global Medical Engineering Physics Exchanges/Pan American Health Care Exchanges (GMEPE/PAHCE), Buenos Aires, Argentina, 26–31 March 2019; pp. 1–5. [Google Scholar]
- Sanches, I.; Gamba, H.; Abreu de Souza, M.; Neves, E.; Nohama, P. 3D image fusion using MRI/CT and infrared images. Rev. Bras. De Eng. Biomédica 2013, 29, 298–308. [Google Scholar] [CrossRef]
- de Souza, M.A.; Borba, G.B.; Krefer, A.G.; Gamba, H.R. 3D thermo scan—Multi-modality image registration. In Proceedings of the 2016 SAI Computing Conference (SAI), London, UK, 13–15 July 2016; pp. 302–306. [Google Scholar]
- Deng, K.; Lichao, Y.; Haochen, L.; Wenhan, L.; Erkoyuncu, J.A.; Zhao, Y. A review of Artificial Intelligence applications in Thermographic Non-destructive Testing. In Proceedings of the The 10th International Conference on Through-Life Engineering Services, Enschede, The Netherlands, 16–17 November 2021. [Google Scholar]
- Deep Learning for Medical Image Analysis, 2nd ed.; Zhou, S.K., Greenspan, H., Shen, D., Eds.; Academic Press: Cambridge, MA, USA, 2024. [Google Scholar]
- Pan, S.J.; Yang, Q. A Survey on Transfer Learning. IEEE Trans. Knowl. Data Eng. 2010, 22, 1345–1359. [Google Scholar] [CrossRef]
- Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. In Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA, 7–9 May 2015; pp. 1–14. [Google Scholar]
- Litjens, G.; Kooi, T.; Bejnordi, B.E.; Setio, A.A.; Ciompi, F.; Ghafoorian, M.; van der Laak, J.A.; van Ginneken, B.; Sánchez, C.I. A survey on deep learning in medical image analysis. Med. Image Anal. 2017, 42, 60–88. [Google Scholar] [CrossRef]
- Ornek, A.H.; Ceylan, M. Comparison of Traditional Transformations for Data Augmentation in Deep Learning of Medical Thermography. In Proceedings of the 2019 42nd International Conference on Telecommunications and Signal Processing, Budapest, Hungary, 1–3 July 2019; pp. 191–194. [Google Scholar]
- Song, Y.; Wu, L.; Takahashi, K. Federated Learning for Breast Thermography Classification with Privacy Preservation. IEEE Trans. Inf. Technol. Biomed. 2024; early access. [Google Scholar]
- Silva, T.; Fernandes, R.R. Vision Transformer Approach for Infrared-Based Breast Lesion Detection: A Federated Learning Perspective. In Proceedings of the 2023 IEEE Region 10 Conference (TENCON), Bangkok, Thailand, 31 October–3 November 2023; pp. 255–262. [Google Scholar]
- World Health Organization. Breast Cancer. 2018. Available online: https://www.who.int/activities/preventing-cancer (accessed on 25 January 2025).
- Rodríguez, M.; Gupta, R.; Das, T.K. Machine Learning-Based Analysis of Thermographic Breast Images for Early Cancer Detection. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada, 20–24 July 2020; pp. 3456–3460. [Google Scholar]
- Jalloul, R.; Chethan, H.K.; Alkhatib, R. A Review of Machine Learning Techniques for the Classification and Detection of Breast Cancer from Medical Images. Diagnostics 2023, 13, 2460. [Google Scholar] [CrossRef]
- Wang, X.; Chou, K.; Zhang, G.; Zuo, Z.; Zhang, T.; Zhou, Y.; Mao, F.; Lin, Y.; Shen, S.; Zhang, X.; et al. Breast cancer pre-clinical screening using infrared thermography and artificial intelligence: A prospective, multicentre, diagnostic accuracy cohort study. Int. J. Surg. 2023, 109, 3021–3031. [Google Scholar] [CrossRef]
- Wang, S.; Liu, Y.; Chen, B.; Zhou, J. Deep CNN with Transfer Learning for Breast Cancer Detection from Infrared Thermography. In Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA, 19–22 September 2021; pp. 523–527. [Google Scholar]
- Al-Shamma, Z.; Bairq, A.Q.; Farhan, M. DenseNet-FC Model for Accurate Detection of Breast Abnormalities in Thermal Images. IEEE Sens. J. 2022, 22, 7416–7425. [Google Scholar]
- Kumar, S.P.; Shanthi, S.; Komma, A.; Geetha, D.A.; Preesat, B. Breast cancer detection using bimodal image fusion: Thermography and mammography images. Oncol. Radiother. 2022, 16, 1–5. [Google Scholar]
- Linta, J.; Humaira, A.; Jhanjhi, N.Z. A Survey Study: Image Fusion to Detect Breast Cancer. figshare, 2023; 1, Preprint. [Google Scholar] [CrossRef]
- Ferdous, A. Breast Cancer Detection with VGG16: A Deep Learning Approach with Thermographic Imaging. Int. J. Intell. Syst. Appl. Eng. 2024, 12, 3439. [Google Scholar]
- Muthu Subathra, L.; Krishnaveni, M.; Paul Keins, B.; Joshua Vimal Raj, R.; Malath, S. Breast Cancer Detection with Resnet50, Inception V3, and Xception Architecture. J. Pharm. Negat. Results 2023, 14, 60–68. [Google Scholar]
- Al Husaini, M.A.S.; Habaebi, M.H.; Hameed, S.A.; Islam, M.R.; Gunawan, T.S. A Systematic Review of Breast Cancer Detection Using Thermography and Neural Networks. IEEE Access 2020, 8, 208922–208937. [Google Scholar] [CrossRef]
- Chi, T.N.; Le Thi Thu, H.; Quang, T.D.; Taniar, D. A Lightweight Method for Breast Cancer Detection Using Thermography Images with Optimized CNN Feature and Efficient Classification. J. Imaging Inform. Med. 2024, 1–18. [Google Scholar]
- Garia, L.S.; Hariharan, M. Vision Transformers for Breast Cancer Classification from Thermal Images. In Robotics, Control and Computer Vision. Lecture Notes in Electrical Engineering; Muthusamy, H., Botzheim, J., Nayak, R., Eds.; Springer Nature: Singapore, 2023; Volume 1009, pp. 177–185. [Google Scholar]
- Kiymet, S.; Aslankaya, M.Y.; Taskiran, M.; Bolat, B. Breast Cancer Detection From Thermography Based on Deep Neural Networks. In Proceedings of the 2019 Innovations in Intelligent Systems and Applications Conference (ASYU), Izmir, Turkey, 31 October–2 November 2019; pp. 1–5. [Google Scholar]
- Koay, J.; Herry, C.; Frize, M. Analysis of Breast Thermography with an Artificial Neural Network. In Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Francisco, CA, USA, 1–5 September 2004; pp. 1159–1162. [Google Scholar]
- Mishra, S.; Prakash, A.; Roy, S.K.; Sharan, P.; Mathur, N. Breast Cancer Detection using Thermal Images and Deep Learning. In Proceedings of the 2020 7th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 12–14 March 2020; pp. 211–216. [Google Scholar]
- Sayed, B.A.; Eldin, A.S.; Elzanfaly, D.S.; Ghoneim, A.S. A Comprehensive Review of Breast Cancer Early Detection Using Thermography and Convolutional Neural Networks. In Proceedings of the 2023 International Conference on Computer and Applications (ICCA), Cairo, Egypt, 28–30 November 2023; pp. 1–6. [Google Scholar]
- Husaini, M.A.S.A.; Habaebi, M.H.; Islam, M.R. Utilizing Deep Learning for the Real-Time Detection of Breast Cancer through Thermography. In Proceedings of the 2023 9th International Conference on Computer and Communication Engineering (ICCCE), Kuala Lumpur, Malaysia, 15–16 August 2023; pp. 270–273. [Google Scholar]
- Torres-Galván, J.C.; Guevara, E.; González, F.J. Comparison of Deep Learning Architectures for Pre-Screening of Breast Cancer Thermograms. In Proceedings of the 2019 Photonics North (PN), Quebec City, QC, Canada, 21–23 May 2019; pp. 1–2. [Google Scholar]
- Varsha, U.; Kumar, P.; Senapati, R.K. An Automated Thermography-Based Breast Cancer Detection and Localization System. In Proceedings of the 2024 2nd International Conference on Artificial Intelligence and Machine Learning Applications Theme: Healthcare and Internet of Things (AIMLA), Namakkal, India, 15–16 March 2024; pp. 1–5. [Google Scholar]
- Timadius, E.D.; Wongso, R.; Baihaqi, T.; Gunawan, A.A.S.; Setiawan, K.E. Breast Cancer Image Classification Obtained Through Dynamic Thermography using Deep Learning. In Proceedings of the 2024 4th International Conference of Science and Information Technology in Smart Administration (ICSINTESA), Balikpapan, Indonesia, 12–13 July 2024; pp. 207–212. [Google Scholar]
- Tsietso, D.; Yahya, A.; Samikannu, R.; Tariq, M.U.; Babar, M.; Qureshi, B.; Koubaa, A. Multi-Input Deep Learning Approach for Breast Cancer Screening Using Thermal Infrared Imaging and Clinical Data. IEEE Access 2023, 11, 52101–52116. [Google Scholar] [CrossRef]
- Khandakar, A.; Chowdhury, M.E.; Reaz, M.B.I.; Ali, S.H.M.; Hasan, M.A.; Kiranyaz, S.; Rahman, T.; Alfkey, R.; Bakar, A.A.A.; Malik, R.A. A machine learning model for early detection of diabetic foot using thermogram images. Comput. Biol. Med. 2021, 137, 104838. [Google Scholar] [CrossRef]
- Munadi, K.; Saddami, K.; Oktiana, M.; Roslidar, R.; Muchtar, K.; Melinda, M.; Muharar, R.; Syukri, M.; Abidin, T.F.; Arnia, F. A Deep Learning Method for Early Detection of Diabetic Foot Using Decision Fusion and Thermal Images. Appl. Sci. 2022, 12, 7524. [Google Scholar] [CrossRef]
- Nguyen, L.T.; Kang, T.; Kim, H. Deep Residual Network for Early Detection of Diabetic Foot Complications with Infrared Thermography. IEEE Access 2021, 9, 57432–57441. [Google Scholar]
- Wu, L.; Huang, R.; He, X.; Tang, L.; Ma, X. Advances in Machine Learning-Aided Thermal Imaging for Early Detection of Diabetic Foot Ulcers: A Review. Biosensors 2024, 14, 614. [Google Scholar] [CrossRef] [PubMed]
- Hussein, B.K.; Azar, A.T.; Song, E.Y. MobileNet-Based Approach for On-Device DFU Screening Using Thermal Imaging. IEEE Sens. J. 2022, 22, 14986–14994. [Google Scholar]
- Shao, H. An Improved Vision Transformer for Early Detection of Diabetic Foot Using Thermogram. In Proceedings of the 2023 8th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China, 21–23 April 2023; pp. 72–76. [Google Scholar]
- Saeedi, M. Federated vs. Central Machine Learning on Diabetic Foot Ulcer Images: Comparative Simulations. IEEE Access 2023, 12, 58960–58971. [Google Scholar] [CrossRef]
- Jain, A.; Sreedevi, I. An Enhanced Methodology for Diabetic Foot Thermogram Classification using Deep Learning. In Proceedings of the 2022 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing, Faridabad, India, 26–27 May 2022; pp. 583–588. [Google Scholar]
- Chowdary, C.S.; Ruthwik, D.; Sai, K.N.; Rishik, S.; Sampath, N. A Comparative Analysis of Deep Learning Models for Detection of Diabetic Foot Ulcer using Foot Thermography Images. In Proceedings of the 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kamand, India, 24–28 June 2024; pp. 1–8. [Google Scholar]
- Jain, A.; Sreedevi, I. An Improved Deep Neural Network for Multiclass Classification of Diabetic Foot Thermogram. In Proceedings of the 2022 2nd International Conference on Intelligent Technologies (CONIT), Hubli, India, 24–26 June 2022; pp. 1–6. [Google Scholar]
- Wei, C.L.; Abdul-Kadir, N.A.; Mahmood, N.H.; Embong, A.M.; Harun, F.K.C.; Wahab, M.A.A. Early Detection of Diabetic Foot Ulcers: Deep Learning Classification using Thermograms (AlexNet Algorithm). In Proceedings of the 2023 IEEE International Biomedical Instrumentation and Technology Conference (IBITeC), Yogyakarta, Indonesia, 9–10 November 2023; pp. 12–16. [Google Scholar]
- Shanmugam, P.; Manoj Kumar, P.K.; Hussain, M.M.; Deepa, R.R.; Sakthivelu, U. A Deep Learning Model-Based Neural Network Framework for Diabetic Foot Ulcer Classification. In Proceedings of the 2024 5th International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, India, 7–9 August 2024; pp. 1305–1310. [Google Scholar]
- Jeyandhan, D.; Jeyanathan, J.S. Investigation of Deep Learning Models for Predicting Diabetic Foot Ulcers in Diabetes Patients. In Proceedings of the 2024 5th International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India, 18–20 September 2024; pp. 1356–1363. [Google Scholar]
- Perpetuini, D.; Formenti, D.; Cardone, D.; Trecroci, A.; Rossi, A.; Di Credico, A.; Merati, G. Alberti G. Baldassarre A.; Merla A. Can Data-Driven Supervised Machine Learning Approaches Applied to Infrared Thermal Imaging Data Estimate Muscular Activity and Fatigue? Sensors 2023, 23, 832. [Google Scholar] [CrossRef]
- dos Santos Bunn, P.; Miranda, M.E.K.; Rodrigues, A.I.; de Souza Sodré, R.; Neves, E.B.; da Silva, E.B. Infrared thermography and musculoskeletal injuries: A systematic review with meta-analysis. Infrared Phys. Technol. 2020, 109, 103435. [Google Scholar] [CrossRef]
- Fernández, C.I.; Arnaiz-Lastras, J.; Escamilla, G.V.; Carmona, P. Infrared Thermography for the Detection of Injury in Sports Medicine. Biol. Med. Phys. Biomed. Eng. (BIOMEDICAL) Appl. Infrared Thermogr. Sports Sci. 2017, 81–109. [Google Scholar]
- Nithyakalyani, K.; Muthu, P. Detection of chronic venous insufficiency condition using transfer learning with convolutional neural networks based on thermal images. Biomed. Eng. Appl. Basis Commun. 2024, 36, 2350030. [Google Scholar]
- Krishnan, N.; Muthu, P. CVINet: A deep learning based model for the diagnosis of chronic venous insufficiency in lower extremity using infrared thermal images. Int. J. Imaging Syst. Technol. 2024, 34, e23004. [Google Scholar] [CrossRef]
- White, E.S.; Silva, T.; Kan, R. Automated Thermographic Arthritis Detection with VGG16 and SVM. IEEE Access 2022, 10, 83212–83222. [Google Scholar]
- Ahalya, R.K.; Snekhalatha, U. CNN Transformer for the Automated Detection of Rheumatoid Arthritis in Hand Thermal Images. In Proceedings of the Artificial Intelligence over Infrared Images for Medical Applications: Third International Conference, AIIIMA 2024, Virtual Event, 9 November 2024; pp. 23–32. [Google Scholar]
- Chantasartrassamee, P.; Ongphiphadhanakul, B.; Suvikapakornkul, R.; Binsirawanich, P.; Sriphrapradang, C. Artificial intelligence-enhanced infrared thermography as a diagnostic tool for thyroid malignancy detection. Ann. Med. 2024, 56, 2425826. [Google Scholar] [CrossRef]
- Lee, S.H.; Park, J.A.; Tsui, K. Deep Transfer Learning for Thyroid Thermogram Classification. IEEE J. Biomed. Health Inform. 2023, 27, 1456–1464. [Google Scholar]
- Aghaomidi, P.; Bahmani, Z.; Mohammdian, A. Recognition of driver’s distraction based on facial thermal videos by deep learning. In Proceedings of the 2022 56th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA, 30 October–2 November 2022; pp. 811–815. [Google Scholar]
- Katte, P.; Kakileti, S.T.; Madhu, H.; Manjunath, G. Automated Thermal Screening for COVID-19 Using Machine Learning. arxiv 2022, arXiv:2203.14128. [Google Scholar]
- Sanal, A.; Udupa, G. Machine learning based human body temperature measurement and mask detection by thermal imaging. In Proceedings of the 2022 Third International Conference on Intelligent Computing Instrumentation and Control Technologies (ICICICT), Kannur, India, 11–12 August 2022; pp. 1339–1343. [Google Scholar]
- Navaneeth, S.; Sarath, S.; Nair, B.A.; Harikrishnan, K.; Prajal, P. Deep-Learning Approach to Find Respiratory Syndromes in Infants using Thermal Imaging. In Proceedings of the 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 28–30 July 2020; pp. 498–501. [Google Scholar]
- Lee, T.J.; Park, H.; Choi, D. Deep Transfer Learning-Based Infrared Fever Detection for COVID-19 Screening. IEEE Access 2021, 9, 147123–147135. [Google Scholar]
- Patel, D.; Sharma, A. Multi-Modal Fusion of RGB and IR Images for COVID-19 Fever Screening. IEEE Sens. J. 2022, 22, 11732–11741. [Google Scholar]
- Makino Antunes, A.C.; Aldred, A.; Tirado Moreno, G.P.; de Souza Ribeiro, J.A.; Brandão, P.E.; Barone, G.T.; Conselheiro, J.A.; Goulart, A.C.; Desuó, I.C.; Gomes, G. Potential of using facial thermal imaging in patient triage of flu-like syndrome during the COVID-19 pandemic crisis. PLoS ONE 2023, 18, e0279930. [Google Scholar] [CrossRef] [PubMed]
- Kwasniewska, A.; Ruminski, J.; Szankin, M.; Kaczmarek, M. Super-resolved thermal imagery for high-accuracy facial areas detection and analysis. Eng. Appl. Artif. Intell. 2020, 87, 103263. [Google Scholar] [CrossRef]
- Kwasniewska, A.; Szankin, M.; Ruminski, J.; Kaczmarek, M. Evaluating Accuracy of Respiratory Rate Estimation from Super Resolved Thermal Imagery. In Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 23–27 July 2019; pp. 2744–2747. [Google Scholar]
- Kaczmarek, M.; Guzik, J. The use of machine learning for face regions detection in thermograms. In Proceedings of the QIRT’23 Conference, Abu Dhabi, United Arab Emirates, 30 October–3 November 2023; pp. 1–5. [Google Scholar]
- Thukral, R.; Arora, A.; Kumar, A.G. Denoising of Thermal Images Using Deep Neural Network. In Proceedings of the International Conference on Recent Trends in Computing, Lecture Notes in Networks and Systems, Ghaziabad, India, 3–4 June 2022; Volume 341, pp. 827–833. [Google Scholar]
- Guo, W.; Fan, Y.; Zhang, G. Lightweight Infrared Image Denoising Method Based on Adversarial Transfer Learning. Sensors 2024, 24, 6677. [Google Scholar] [CrossRef]
- Marnissi, M.A.; Fathallah, A. GAN-based Vision Transformer for High-Quality Thermal Image Enhancement. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada, 17–24 June 2023; pp. 817–825. [Google Scholar]
- Blasch, E.; Liu, Z.; Zheng, Y. Advances in deep learning for infrared image processing and exploitation. In Infrared Technology and Applications XLVIII; SPIE: Bellingham, WA, USA, 2022; pp. 1–16. [Google Scholar]
- Choi, C.-H.; Han, J.; Cha, J.; Choi, H.; Shin, J.; Kim, T.; Oh, H.W. Contrast Enhancement Method Using Region-Based Dynamic Clipping Technique for LWIR-Based Thermal Camera of Night Vision Systems. Sensors 2024, 24, 3829. [Google Scholar] [CrossRef] [PubMed]
- Ma, W.; Wang, K.; Li, J.; Yang, S.X.; Li, J.; Song, L.; Li, Q. Infrared and Visible Image Fusion Technology and Application: A Review. Sensors 2023, 23, 599. [Google Scholar] [CrossRef] [PubMed]
- Yang, S.; Sun, M.; Lou, X.; Yang, H.; Zhou, H. An Unpaired Thermal Infrared Image Translation Method Using GMA-CycleGAN. Remote Sens. 2023, 15, 663. [Google Scholar] [CrossRef]
- da Silva, L.; Saade, D.; Sequeiros, O.; Silva, A.; Paiva, A.; Bravo, R.; Conci, A. A New Database for Breast Research with Infrared Image. J. Med. Imaging Health Inform. 2014, 4, 92–100. [Google Scholar] [CrossRef]
- Pacheco, R.C.; Carvalho, K.R.; da Silva, A.J. Breast Thermography Database for Mastology Research (BIR/DMR). In Proceedings of the 2020 IEEE EMBS Conference, Montreal, QC, Canada, 20–24 July 2020; pp. 1–11. [Google Scholar]
- Bouallal, D.; Bougrine, A.; Harba, R.; Canals, R.; Douzi, H.; Vilcahuaman, L.; Arbanil, H. STANDUP database of plantar foot thermal and RGB images for early ulcer detection. Open Res. Eur. 2022, 2, 77. [Google Scholar] [CrossRef]
- Rodriguez-Guerrero, S.; Loaiza-Correa, H.; Restrepo-Girón, A.-D.; Reyes, L.A.; Olave, L.A.; Diaz, S.; Pacheco, R. Dataset of breast thermography images for the detection of benign and malignant masses. Data Brief 2024, 54, 110503. [Google Scholar] [CrossRef]
- Singh, A.; Bhat, V.; Sudhakar, S.; Namachivayam, A.; Gangadharan, C.; Pulchan, C.; Sigamani, A. Multicentric study to evaluate the effectiveness of Thermalytix as compared with standard screening modalities in subjects who show possible symptoms of suspected breast cancer. BMJ Open 2021, 11, e052098. [Google Scholar] [CrossRef]
- Bansal, R.; Collison, S.; Krishnan, L.; Aggarwal, B.; Vidyasagar, M.; Kakileti, S.T.; Manjunath, G. A prospective evaluation of breast thermography enhanced by a novel machine learning technique for screening breast abnormalities in a general population of women presenting to a secondary care hospital. Front. Artif. Intell. 2023, 5, 1050803. [Google Scholar] [CrossRef]
Years | Technology Progress |
---|---|
1958–1960 | single-detector scanning camera, 1 image/minute, analog signal |
~1965 | InSb cooled detector, MWIR, scanning mirrors, 30 images/s |
~1970 | HgCdTe cooled detector, LWIR, scanning |
~1975 | digital signal, isotherms, 60 images/s, real-time images |
~1985 | FPA detectors and integrated software in hand-held cameras |
~1990 | uncooled FPA arrays |
Now | introduction of high-resolution, uncooled thermal imagers, multimodality systems, multispectral and high-resolution arrays, advanced AI tools on board IR thermal systems |
Year | IEEE Xplore | MDPI Journals |
---|---|---|
2020 | 10–15 | 5–10 |
2021 | 20–25 | 10–15 |
2022 | 30–35 | 15–25 |
2023 | 40–50 | 25–35 |
2024 | 15–25 | 15–25 1 |
Model | Dataset Size | Accuracy | Sensitivity | Specificity | AUC | Notes |
---|---|---|---|---|---|---|
VGG16 | ~300–600 images | 78–85% | 80–88% | 75–83% | 0.80–0.85 | Often used as a baseline, overfitting risks, especially in small data. |
ResNet50 | ~500–1000 images | 85–90% | 88–92% | 82–88% | 0.86–0.92 | Residual blocks enable deeper feature extraction, typically strong performance. |
DenseNet121 | ~500–1000 images | 85–91% | 88–94% | 80–90% | 0.86–0.93 | Dense connections can boost feature reuse, good for relatively small data. |
MobileNet | ~300–500 images | 78–85% | 78–88% | 75–83% | 0.78–0.85 | Lightweight model appealing for bedside or low-power devices. |
ViT | ~300–700 images | 80–88% | 83–90% | 78–85% | 0.84–0.89 | Emerging approach; efficacy limited by dataset size (transfer learning is key). |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Nowakowski, A.Z.; Kaczmarek, M. Artificial Intelligence in IR Thermal Imaging and Sensing for Medical Applications. Sensors 2025, 25, 891. https://doi.org/10.3390/s25030891
Nowakowski AZ, Kaczmarek M. Artificial Intelligence in IR Thermal Imaging and Sensing for Medical Applications. Sensors. 2025; 25(3):891. https://doi.org/10.3390/s25030891
Chicago/Turabian StyleNowakowski, Antoni Z., and Mariusz Kaczmarek. 2025. "Artificial Intelligence in IR Thermal Imaging and Sensing for Medical Applications" Sensors 25, no. 3: 891. https://doi.org/10.3390/s25030891
APA StyleNowakowski, A. Z., & Kaczmarek, M. (2025). Artificial Intelligence in IR Thermal Imaging and Sensing for Medical Applications. Sensors, 25(3), 891. https://doi.org/10.3390/s25030891