CN113796850A - Parathyroid MIBI image analysis system, computer device, and storage medium - Google Patents
Parathyroid MIBI image analysis system, computer device, and storage medium Download PDFInfo
- Publication number
- CN113796850A CN113796850A CN202111138902.8A CN202111138902A CN113796850A CN 113796850 A CN113796850 A CN 113796850A CN 202111138902 A CN202111138902 A CN 202111138902A CN 113796850 A CN113796850 A CN 113796850A
- Authority
- CN
- China
- Prior art keywords
- model
- mibi
- parathyroid
- image
- layers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- LJJFNFYPZOHRHM-UHFFFAOYSA-N 1-isocyano-2-methoxy-2-methylpropane Chemical compound COC(C)(C)C[N+]#[C-] LJJFNFYPZOHRHM-UHFFFAOYSA-N 0.000 title claims abstract description 65
- 230000000849 parathyroid Effects 0.000 title claims abstract description 34
- 238000010191 image analysis Methods 0.000 title claims abstract description 19
- 210000002990 parathyroid gland Anatomy 0.000 claims abstract description 44
- 238000013136 deep learning model Methods 0.000 claims abstract description 33
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000004927 fusion Effects 0.000 claims abstract description 22
- 238000012549 training Methods 0.000 claims abstract description 21
- 230000009467 reduction Effects 0.000 claims abstract description 18
- 238000012360 testing method Methods 0.000 claims abstract description 17
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 9
- 238000007781 pre-processing Methods 0.000 claims abstract description 9
- 208000000821 Parathyroid Neoplasms Diseases 0.000 claims description 14
- 208000025061 parathyroid hyperplasia Diseases 0.000 claims description 10
- 230000001537 neural effect Effects 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 8
- 206010067772 Parathyroid cyst Diseases 0.000 claims description 7
- 206010033964 Parathyroid tumour benign Diseases 0.000 claims description 7
- 201000003686 parathyroid adenoma Diseases 0.000 claims description 7
- 201000003913 parathyroid carcinoma Diseases 0.000 claims description 7
- 208000014643 parathyroid gland adenoma Diseases 0.000 claims description 7
- 208000017954 parathyroid gland carcinoma Diseases 0.000 claims description 7
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 201000010099 disease Diseases 0.000 abstract description 8
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 abstract description 8
- 230000008901 benefit Effects 0.000 abstract description 7
- 238000003745 diagnosis Methods 0.000 abstract description 5
- 238000004458 analytical method Methods 0.000 abstract 1
- 238000003384 imaging method Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 7
- 238000013135 deep learning Methods 0.000 description 5
- 201000002980 Hyperparathyroidism Diseases 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 238000002604 ultrasonography Methods 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001356 surgical procedure Methods 0.000 description 2
- 210000001685 thyroid gland Anatomy 0.000 description 2
- OYPRJOBELJOOCE-UHFFFAOYSA-N Calcium Chemical compound [Ca] OYPRJOBELJOOCE-UHFFFAOYSA-N 0.000 description 1
- BHPQYMZQTOCNFJ-UHFFFAOYSA-N Calcium cation Chemical compound [Ca+2] BHPQYMZQTOCNFJ-UHFFFAOYSA-N 0.000 description 1
- 208000013612 Parathyroid disease Diseases 0.000 description 1
- 102000003982 Parathyroid hormone Human genes 0.000 description 1
- 108090000445 Parathyroid hormone Proteins 0.000 description 1
- 208000029088 Phosphorus metabolism disease Diseases 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000004071 biological effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000011575 calcium Substances 0.000 description 1
- 229910052791 calcium Inorganic materials 0.000 description 1
- 229910001424 calcium ion Inorganic materials 0.000 description 1
- 208000022458 calcium metabolism disease Diseases 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 230000002490 cerebral effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000000586 desensitisation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000002249 digestive system Anatomy 0.000 description 1
- 230000004064 dysfunction Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000004907 gland Anatomy 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 239000000199 parathyroid hormone Substances 0.000 description 1
- 229960001319 parathyroid hormone Drugs 0.000 description 1
- 230000036285 pathological change Effects 0.000 description 1
- 231100000915 pathological change Toxicity 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 230000002980 postoperative effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002485 urinary effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/725—Details of waveform analysis using specific filters therefor, e.g. Kalman or adaptive filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Signal Processing (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- Physiology (AREA)
- Psychiatry (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Fuzzy Systems (AREA)
- Radiology & Medical Imaging (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Bioinformatics & Cheminformatics (AREA)
- High Energy & Nuclear Physics (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Quality & Reliability (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention belongs to the technical field of parathyroid gland functional disease diagnosis, and particularly relates to a parathyroid gland MIBI image analysis system, computer equipment and a storage medium. The computer device of the present invention is used to implement the following parathyroid MIBI image analysis steps: step 1, preprocessing an MIBI image of parathyroid gland and inputting the preprocessed MIBI image into a deep learning model; step 2, after the deep learning model is calculated, outputting a classification result of the MIBI image of the parathyroid gland; the deep learning model is constructed by the following method: and respectively modeling and fusing the four convolutional neural network models to construct a final deep learning model. The invention also provides a system for realizing the analysis steps, which comprises a sub-model training module, a sub-model fusion module, a test module, a use module, a noise reduction module and an enhancement module. The method has the advantages of improving the advantages and avoiding the disadvantages by fusing multiple sub-models, improving the accuracy and robustness and having good application prospect.
Description
Technical Field
The invention belongs to the technical field of parathyroid gland functional disease diagnosis, and particularly relates to a parathyroid gland MIBI image analysis system, computer equipment and a storage medium.
Background
Parathyroid gland is an important organ for maintaining calcium ion balance of the body, and parathyroid gland related diseases are caused by calcium and phosphorus metabolism disorder due to parathyroid hormone abnormality secreted by parathyroid gland main cells, so that a series of multi-system and multi-organ pathological changes and dysfunction of urinary system, digestive system, nerve system, skin system and the like are caused. Parathyroid disorders are divided into two major categories, hyperparathyroidism and hypofunction, with hyperparathyroidism being the most common. Hyperparathyroidism generally lacks specific clinical manifestations and many changes in imaging due to changes in its structure have become important clinical bases, including parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma, and parathyroid cyst. Therefore, accurate localization and assessment of problem foci of the parathyroid gland is critical to the diagnosis and treatment of parathyroid related diseases.
99 mTechnetium-methoxyisobutylisonitrile (99mTc-MIBI, MIBI for short) imaging is the most common and accurate method for parathyroid gland image examination. Currently, the 99mTcMIBI two-phase imaging method is commonly used to localize diseased parathyroid glands clinically. The principle is to use the difference of the clearance rate of the thyroid gland and the parathyroid gland to 99mTc-MIBI, thereby qualitatively and locally diagnosing the hyperparathyroid gland tissue. The MIBI planar imaging is a two-dimensional image and has lower resolution, meanwhile, the parathyroid gland has the characteristics of small volume and low visual identification difference of disease difference, and the identification of the parathyroid gland MIBI imaging has extremely high requirements on the experience and the professional degree of a clinician.
The deep learning neural network algorithm is a more effective image identification method. The neural network algorithm is a nonlinear model for simulating the biological activity of cerebral neurons, and has the advantages of being capable of rapidly identifying linear types, processing mixed and incomplete data, being high in fault tolerance capability, training data popularization capability and the like. Deep learning is a deep artificial neural network. The method is a nonlinear multi-layer feature learning model, which automatically detects and classifies feature information of original data (such as pixels, characters and the like), learns features on a plurality of layers according to a nonlinear modularization mode, and then simplifies and integrates the features step by step to generate a final result. At present, related researches are carried out on a method for diagnosing parathyroid related diseases by utilizing a neural network algorithm, and Chinese patent application CN111062953A, namely a method for identifying parathyroid hyperplasia in an ultrasonic image, provides a method for identifying parathyroid hyperplasia and obtains a training sample comprising the ultrasonic image and a corresponding diagnosis result; wherein, the ultrasonic image is an image obtained by ultrasonic imaging of the hyperparathyroidism affected area of the patient; carrying out data enhancement processing on the training sample by adopting a mixed gamma-CLAHE method; inputting the training sample after the enhancement treatment into a Faster R-CNN network to obtain a trained network model; and inputting the neck ultrasonic image to be recognized into the trained Faster R-CNN model to obtain a recognition result output by the trained model. However, the image data used in this patent application is an ultrasound image, the ultrasound image has extremely low resolution to the parathyroid gland, and the color ultrasound is not conventionally used in clinic as a radiographic examination of the parathyroid gland; meanwhile, the method can only identify the focus of parathyroid hyperplasia, and is not suitable for other types of focuses of parathyroid function diseases.
At present, the mature MIBI imaging artificial intelligence recognition technology can realize the recognition of multiple parathyroid foci at home and abroad.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a parathyroid MIBI image analysis system, computer equipment and a storage medium, and aims to provide a method with high accuracy and good robustness, so that the identification and classification of normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst on a parathyroid MIBI image by using a deep learning model can be realized.
A computer device for parathyroid MIBI image analysis, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor executing the program to perform the steps of parathyroid MIBI image analysis as follows:
step 1, preprocessing an MIBI image of parathyroid gland and inputting the preprocessed MIBI image into a deep learning model;
step 2, after the deep learning model is calculated, outputting a classification result of the MIBI image of the parathyroid gland;
the deep learning model is constructed by the following method:
step A, respectively modeling four convolutional neural network models, namely a VGG model, a ResNet model, a DenseNet model and an EfficientNet model, by adopting a multi-head attention mechanism;
and step B, performing neural model fusion by adopting a majority voting mode, and constructing a final deep learning model.
Preferably, in step a, the number of layers of the VGG model is 19, the number of layers of the ResNet model is at least one of 18 layers, 50 layers, or 152 layers, the number of layers of the DenseNet model is at least one of 169 layers or 264 layers, and the version of the EfficientNet model is at least one of b0, b4, or b 7.
Preferably, in step a, a VGG model of 19 layers, a ResNet model of 18 layers, 50 layers and 152 layers, a DenseNet model of 169 layers and 264 layers, and EfficientNet models of versions b0, b4 and b7 are modeled to obtain 9 sub-models respectively;
in step B, the result of performing neural model fusion is:
Result＝k1×VGG19+k2×ResNet18+k3×ResNet50+k4×ResNet152+k5×DenseNet169+k6×DenseNet264+k7×EfficientNetb0+k8×EfficientNetb4+k9×EfficientNetb7；
wherein Result is the Result of classifying parathyroid MIBI images by the final deep learning model, k1, k2, k3, k4, k5, k6, k7, k8 and k9 are coefficients of sub models, which satisfy k1+ k2+ k3+ k4+ k5+ k6+ k7+ k8+ k9 ═ 1, VGG19, ResNet18, ResNet50, ResNet152, densnet 169, densnet 264, efficientnet 0, efficientnet 4 and efficientnet 7 are the results of classifying parathyroid MIBI images by 9 sub models respectively.
Preferably, in step 1, the preprocessing includes at least one of noise reduction or super-resolution data enhancement.
Preferably, the noise reduction method is to process the image by using an adaptive median filter.
Preferably, the super-resolution data enhancement is realized by adopting a test timing sequence enhancement technology.
Preferably, the classification result output by the deep learning model is the probability that the MIBI image belongs to normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst.
The present invention also provides a computer-readable storage medium having stored thereon a computer program for carrying out the steps of the above-described parathyroid MIBI image analysis.
The present invention also provides a system for MIBI image analysis of a parathyroid gland, comprising:
the sub-model training module is used for respectively modeling four convolutional neural network models, namely a VGG model, a ResNet model, a DenseNet model and an EfficientNet model, by adopting a multi-head attention mechanism;
the sub-model fusion module is used for carrying out neural model fusion by adopting a majority voting mode to construct a final deep learning model;
the test module is used for inputting the test set into the deep learning model constructed by the sub-model fusion module and evaluating the accuracy of the model;
and the using module is used for inputting the MIBI images of the parathyroid gland into the deep learning model constructed by the sub-model fusion module and outputting the classification result of the MIBI images of the parathyroid gland.
Preferably, the system further comprises:
the noise reduction module is used for carrying out noise reduction pretreatment on the MIBI image of the parathyroid gland;
and the enhancement module is used for carrying out super-resolution data enhancement preprocessing on the MIBI image of the parathyroid gland.
The technical scheme of the invention has the following beneficial effects:
1. the method and the device for identifying the MIBI developed image of the parathyroid gland based on deep learning are used for assisting a doctor in identifying the parathyroid gland and related diseases by imaging, and have the advantage of high accuracy. The accuracy rate of parathyroid MIBI developed image identification reaches 95%, and the method has important significance for clinical auxiliary diagnosis, and especially has important clinical significance for primary screening under the condition that a primary hospital lacks a thyroid ultrasonography department.
2. The invention is based on clinic, highly fit with clinical logic thinking and actual use scenes, and has convenient operation and high practicability.
3. In the preferred scheme, before the image deep learning is carried out, the noise reduction processing is carried out on the MIBI image, the interference of the image quality to a training model is reduced, and the accuracy is improved. And the ATT technology is adopted to perform data enhancement on the training set, so that the richness of the data of the training set is increased. The method is characterized in that the method is trained by using sub models of 9 different levels and versions of four convolutional network models, namely VGG, ResNet, DenseNet and EfficientNet, wherein the models are the latest large deep learning networks with better performance on medical images. The final model combines sub-models of 9 different levels and versions of the four convolutional network models to fuse, so that the advantages and the disadvantages of the sub-models are improved, and the accuracy and the robustness of the training model are improved. When the model is used, the newly input images are subjected to noise reduction processing, so that the degree of adaptation to the model is facilitated, and the accuracy of the system is improved.
Obviously, many modifications, substitutions, and variations are possible in light of the above teachings of the invention, without departing from the basic technical spirit of the invention, as defined by the following claims.
The present invention will be described in further detail with reference to the following examples. This should not be understood as limiting the scope of the above-described subject matter of the present invention to the following examples. All the technologies realized based on the above contents of the present invention belong to the scope of the present invention.
Drawings
FIG. 1 is a schematic flow chart of example 1 of the present invention;
fig. 2 is a schematic structural diagram of a system in embodiment 1 of the present invention.
Detailed Description
It should be noted that, in the embodiment, the algorithm of the steps of data acquisition, transmission, storage, processing, etc. which are not specifically described, as well as the hardware structure, circuit connection, etc. which are not specifically described, can be implemented by the contents disclosed in the prior art.
Example 1 System for Parathyroid MIBI image analysis
The present embodiment provides a system for parathyroid MIBI image analysis, comprising: the device comprises a noise reduction module, an enhancement module, a sub-model training module, a sub-model fusion module, a test module and a use module.
Wherein:
the sub-model training module is used for respectively modeling four convolutional neural network models, namely a VGG model, a ResNet model, a DenseNet model and an EfficientNet model, by adopting a multi-head attention mechanism;
the sub-model fusion module is used for carrying out neural model fusion by adopting a majority voting mode to construct a final deep learning model;
the test module is used for inputting the test set into the deep learning model constructed by the sub-model fusion module and evaluating the accuracy of the model;
the using module is used for inputting the MIBI images of the parathyroid gland into the deep learning model constructed by the sub-model fusion module and outputting the classification result of the MIBI images of the parathyroid gland;
the noise reduction module is used for carrying out noise reduction pretreatment on the MIBI image of the parathyroid gland;
and the enhancement module is used for carrying out super-resolution data enhancement preprocessing on the MIBI image of the parathyroid gland.
The above system may be implemented in a computing and apparatus comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor when executing the program implementing the parathyroid MIBI image analysis step as shown in fig. 1. The specific process of parathyroid MIBI image analysis is as follows:
1. extracting data: the original data matching, desensitization and extraction are performed by retrospectively collecting postoperative pathological data of patients who have undergone parathyroid gland surgery and parathyroid MIBI imaging pictures before surgery.
2. The method for marking parathyroid MIBI development original pictures comprises the following steps: the image names (classification results) are used as label labels, and the labels are classified into normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst.
3. Noise reduction pretreatment: and carrying out noise reduction processing on the image by adopting an adaptive median filter. It includes two working processes:
and a process A:
A1＝zmed-zmin
A2＝zmed-zmax
if A is1> 0 and A2If the value is less than 0, the process B is switched to;
otherwise, increasing the image size;
if the window size is less than or equal to SmaxRepeating the process A;
otherwise output zmed；
And a process B:
B1＝zxy-zmin
B2＝zxy-zmax
if B is present1> 0 and B2If < 0, then z is outputxy
Otherwise, output xmed
Wherein: the meaning of the symbols is as follows:
Sxythe image data needing noise reduction processing is obtained;
zminis SxyThe minimum gray value;
zmaxis SxyMedium maximum gray value;
zmedis SxyMedian of median gray values;
zxyis the gray value at coordinate (x, y);
Smaxis SxyThe maximum size allowed.
4. The noise-reduced MIBI developed image is divided into a training image set and a testing image set in a random distribution mode, wherein the training set accounts for 80%, and the testing set accounts for 20%. In this example, 5000 labeled parathyroid MIBI images are provided, 4000 of which are used as training sets and 1000 of which are used as test sets.
5. And (2) performing data enhancement by adopting a test time sequence enhancement (TTA) technology, turning, rotating, cutting, deforming, scaling and the like on the training set image of each model, increasing the training set image quantity, and inputting the training set image quantity into the training model, namely the test time sequence enhancement (TTA) technology.
6. Defining the selected sub-model and the number of layers or version number thereof, in this embodiment, 9 seed models are selected, which are: VGG model at 19 layers, ResNet model at 18, 50 and 152 layers, DenseNet model at 169 and 264 layers, and EfficientNet model at versions b0, b4 and b 7. And respectively utilizing the training sets to train and model the 9 sub-models by adopting a multi-head attention mechanism.
7. Performing neural model fusion by adopting a majority voting mode, setting parameters for each sub-model, and performing neural model fusion as follows:
Result＝k1×VGG19+k2×ResNet18+k3×ResNet50+k4×ResNet152+k5×DenseNet169+k6×DenseNet264+k7×EfficientNetb0+k8×EfficientNetb4+k9×EfficientNetb7；
wherein Result is the Result of classifying parathyroid MIBI images by the final deep learning model (i.e. the probability of predicting that the MIBI images are classified by normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst), k1, k2, k3, k4, k5, k6, k7, k8 and k9 are coefficients of sub-models, which satisfy k1+ k2+ k3+ k4+ k5+ k6+ k7+ k8+ k9 ═ 1, VGG19, ResNet18, ResNet50, ResNet152, densnet 169, densnet 264, efficientb 0, efficientb 4 and efficientnet 7 are the Result of classifying the parathyroid MIBI images by 9 sub-models respectively.
8. And inputting the test set data into the fusion model for internal test, and evaluating the accuracy of the model.
9. And inputting the parathyroid MIBI images to be classified into the final deep learning model after noise reduction preprocessing to obtain classification results of the parathyroid MIBI images to be classified.
In order to further explain the technical scheme of the invention, the beneficial effects of the invention are further explained by experimental examples.
Experimental example 1 investigation of model accuracy
In this experimental example, the same method as that used in example 1 was used to model a deep learning model, and the results of the nine submodels (GG19, ResNet18, ResNet50, ResNet152, DenseNet169, DenseNet264, EfficientNet-b0, EfficientNet-b4, and EfficientNet-b7) obtained and 1 fused deep learning model [ ensemble (tta) ], AUC (area under ROC curve), F1, and k value are shown in the following table:
as can be seen from the data in the table, the accuracy, AUC, F1 and k value of the 9 sub-models are all significantly lower than those of the fused deep learning model. This shows that the fusion of the application to 9 submodels realizes the effect of making good use of the advantages and avoiding the disadvantages of the submodels, thereby improving the accuracy and robustness of the models.
As can be seen from the above examples and experimental examples, the present invention provides a method, system and apparatus for identifying and classifying normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst from parathyroid MIBI images using a deep learning model. According to the invention, the effects of making good use of the advantages and avoiding the disadvantages of different models are realized by means of fusing the four convolutional neural network models, namely the VGG model, the ResNet model, the DenseNet model and the EfficientNet model, so that the deep learning model for analyzing the parathyroid MIBI image has high accuracy and good robustness. Therefore, the parathyroid MIBI image analysis technology has good application prospect.
Claims (10)
1. A computer device for parathyroid MIBI image analysis, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that: the processor, when executing the program, performs the steps of parathyroid MIBI image analysis as follows:
step 1, preprocessing an MIBI image of parathyroid gland and inputting the preprocessed MIBI image into a deep learning model;
step 2, after the deep learning model is calculated, outputting a classification result of the MIBI image of the parathyroid gland;
the deep learning model is constructed by the following method:
step A, respectively modeling four convolutional neural network models, namely a VGG model, a ResNet model, a DenseNet model and an EfficientNet model, by adopting a multi-head attention mechanism;
and step B, performing neural model fusion by adopting a majority voting mode, and constructing a final deep learning model.
2. The computer apparatus of claim 1, wherein: in step a, the number of layers of the VGG model is 19, the number of layers of the ResNet model is at least one of 18 layers, 50 layers or 152 layers, the number of layers of the DenseNet model is at least one of 169 layers or 264 layers, and the version of the EfficientNet model is at least one of b0, b4 or b 7.
3. The computer apparatus of claim 2, wherein: in the step A, modeling is carried out on a VGG model with 19 layers, a ResNet model with 18 layers, 50 layers and 152 layers, a DenseNet model with 169 layers and 264 layers and EfficientNet models with b0 versions, b4 versions and b7 versions to respectively obtain 9 sub-models;
in step B, the result of performing neural model fusion is:
Result＝k1×VGG19+k2×ResNet18+k3×ResNet50+k4×ResNet152+k5×DenseNet169+k6×DenseNet264+k7×EfficientNetb0+k8×EfficientNetb4+k9×EfficientNetb7；
wherein Result is the Result of classifying parathyroid MIBI images by the final deep learning model, k1, k2, k3, k4, k5, k6, k7, k8 and k9 are coefficients of sub models, which satisfy k1+ k2+ k3+ k4+ k5+ k6+ k7+ k8+ k9 ═ 1, VGG19, ResNet18, ResNet50, ResNet152, densnet 169, densnet 264, efficientnet 0, efficientnet 4 and efficientnet 7 are the results of classifying parathyroid MIBI images by 9 sub models respectively.
4. The computer apparatus of claim 1, wherein: in step 1, the preprocessing includes at least one of noise reduction or super-resolution data enhancement.
5. The computer apparatus of claim 4, wherein: the noise reduction method is to process the image by adopting a self-adaptive median filter.
6. The computer apparatus of claim 4, wherein: the super-resolution data enhancement is realized by adopting a test time sequence enhancement technology.
7. The computer apparatus of claim 1, wherein: and the classification result output by the deep learning model is the probability that the MIBI image belongs to normal parathyroid gland, parathyroid adenoma, parathyroid hyperplasia, parathyroid carcinoma and parathyroid cyst.
8. A computer-readable storage medium characterized by: stored thereon a computer program for carrying out the steps of the parathyroid MIBI image analysis of any of claims 1-7.
9. A system for MIBI image analysis of a parathyroid gland, comprising:
the sub-model training module is used for respectively modeling four convolutional neural network models, namely a VGG model, a ResNet model, a DenseNet model and an EfficientNet model, by adopting a multi-head attention mechanism;
the sub-model fusion module is used for carrying out neural model fusion by adopting a majority voting mode to construct a final deep learning model;
the test module is used for inputting the test set into the deep learning model constructed by the sub-model fusion module and evaluating the accuracy of the model;
and the using module is used for inputting the MIBI images of the parathyroid gland into the deep learning model constructed by the sub-model fusion module and outputting the classification result of the MIBI images of the parathyroid gland.
10. The system of claim 9, wherein the system further comprises:
the noise reduction module is used for carrying out noise reduction pretreatment on the MIBI image of the parathyroid gland;
and the enhancement module is used for carrying out super-resolution data enhancement preprocessing on the MIBI image of the parathyroid gland.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111138902.8A CN113796850A (en) | 2021-09-27 | 2021-09-27 | Parathyroid MIBI image analysis system, computer device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111138902.8A CN113796850A (en) | 2021-09-27 | 2021-09-27 | Parathyroid MIBI image analysis system, computer device, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113796850A true CN113796850A (en) | 2021-12-17 |
Family
ID=78896876
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111138902.8A Pending CN113796850A (en) | 2021-09-27 | 2021-09-27 | Parathyroid MIBI image analysis system, computer device, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113796850A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117456283A (en) * | 2023-12-18 | 2024-01-26 | 南京江北新区生物医药公共服务平台有限公司 | Nail disease image intelligent diagnosis method based on deep learning |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111598876A (en) * | 2020-05-18 | 2020-08-28 | 北京小白世纪网络科技有限公司 | Method, system and equipment for constructing thyroid nodule automatic identification model |
| CN112656369A (en) * | 2020-11-30 | 2021-04-16 | 浙江大学医学院附属第一医院 | AR technology-based near-infrared fluorescent parathyroid gland identification enhancement method |
| CN113205141A (en) * | 2021-05-08 | 2021-08-03 | 脉得智能科技(无锡)有限公司 | Parathyroid gland identification method based on image fusion technology |
-
2021
- 2021-09-27 CN CN202111138902.8A patent/CN113796850A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111598876A (en) * | 2020-05-18 | 2020-08-28 | 北京小白世纪网络科技有限公司 | Method, system and equipment for constructing thyroid nodule automatic identification model |
| CN112656369A (en) * | 2020-11-30 | 2021-04-16 | 浙江大学医学院附属第一医院 | AR technology-based near-infrared fluorescent parathyroid gland identification enhancement method |
| CN113205141A (en) * | 2021-05-08 | 2021-08-03 | 脉得智能科技(无锡)有限公司 | Parathyroid gland identification method based on image fusion technology |
Non-Patent Citations (2)
| Title |
|---|
| JOSEPH R.IMBUS MD等: "Machine learning to identify multigland disease in primary hyperparathyroidism" * |
| 刘冰: "小视野多b值扩散加权成像在诊断甲状腺及甲状旁腺病变中的价值" * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117456283A (en) * | 2023-12-18 | 2024-01-26 | 南京江北新区生物医药公共服务平台有限公司 | Nail disease image intelligent diagnosis method based on deep learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109886273B (en) | CMR image segmentation and classification system | |
| CN112101451B (en) | Breast cancer tissue pathological type classification method based on generation of antagonism network screening image block | |
| CN109670510A (en) | A kind of gastroscopic biopsy pathological data screening system and method based on deep learning | |
| CN112365980A (en) | Brain tumor multi-target point auxiliary diagnosis and prospective treatment evolution visualization method and system | |
| CN115410046A (en) | Skin disease tongue picture classification model based on deep learning, establishing method and application | |
| CN113576508A (en) | Cerebral hemorrhage auxiliary diagnosis system based on neural network | |
| CN112101424A (en) | Generation method, identification device and equipment of retinopathy identification model | |
| CN116993699A (en) | Medical image segmentation method and system under eye movement auxiliary training | |
| CN117237351A (en) | Ultrasonic image analysis method and related device | |
| CN113974627B (en) | Emotion recognition method based on brain-computer generated confrontation | |
| CN113796850A (en) | Parathyroid MIBI image analysis system, computer device, and storage medium | |
| CN114400086A (en) | Articular disc forward movement auxiliary diagnosis system and method based on deep learning | |
| CN113643263B (en) | Identification method and system for upper limb bone positioning and forearm bone fusion deformity | |
| CN116402954A (en) | Spine three-dimensional structure reconstruction method based on deep learning | |
| Voggu et al. | A survey on skin disease detection using deep learning techniques | |
| Zhao et al. | Machine learning approaches in comparative studies for Alzheimer’s diagnosis using 2D MRI slices | |
| CN112967295A (en) | Image processing method and system based on residual error network and attention mechanism | |
| Chehade et al. | Advancing chest X-ray diagnostics: A novel CycleGAN-based preprocessing approach for enhanced lung disease classification in ChestX-Ray14 | |
| Hsu et al. | A comprehensive study of age-related macular degeneration detection | |
| Gunasekara et al. | A feasibility study for deep learning based automated brain tumor segmentation using magnetic resonance images | |
| CN115100183B (en) | Calculus identification and positioning method based on depth separable convolution model and related equipment | |
| CN113936165B (en) | CT image processing method, terminal and computer storage medium | |
| Upadhyay et al. | Medical Imaging in Artificial Intelligence: a Literature Survey | |
| Li et al. | Composition statistics of gynecological microscopic images based on texture analysis and medical intelligence system | |
| Barkovitch et al. | Comparison of InceptionV3 and ResNet18 Deep Neural Networks for Regression in Medical Imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211217 |
|
| RJ01 | Rejection of invention patent application after publication |