Nothing Special   »   [go: up one dir, main page]
Skip to main content
Visual Computing for Industry, Biomedicine, and Art
Download PDF
  • Original Article
  • Open access
  • Published:

Discrimination between leucine-rich glioma-inactivated 1 antibody encephalitis and gamma-aminobutyric acid B receptor antibody encephalitis based on ResNet18

Visual Computing for Industry, Biomedicine, and Art volume 6, Article number: 17 (2023) Cite this article

Abstract

This study aims to discriminate between leucine-rich glioma-inactivated 1 (LGI1) antibody encephalitis and gamma-aminobutyric acid B (GABAB) receptor antibody encephalitis using a convolutional neural network (CNN) model. A total of 81 patients were recruited for this study. ResNet18, VGG16, and ResNet50 were trained and tested separately using 3828 positron emission tomography image slices that contained the medial temporal lobe (MTL) or basal ganglia (BG). Leave-one-out cross-validation at the patient level was used to evaluate the CNN models. The receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC) were generated to evaluate the CNN models. Based on the prediction results at slice level, a decision strategy was employed to evaluate the CNN models’ performance at patient level. The ResNet18 model achieved the best performance at the slice (AUC = 0.86, accuracy = 80.28%) and patient levels (AUC = 0.98, accuracy = 96.30%). Specifically, at the slice level, 73.28% (1445/1972) of image slices with GABAB receptor antibody encephalitis and 87.72% (1628/1856) of image slices with LGI1 antibody encephalitis were accurately detected. At the patient level, 94.12% (16/17) of patients with GABAB receptor antibody encephalitis and 96.88% (62/64) of patients with LGI1 antibody encephalitis were accurately detected. Heatmaps of the image slices extracted using gradient-weighted class activation mapping indicated that the model focused on the MTL and BG for classification. In general, the ResNet18 model is a potential approach for discriminating between LGI1 and GABAB receptor antibody encephalitis. Metabolism in the MTL and BG is important for discriminating between these two encephalitis subtypes.

Introduction

Autoimmune encephalitis (AE) is an immune-mediated disease in which antibodies act against neuronal synapses and cell surfaces [1, 2]. Autoimmune limbic encephalitis (ALE) is a common type of AE. A dramatic reduction in neuropsychiatric functions is a hallmark of ALE [3]. ALE has many subtypes, and leucine-rich glioma-inactivated 1 (LGI1) antibody encephalitis and gamma-aminobutyric acid B (GABAB) receptor antibody encephalitis are two typical subtypes [4]. Approximately 10% of LGI1 antibody encephalitis cases are associated with various cancers, such as thymoma [3, 5], and approximately half of GABAB receptor antibody encephalitis cases are associated with small-cell lung cancer [5], which is a common cause of death from cancer [6, 7]. Thus, early and accurate discrimination between LGI1 and GABAB receptor antibody encephalitis can inform different cancer screenings, thereby facilitating individualized treatment decisions and improving clinical outcomes. The diagnosis of LGI1 and GABAB receptor antibody encephalitis depends on antibody testing. However, antibody testing has two main shortcomings: it is time consuming and not easily accessible [5], which likely delays treatment. Previous studies have shown that early diagnosis and treatment can improve the clinical outcomes of patients with AE [8, 9]. A position study [5] stated that while waiting for the results of antibody testing, patients can initially be evaluated using commonly used diagnostic methods, such as magnetic resonance imaging (MRI), for preliminary treatment [5]. Furthermore, the sensitivity of positron emission tomography (PET) is higher than that of MRI for detecting LGI1 [10, 11] and GABAB receptor antibody encephalitis [12]. Therefore, PET is a potential imaging technique for differentiating these two types of encephalitis. However, the abnormal metabolisms of LGI1 and GABAB receptor antibody encephalitis in the PET images were similar. Previous studies found that the metabolism of the medial temporal lobe (MTL) and basal ganglia (BG) was abnormal in patients with LGI1 antibody encephalitis [13,14,15] and those with GABAB receptor antibody encephalitis [16,17,18]. Thus, it is difficult to discriminate between LGI1 and GABAB receptor antibody encephalitis based on visual interpretation of PET images. In clinical practice, visual interpretation is the traditional method of diagnosis using medical images [19]. However, this method depends on the clinician’s experience, which is subjective and inconsistent among clinicians [19]. Some subtle abnormal metabolisms of patients with AE in PET images can be ignored [20]. Fortunately, machine learning (ML) has been increasingly employed to analyze medical images and improve diagnoses [21]. Thus, ML is a potential method for discriminating between LGI1 and GABAB receptor antibody encephalitis based on PET images.

As a recently developed ML methodology, deep learning (DL) has been extensively used in medical image analyses, including classification [22], segmentation [23], and image registration [24]. In particular, it exhibited excellent performance in the intelligent analysis of PET images of patients with brain diseases. For example, Ding et al. [25] applied a convolutional neural network (CNN) model based on PET images to improve the detection of Alzheimer’s disease. Shen et al. [26] employed a modified group lasso sparse deep belief network model to discriminate patients with Parkinson’s disease from healthy participants based on PET images. These studies suggest that DL methods based on PET images can aid in the precise diagnosis of brain diseases. However, it remains unclear whether LGI1 and GABAB receptor antibody encephalitis can be accurately discriminated using DL models based on PET images.

This study aimed to construct CNN models with different convolutional layers based on PET images to discriminate between LGI1 and GABAB receptor antibody encephalitis. When the PET image passes forward through the convolutional layers, the extracted image features are refined to reflect subtle changes in the PET image. Thus, given the strong ability of CNN models to mine crucial features and subtle information, these models may accurately characterize the properties of PET images of both LGI1 and GABAB receptor antibody encephalitis. It was hypothesized that these CNN models could detect abnormal metabolism in PET images of these two types of encephalitis and thereby accurately discriminate them from each other.

Methods

Participants

The Medical Ethics Committee of Beijing Tiantan Hospital approved this study, which complied with the Declaration of Helsinki. The study recruited 81 patients, including 56 males and 25 females (mean ± SD age = 56.99 ± 12.70 years). Table 1 summarizes the patient demographics. The 81 patients fulfilled the following inclusion criteria: (1) antibody testing of cerebrospinal fluid (CSF) and/or serum was positive for LGI1 antibodies or GABAB receptor antibodies; (2) patients presenting clinical symptoms, such as memory impairments, seizures, and cognitive dysfunction; (3) PET and CT images were available.

Table 1 Clinical characteristics of patients
Full size table

Patients with seizures resulting from brain structural lesions (such as traumatic lesions, tumors, and stroke) or other diseases (such as severe hypo/hyperglycemia, malignant hypertension, or renal/hepatic failure) were excluded.

Antibody testing

In this study, all the patients underwent antibody testing. The LGI1 antibody and GABAB receptor antibody in the CSF or serum were tested using cell-based assays and immunohistochemistry performed in the Laboratory of Neurological Immunology of Peking Union Medical College Hospital.

Image acquisition and preprocessing

To acquire PET and CT images, all patients underwent a 18F-FDG PET/CT scan. Firstly, each patient was required to fast for at least six hours. Secondly, 18F-FDG (0.10–0.15 mCi/kg) was intravenously injected after a normal blood glucose level was confirmed. Thirdly, the patients rested for 30 min with their eyes open in a dark room. Brain PET/CT images were obtained using a GE Discovery 690 scanner. The acquisition parameters for the PET images were as follows: matrix = 192 \(\times\) 192 pixels, voxel size = 1.5625 \(\times\) 1.5625 \(\times\) 3.2700 mm3, axial slides = 47.

Statistical parametric mapping software (SPM12; Wellcome Trust Center for Neuroimaging, London, UK) was used to preprocess all images. Firstly, for each patient, co-registration was performed between the CT and PET images. Secondly, a spatial normalization was performed from the co-registered CT images to the Montreal Neurological Institute (MNI) template using the Clinical Toolbox, which is an extension of SPM12 (https://www.nitrc.org/projects/clinicaltbx/) [27]. Thirdly, the spatial transformation of CT normalization was applied to PET, by which the PET images were adjusted to match the MNI template; then, the resolution of the PET images was changed to 2 × 2 × 2 mm3. Fourthly, a 6-mm isotropic full-width-half-maximum was used to smooth the normalized PET images. Fifthly, for each PET image, the mean value of the intensities across the highest 20% of voxels of the corresponding PET image [28] was used to normalize the smoothed PET image, by which the intensity of each voxel of the PET image was divided. Sixthly, the gray matter of the PET image was retained and used to extract image slices.

Image slices extraction and augmentation

Multiple studies have shown that the MTL and BG metabolism is abnormal in patients with LGI1 antibody encephalitis [13,14,15] and those with GABAB receptor antibody encephalitis [16,17,18]. Based on the Human Brainnetome Atlas [29], there are 30 axial image slices containing the MTL or BG. One of these axial image slices was excluded because in this slice, only one voxel belonged to the MTL and no voxels belonged to the BG. Thus, as Fig. 1 shows, 29 axial image slices were extracted from the preprocessed PET image of each patient. Because the number of patients with GABAB receptor antibody encephalitis was relatively small, vertical and horizontal flips were used to augment the original image slices of all patients with GABAB receptor antibody encephalitis. As Fig. 2(a) shows, for GABAB receptor antibody encephalitis, four types of augmentation were performed for each original image slice: maintaining the original image, vertical flip, horizontal flip, and a combination of vertical and horizontal flips. Thus, the number of image slices with GABAB receptor antibody encephalitis was increased to four times. To maintain the consistency of the augmentation operation between LGI1 and GABAB receptor antibody encephalitis, four types of augmentation were applied to the original image slices of all patients with LGI1 antibody encephalitis. As Fig. 2(b) shows, for LGI1 antibody encephalitis, the image slices from bottom to top sequentially underwent one of four types of augmentation: maintaining the original image, vertical flip, horizontal flip, and a combination of vertical and horizontal flips. The augmented image slices were used to replace the original image slices. Therefore, the number of image slices with LGI1 antibody encephalitis remained unchanged. After augmentation, 3828 image slices were produced.

Fig. 1
figure 1

An example of axial image slices extraction. For each patient, 29 axial image slices were extracted from each preprocessed PET image. The left image was a brain PET image in sagittal view. The right images were the examples of the extracted axial image slices. The Z values in the right images indicate the MNI coordinates of axial image slices

Full size image
Fig. 2
figure 2

Illustrations of image slices augmentation. a Image augmentation for the GABAB receptor antibody encephalitis. Four types of augmentation were performed on each original image slice, namely, maintaining the original image, vertical flip, horizontal flip, and a combination of vertical and horizontal flips; b Image augmentation for the LGI1 antibody encephalitis. One of four types of augmentation was performed on the original image slices from bottom to top sequentially, namely, maintaining the original image, vertical flip, horizontal flip, and a combination of vertical and horizontal flips. For (a) and (b), the images in top row were original image slices and the images in bottom row were augmented image slices. The Z values in the image slices indicate the MNI coordinates of axial image slices

Full size image

CNN classification

In this study, 3828 image slices were used to construct the ResNet18 [30], VGG16 [31], and ResNet50 [30] models. The architectures of the ResNet18, VGG16, and ResNet50 models are shown (Fig. 3). For each CNN model, the number of input channels in the first convolution layer was modified because the image slice was a gray image with only one channel. To match these CNN models in PyTorch (https://pytorch.org/vision/stable/models.html), a zero-padding layer was added before the first convolution layer of each CNN model, so that the size of the image fed into the first convolution layer was 224 \(\times\) 224. Because the discrimination between LGI1 and GABAB receptor antibody encephalitis was a binary classification task, the output dimensions of the fully connected layer were set to two.

Fig. 3
figure 3

Architecture of the ResNet18 (a), VGG16 (b) and ResNet50 (c). For each of the CNN models, a zero-padding layer was added before the first convolution layer, so that the size of the image fed into the first convolution layer was 224 × 224. The number of the input channel in the first convolution layer was set to one. The output dimension of the fully connected layer was set to two. Conv: Convolution layer; ReLU: Rectified linear unit

Full size image

Given that the number of patients was relatively small, each CNN model was evaluated using leave-one-out cross-validation (LOOCV) at the patient level. As Fig. 4 shows, in each fold of LOOCV, the PET image slices of one patient were used as testing samples (Fig. 4, right), and those of the other 80 patients were used as training samples (Fig. 4, left). This study included 81 patients. Thus, this LOOCV fold was repeated 81 times, with each patient in turn used as the testing cohort and the other 80 patients used as the training cohort. In each LOOCV fold, to reduce overfitting and select the best model, the patients in the training cohort were divided into a training dataset (n = 56) and a validation dataset (n = 24) in a ratio of 7:3. The image slices of 56 patients in the training dataset were used to train the CNN model, whereas those of 24 patients in the validation dataset were used to select the CNN model with the best performance. Finally, the image slices from one patient in the testing cohort were used to test the selected CNN model.

Fig. 4
figure 4

Training and testing of one-fold of LOOCV for the ResNet18, VGG16 and ResNet50 models. In each LOOCV fold, the PET image slices of a patient were used as testing samples (right) and those of the other 80 patients were used as training samples (left)

Full size image

The ResNet18, VGG16, and ResNet50 models were trained and tested using PyTorch on a Windows computer system. The batch size and the number of epochs were set to 16 and 100, respectively. For ResNet18, the initial learning rate was set to 0.01. The learning rate was updated every five epochs. The new learning rate was calculated by dividing the old learning rate by 10. For VGG16 and ResNet50, the initial learning rate was set as 0.001. The learning rate was updated every 10 epochs. The new learning rate was calculated by dividing the old learning rate by 10. A stochastic gradient descent was used to optimize the model with a momentum of 0.9.

Performance evaluation at slice level

The number of image slices with GABAB receptor antibody encephalitis detected as GABAB receptor antibody encephalitis was referred to as true positive (TP). The number of image slices with LGI1 antibody encephalitis detected as GABAB receptor antibody encephalitis was referred to as false positive (FP). The number of image slices with LGI1 antibody encephalitis detected as LGI1 antibody encephalitis was referred to as true negative (TN). The number of image slices with GABAB receptor antibody encephalitis detected as LGI1 antibody encephalitis was referred to as false negative (FN).

A total of 81 patients were included. Therefore, the LOOCV consisted of 81 folds. The \({TP}_{i}\), \({FP}_{i}\), \({TN}_{i}\) and \({FN}_{i}\) were the TP, FP, TN and FN of the i-th fold of the LOOCV, respectively. i (i = 1, 2, 3 … 81) represented the i-th fold of LOOCV.

Therefore, accuracy was calculated by Eq. 1

$$Accuracy= \frac{\sum_{i=1}^{81}({TN}_{i} + {TP}_{i})}{\sum_{i=1}^{81}({TN}_{i} + {TP}_{i}+ {FN}_{i} + {FP}_{i})}\times 100\%$$
(1)

sensitivity was calculated by Eq. 2

$$Sensitivity = \frac{\sum_{i=1}^{81}{TP}_{i}}{\sum_{i=1}^{81}({TP}_{i}+ {FN}_{i})}\times 100\%$$
(2)

specificity was calculated by Eq. 3

$$Specificity= \frac{\sum_{i=1}^{81}{TN}_{i}}{\sum_{i=1}^{81}({TN}_{i} + {FP}_{i})}\times 100\%$$
(3)

In addition, the receiver operating characteristic (ROC) curve was plotted with 1-specificity and sensitivity on the x- and y-axis, respectively. The area under the ROC curve (AUC) was calculated to assess the performance of the CNN models at the slice level. In this study, the Delong test was used to compare the ROC curves at the slice level between ResNet18 and VGG16, as well as between ResNet18 and ResNet50.

Performance evaluation at patient level

As Fig. 5 shows, a patient-level diagnosis strategy was employed to evaluate the model performance at the patient level. In each LOOCV fold, the image slices of a patient were used as testing samples. If the number of image slices classified as LGI1 antibody encephalitis was larger than that of image slices classified as GABAB receptor antibody encephalitis, the patient was classified as LGI1 antibody encephalitis; otherwise, it was classified as GABAB receptor antibody encephalitis (Fig. 5). After all the LOOCV loops, the prediction results were generated for all patients. Thus, the accuracy was calculated by dividing the number of correct patient predictions by the total number of patients. Sensitivity was calculated by dividing the number of correct predictions in patients with GABAB receptor antibody encephalitis by the total number of patients with GABAB receptor antibody encephalitis. Specificity was calculated by dividing the number of correct predictions in patients with LGI1 antibody encephalitis by the total number of patients with LGI1 antibody encephalitis. In addition, the ROC curve of the patient level was plotted with 1-specificity and sensitivity of the patient level on the x- and y-axis, respectively. The AUC at the patient level was generated to assess the performance of the CNN model at patient level. In this study, the Delong test was used to compare the ROC curves at the patient level between ResNet18 and VGG16, as well as between ResNet18 and ResNet50.

Fig. 5
figure 5

Patient level diagnosis strategy. For a patient, if the number of image slices detected as LGI1 antibody encephalitis (i.e., LGI1_num) was more than that of image slices detected as GABAB receptor antibody encephalitis (i.e., GABAB_num), the patient was detected as LGI1 antibody encephalitis, otherwise detected as GABAB receptor antibody encephalitis. A red rectangle indicated that an image slice was detected as GABAB receptor antibody encephalitis. A green rectangle indicated that an image slice was detected as LGI1 antibody encephalitis

Full size image

Visual explanation of model using gradient-weighted class activation mapping

The best CNN model was selected based on the AUC. Gradient-weighted class activation mapping (Grad-CAM) was used to identify the regions that played important roles in the best CNN model [32]. The gradient of the output of the last fully connected layer with respect to the output (i.e., feature maps) of the final convolution layer was first calculated. Then, the feature maps were multiplied by the average gradient of the corresponding channels. Finally, the summation of all channels of the feature maps was activated using a rectified linear unit function to obtain a heatmap. Because LOOCV was applied, the final heatmap of each image slice was generated from the average of the heatmaps of the image slices across all loops. In this study, the output of the last convolution layer of the best CNN model was employed as the final feature map.

Results

Patient demographics

Table 1 summarizes the patient demographics. In total, 81 patients were enrolled in this study. Among these 81 patients, 64 patients with LGI1 antibody encephalitis (58.27 ± 12.62 years, 44 males) and 17 patients with GABAB receptor antibody encephalitis (52.18 ± 12.19 years, 12 males) were verified using antibody testing. However, the weight and height of one patient with LGI1 antibody encephalitis were unknown. Thus, the weight and height of the remaining 63 patients with LGI1 antibody encephalitis were used for statistical analysis. None of the age, gender, weight, and height of patients with LGI1 antibody encephalitis was significantly different from that of patients with GABAB receptor antibody encephalitis with the p values of 0.08, 0.88, 0.91, and 0.80, respectively.

Model performance at slice level and patient level

Table 2 summarizes the performance of ResNet18, VGG16, and ResNet50 for the classification between image slices with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis. Figure 6(a) shows the ROC curves of these models at the slice level. As Table 2 indicates, ResNet18 outperformed VGG16 and ResNet50 at the slice level (p < 0.0001). Specifically, the AUC, accuracy, sensitivity, and specificity were 0.86, 80.28%, 73.28%, and 87.72% for ResNet18; 0.67, 62.77%, 77.43%, and 47.20% for VGG16; and 0.74, 67.40%, 52.23%, and 83.51% for ResNet50.

Table 2 The classification results of ResNet18, VGG16 and ResNet50 at slice level
Full size table
Fig. 6
figure 6

The performance of ResNet18, VGG16 and ResNet50 at slice level (a) and patient level (b). For the slice level, the sensitivity and specificity refer to the ratio of successfully identifying the image slices with GABAB receptor antibody encephalitis and that successfully identifying the image slices with LGI1 antibody encephalitis, respectively. For the patient level, the sensitivity and specificity refer to the ratio of successfully identifying the patients with GABAB receptor antibody encephalitis and that successfully identifying the patients with LGI1 antibody encephalitis, respectively

Full size image

To evaluate the performance of these network models at the patient level, a decision strategy was employed (Fig. 5), which successfully distinguished between patients with GABAB receptor antibody encephalitis and those with LGI1 antibody encephalitis. Table 3 summarizes the performance of ResNet18, VGG16, and ResNet50 for the classification between patients with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis, and Fig. 6 (b) shows the ROC curves of these models at the patient level. As Table 3 indicates, ResNet18 outperformed VGG16 and ResNet50 at the patient level (p < 0.01). Specifically, the AUC, accuracy, sensitivity, and specificity were 0.98, 96.30%, 94.12%, and 96.88% for ResNet18; 0.73, 55.56%, 88.24%, and 46.88% for VGG16; and 0.86, 86.42%, 52.94%, and 95.31% for ResNet50, respectively.

Table 3 The classification results of ResNet18, VGG16 and ResNet50 at patient level
Full size table

The visual explanation for the model using Grad-CAM

Based on the AUC values, ResNet18 outperformed VGG16 and ResNet50 at the slice and patient levels. In this study, the ResNet18 model was interpreted using Grad-CAM. In Fig. 7, the hot color of a region indicated that the model focused on this region to discriminate between LGI1 and GABAB receptor antibody encephalitis. As Fig. 7 shows, the hot regions overlapped in the majority of the MTL and BG regions, suggesting that the metabolic differences reflected by these two regions might play a more important role in discriminating between LGI1 and GABAB receptor antibody encephalitis.

Fig. 7
figure 7

Visual explanation of model using Grad-CAM. The final heatmap of each image slice was generated from the average of the heatmaps of the image slices across all loops. The hot color overlaps on the MTL and BG. The intensity of the hot color indicates the degree with which the model focused on the corresponding region for the discrimination between LGI1 and GABAB receptor antibody encephalitis. The Z values in the image slices indicated the MNI coordinates of axial slices

Full size image

Discussion

In this study, ResNet18, VGG16, and ResNet50 models were used to discriminate between LGI1 and GABAB receptor antibody encephalitis. The ResNet18 model achieved the best performance at both slice and patient levels. This study demonstrated that the ResNet18 model could be a prospective approach for discriminating between LGI1 and GABAB receptor antibody encephalitis.

The convolution layer of the CNN models extracted complex and abstract features using a convolution operation between the convolution kernel and the input image. As the number of convolution layers increased, the extracted metabolic features were continuously enhanced and abstracted, which was helpful for identifying subtle changes in medical images. However, as the number of convolution layers in the CNN model increased, the number of parameters increased, requiring more samples to train the corresponding CNN model. Although the number of samples was increased at the slice level, it might not be sufficient to train the ResNet50 model with more parameters than ResNet18. This might be one of the potential explanations for the inferior performance of ResNet50 compared with that of ResNet18. In addition, different from the VGG16, the ResNet18 model employed a “skip connection” (i.e., residual block) to speed up the model training process and improve the accuracy of the classification. A “skip connection” could add features extracted from the previous residual block to the next residual block, preserving as many effective features as possible to discriminate between LGI1 and GABAB receptor antibody encephalitis. Therefore, compared to VGG16, the ResNet18 model achieved better classification performance.

In this study, one of the advantages of using image slices was that the number of samples used to train the models increased. In addition, the 2D ResNet18 model had fewer parameters than the 3D ResNet18 model. Therefore, given the relatively small number of patients, the 2D ResNet18 model with 2D image slices as the input images were trained more easily than the 3D ResNet18 model with 3D images. Therefore, this study employed axial image slices to construct a 2D ResNet18 model to discriminate between LGI1 and GABAB receptor antibody encephalitis. The present study showed that the method using axial image slices achieved a good performance in the classification between patients with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis.

Based on the classification results of the ResNet18 model, it was found that the heatmap generated by Grad-CAM included the MTL and BG, indicating that this model focused on the MTL and BG to discriminate between LGI1 and GABAB receptor antibody encephalitis. Multiple studies have revealed that the MTL and BG are common abnormal metabolism regions for LGI1 [13,14,15] and GABAB receptor antibody encephalitis [16,17,18], consistent with the findings of this study. Previous studies have attempted to explore the characteristics of PET images to aid in differentiating ALE subtypes. Wegner et al. [33] explored the different metabolic patterns of LGI1 antibody encephalitis from anti-NMDAR encephalitis and found that the BG was hypermetabolic in LGI1 antibody encephalitis. Vedeler and Storstein [34] reported that ALE predominantly affected the MTL, in which hypermetabolism could be detected using FDG-PET. In addition, another study applied a semi-quantitative analysis method for the MTL and BG to increase the detection sensitivity for patients with AE, including patients with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis [20]. In this study [20], compared with healthy participants, the metabolism of both the MTL and BG was abnormal in patients with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis. This evidence implied that the metabolic pattern was similar for LGI1 and GABAB receptor antibody encephalitis. Thus, it was difficult to discriminate between LGI1 and GABAB receptor antibody encephalitis by the visual assessment of PET images. However, the ResNet18 model could identify subtle differences in the MTL and BG in the PET images.

Notably, the heatmap generated by Grad-CAM did not perfectly focus on the MTL and BG. ResNet18 could learn effective information using a convolution operation between the convolution kernel and image slices. Thus, the method in this study used the global effective information of each image slice to make a decision, highlighting the strength of DL and implying that the method of ‘looking’ medical images was different between DL algorithms and clinicians.

The relatively small number of samples was the main limitation of this study because the incidence of AE was relatively low [35, 36]. Further studies should include more patients with LGI1 antibody encephalitis and those with GABAB receptor antibody encephalitis, particularly prospective cases, to enhance the performance of the DL model. In addition, further studies should focus on identifying the other subtypes of AE.

Conclusions

In conclusion, the ResNet18 model was a potential approach for discriminating between LGI1 antibody encephalitis and GABAB receptor antibody encephalitis. Metabolism in the MTL and BG was important for discriminating between LGI1 and GABAB receptor antibody encephalitis.

Availability of data and materials

The original imaging and clinical data are not publicly available, because they contain private patient health information. The result data that support the findings of the present study are available on reasonable requests.

Abbreviations

LGI1:

Leucine-rich glioma-inactivated 1

GABAB:

Gamma-aminobutyric acid B

MTL:

Medial temporal lobe

BG:

Basal ganglia

Grad-CAM:

Gradient-weighted class activation mapping

AE:

Autoimmune encephalitis

ALE:

Autoimmune limbic encephalitis

MRI:

Magnetic resonance imaging

PET:

Positron emission tomography

DL:

Deep learning

ML:

Machine learning

CNN:

Convolutional neural network

CSF:

Cerebrospinal fluid

MNI:

Montreal Neurological Institute

LOOCV:

Leave-one-out cross-validation

TP:

True positive

FP:

False positive

TN:

True negative

FN:

False negative

AUC:

Area under the curve

ROC:

Receiver operating characteristic

Conv:

Convolution layer

ReLU:

Rectified linear unit

References

  1. Lancaster E, Dalmau J (2012) Neuronal autoantigens--pathogenesis, associated disorders and antibody testing. Nat Rev Neurol 8(7):380-390. https://doi.org/10.1038/nrneurol.2012.99

  2. Seery N, Butzkueven H, O’Brien TJ, Monif M (2022) Rare antibody-mediated and seronegative autoimmune encephalitis: An update. Autoimmun Rev 21(7):103118. https://doi.org/10.1016/j.autrev.2022.103118

    Article  Google Scholar 

  3. Budhram A, Leung A, Nicolle MW, Burneo JG (2019) Diagnosing autoimmune limbic encephalitis. CMAJ 191(19):E529-E534. https://doi.org/10.1503/cmaj.181548

    Article  Google Scholar 

  4. Heine J, Prüss H, Bartsch T, Ploner CJ, Paul F, Finke C (2015) Imaging of autoimmune encephalitis--Relevance for clinical practice and hippocampal function. Neuroscience 309:68-83. https://doi.org/10.1016/j.neuroscience.2015.05.037

  5. Graus F, Titulaer MJ, Balu R, Benseler S, Bien CG, Cellucci T et al (2016) A clinical approach to diagnosis of autoimmune encephalitis. Lancet Neurol 15(4):391-404. https://doi.org/10.1016/S1474-4422(15)00401-9

    Article  Google Scholar 

  6. Kalemkerian GP, Akerley W, Bogner P, Borghaei H, Chow LQ, Downey RJ et al (2013) Small cell lung cancer. J Natl Compr Canc Netw 11(1):78-98. https://doi.org/10.6004/jnccn.2013.0011

    Article  Google Scholar 

  7. Torre LA, Siegel RL, Jemal A (2016) Lung cancer statistics. Adv Exp Med Biol 893:1-19. https://doi.org/10.1007/978-3-319-24223-1_1

    Article  Google Scholar 

  8. Ances BM, Vitaliani R, Taylor RA, Liebeskind DS, Voloschin A, Houghton DJ et al (2005) Treatment-responsive limbic encephalitis identified by neuropil antibodies: MRI and PET correlates. Brain 128(8):1764-1777. https://doi.org/10.1093/brain/awh526

    Article  Google Scholar 

  9. Vincent A, Buckley C, Schott JM, Baker I, Dewar BK, Detert N et al (2004) Potassium channel antibody-associated encephalopathy: a potentially immunotherapy-responsive form of limbic encephalitis. Brain 127(3):701-712. https://doi.org/10.1093/brain/awh077

    Article  Google Scholar 

  10. Solnes LB, Jones KM, Rowe SP, Pattanayak P, Nalluri A, Venkatesan A et al (2017) Diagnostic value of 18F-FDG PET/CT versus MRI in the setting of antibody-specific autoimmune encephalitis. J Nucl Med 58(8):1307-1313. https://doi.org/10.2967/jnumed.116.184333

    Article  Google Scholar 

  11. Shin YW, Lee ST, Shin JW, Moon J, Lim JA, Byun JI et al (2013) VGKC-complex/LGI1-antibody encephalitis: clinical manifestations and response to immunotherapy. J Neuroimmunol 265(1-2):75-81. https://doi.org/10.1016/j.jneuroim.2013.10.005

  12. Kim TJ, Lee ST, Shin JW, Moon J, Lim JA, Byun JI et al (2014) Clinical manifestations and outcomes of the treatment of patients with GABAB encephalitis. J Neuroimmunol 270(1-2):45-50. https://doi.org/10.1016/j.jneuroim.2014.02.011

  13. Shan W, Liu X, Wang Q (2019) Teaching NeuroImages: 18F-FDG-PET/SPM analysis in 3 different stages from a patient with LGI-1 autoimmune encephalitis. Neurology 93(20):e1917-e1918. https://doi.org/10.1212/WNL.0000000000008473

    Article  Google Scholar 

  14. Chiriboga ASL, Siegel JL, Tatum WO, Shih JJ, Flanagan EP (2017) Striking basal ganglia imaging abnormalities in LGI1 ab faciobrachial dystonic seizures. Neurol Neuroimmunol Neuroinflamm 4(3):e336. https://doi.org/10.1212/NXI.0000000000000336

    Article  Google Scholar 

  15. Kunze A, Drescher R, Kaiser K, Freesmeyer M, Witte OW, Axer H (2014) Serial FDG PET/CT in autoimmune encephalitis with faciobrachial dystonic seizures. Clin Nucl Med 39(10):e436-e438. https://doi.org/10.1097/RLU.0000000000000372

    Article  Google Scholar 

  16. Su MG, Xu DK, Tian R (2015) 18F-FDG PET/CT and MRI findings in a patient with anti-GABAB receptor encephalitis. Clin Nucl Med 40(6):515-517. https://doi.org/10.1097/rlu.0000000000000676

    Article  Google Scholar 

  17. Zhu F, Shan W, Lv RJ, Li ZM, Wang Q (2020) Clinical characteristics of Anti-GABA-B receptor encephalitis. Front Neurol 11:403. https://doi.org/10.3389/fneur.2020.00403

    Article  Google Scholar 

  18. Liu X, Yu TT, Zhao XB, Li GF, Lv RJ, Ai L et al (2022) 18F-fluorodeoxy-glucose positron emission tomography pattern and prognostic predictors in patients with anti-GABAB receptor encephalitis. CNS Neurosci Ther 28(2):269-278. https://doi.org/10.1111/cns.13767

    Article  Google Scholar 

  19. Le WT, Maleki F, Romero FP, Forghani R, Kadoury S (2020) Overview of machine learning: Part 2: Deep learning for medical image analysis. Neuroimaging Clin N Am 30(4):417-431. https://doi.org/10.1016/j.nic.2020.06.003

    Article  Google Scholar 

  20. Lv RJ, Pan J, Zhou GF, Wang Q, Shao XQ, Zhao XB et al (2019) Semi-quantitative FDG-PET analysis increases the sensitivity compared with visual analysis in the diagnosis of autoimmune encephalitis. Front Neurol 10:576. https://doi.org/10.3389/fneur.2019.00576

    Article  Google Scholar 

  21. Currie G, Hawk KE, Rohren E, Vial A, Klein R (2019) Machine learning and deep learning in medical imaging: Intelligent imaging. J Med Imaging Radiat Sci 50(4):477-487. https://doi.org/10.1016/j.jmir.2019.09.005

    Article  Google Scholar 

  22. Peng J, Kang S, Ning ZY, Deng HX, Shen JX, Xu YK et al (2020) Residual convolutional neural network for predicting response of transarterial chemoembolization in hepatocellular carcinoma from CT imaging. Eur Radiol 30(1):413-424. https://doi.org/10.1007/s00330-019-06318-1

    Article  Google Scholar 

  23. Yin S, Peng QM, Li HM, Zhang ZQ, You XG, Fischer K et al (2020) Automatic kidney segmentation in ultrasound images using subsequent boundary distance regression and pixelwise classification networks. Med Image Anal 60:101602. https://doi.org/10.1016/j.media.2019.101602

    Article  Google Scholar 

  24. de Vos BD, Berendsen FF, Viergever MA, Sokooti H, Staring M, Išgum I (2019) A deep learning framework for unsupervised affine and deformable image registration. Med Image Anal 52:128-143. https://doi.org/10.1016/j.media.2018.11.010

    Article  Google Scholar 

  25. Ding YM, Sohn JH, Kawczynski MG, Trivedi H, Harnish R, Jenkins NW et al (2019) A deep learning model to predict a diagnosis of alzheimer disease by Using 18F-FDG PET of the brain. Radiology 290(2):456-464. https://doi.org/10.1148/radiol.2018180958

    Article  Google Scholar 

  26. Shen T, Jiang JH, Lin W, Ge JJ, Wu P, Zhou YJ et al (2019) Use of overlapping group LASSO sparse deep belief network to discriminate parkinson's disease and normal control. Front Neurosci 13:396. https://doi.org/10.3389/fnins.2019.00396

    Article  Google Scholar 

  27. Rorden C, Bonilha L, Fridriksson J, Bender B, Karnath HO (2012) Age-specific CT and MRI templates for spatial normalization. NeuroImage 61(4):957-965. https://doi.org/10.1016/j.neuroimage.2012.03.020

    Article  Google Scholar 

  28. Pagani M, Öberg J, De Carli F, Calvo A, Moglia C, Canosa A et al (2016) Metabolic spatial connectivity in amyotrophic lateral sclerosis as revealed by independent component analysis. Hum Brain Mapp 37(3):942-953. https://doi.org/10.1002/hbm.23078

    Article  Google Scholar 

  29. Fan LZ, Li H, Zhuo JJ, Zhang Y, Wang JJ, Chen LF et al (2016) The human brainnetome atlas: A new brain atlas based on connectional architecture. Cereb Cortex 26(8):3508-3526. https://doi.org/10.1093/cercor/bhw157

    Article  Google Scholar 

  30. He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition. Las Vegas, IEEE https://doi.org/10.1109/Cvpr.2016.90

  31. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  32. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-CAM: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the 2017 IEEE international conference on computer vision. Venice, IEEE https://doi.org/10.1109/Iccv.2017.74

  33. Wegner F, Wilke F, Raab P, Tayeb SB, Boeck AL, Haense C et al (2014) Anti-leucine rich glioma inactivated 1 protein and anti-N-methyl-D-aspartate receptor encephalitis show distinct patterns of brain glucose metabolism in 18F-fluoro-2-deoxy-d-glucose positron emission tomography. BMC Neurol 14:136. https://doi.org/10.1186/1471-2377-14-136

    Article  Google Scholar 

  34. Vedeler CA, Storstein A (2009) Autoimmune limbic encephalitis. Acta Neurol Scand 120(s189):63-67. https://doi.org/10.1111/j.1600-0404.2009.01204.x

    Article  Google Scholar 

  35. Dubey D, Pittock SJ, Kelly CR, McKeon A, Lopez-Chiriboga AS, Lennon VA et al (2018) Autoimmune encephalitis epidemiology and a comparison to infectious encephalitis. Ann Neurol 83(1):166-177. https://doi.org/10.1002/ana.25131

    Article  Google Scholar 

  36. Dalmau J, Graus F (2018) Antibody-mediated encephalitis. N Engl J Med 378(9):840-851. https://doi.org/10.1056/NEJMra1708712

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was supported by grants from the Beijing Natural Science Foundation-Haidian Original Innovation Joint Foundation, No. L222033; the National Key Research and Development Program of China “Common Disease Prevention and Control Research” Key Project, No. 2022YFC2503800; the National Natural Science Foundation of China, No. 81771143; the Beijing Natural Science Foundation, No. 7192054; and the National Key Research and Development Program of China, No. 2018YFC1315201.

Author information

Author notes

  1. Jian Pan and Ruijuan Lv share the role of first author.

Authors and Affiliations

  1. School of Computer and Information Technology, Beijing Jiaotong University, Beijing, 100044, China

    Jian Pan & Jiangang Liu

  2. Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, China National Clinical Research Center for Neurological Diseases, Beijing, 100070, China

    Ruijuan Lv & Qun Wang

  3. Department of Nuclear Medicine, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China

    Xiaobin Zhao & Lin Ai

  4. School of Engineering Medicine, Beihang University, Beijing, 100191, China

    Jiangang Liu

  5. Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People’s Republic of China, Beijing, 100191, China

    Jiangang Liu

Authors
  1. Jian Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruijuan Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaobin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiangang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lin Ai
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JP and JL contributed to the conception and design of the study; JP contributed to analysis of data; RL, QW and XZ contributed to acquisition of data; JP and JL drafted the manuscript; JL, RL, XZ and LA revised the manuscript; JL and LA supervised the study. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Jiangang Liu or Lin Ai.

Ethics declarations

Competing interests

All authors in the present study declared that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, J., Lv, R., Wang, Q. et al. Discrimination between leucine-rich glioma-inactivated 1 antibody encephalitis and gamma-aminobutyric acid B receptor antibody encephalitis based on ResNet18. Vis. Comput. Ind. Biomed. Art 6, 17 (2023). https://doi.org/10.1186/s42492-023-00144-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s42492-023-00144-5

Keywords