(IJIT-V7I2P7) :manish Gupta, Rachel Calvin, Bhavika Desai, Prof. Suvarna Aranjo
(IJIT-V7I2P7) :manish Gupta, Rachel Calvin, Bhavika Desai, Prof. Suvarna Aranjo
(IJIT-V7I2P7) :manish Gupta, Rachel Calvin, Bhavika Desai, Prof. Suvarna Aranjo
Manish Gupta [1], Rachel Calvin [2], Bhavika Desai [3], Prof. Suvarna Aranjo [4]
[1],[2],[3],[4]
Dept. of Information Technology Xavier’s Institute of Engineering, Mumbai Maharashtra - India
ABSTRACT
Chest disease have majorly affected man lives around the world.There are many chest disease such as pneumonia, asthma,
tuberculosis and many more lung diseases. If these diseases are not diagnosed in time they can turn deadly.Chest radiography
(chest X-ray)is a effective way of recognizing and the problem and cost effective at he same time. But due to lack of
professional radiologist the application of the method hasn’t reached it peak. In this paper, we will explore the possibility of
designing a computer aided diagnosis for chest X-rays using deep convolutional neural networks. Using a real-world dataset of
118055 chest X-rays with natural language diagnosis reports, we can train a multi-class classification model from images and
preform accurate diagnosis, without any prior domain knowledge. Chest X-ray (CXR)is commonly used for the diagnoses of
such lung diseases. Computeraided diagnosis (CAD)was developed for the radiologist to achieve the desired result in short
period of time.
Keyboard: - CAD, CXR, CNN, multi-label classification, problem transformation method, deep learning, image classification,
image feature extraction.
I. INTRODUCTION
classification which is called as the Convolutional neural
Medical X-rays are used to diagnose several disease in a short network in deep learning.This model provides the
period of time.Medical professionals use this technique to highest accuracy after training the dataset. This model
identify different fractures and abnormalities in different ares was introduced in 90’s for human visual perception of
of the body.This is because X rays are very effective and does recognizing things. The best known architecture in
not cause any harm to the body in any ways.Chest diseases Convolutional neural net is the LeNet architecture that
can be shown in CXR images in the form of cavitation, was used to analyze the zip codes, digits, etc. [3]. But
consolidations, infiltrates, and small broadly distributed due to it property of being data hungry researchers had to
nodules. By analyzing the X-ray’s the doctors can diagnose introduce more generalized methods in deep learning
different diseases such as effusion, pneumonia, bronchitis, [4].In multiclassification instances are introduced for the
infiltration, nodule, cardiomegaly, pneumothorax, fractures, training of the dataset by transforming problem into
and many others. In this work, we diagnose the lung diseases more single labels. The given paper introduces a model
at a much quicker pace than the radiologist. Chest X-Ray, is which will use multiclassification and deep learning
one of the most common types of radiology examination for technique for the detection of different chest
the diagnosis of lung diseases. diseases.The Ian concept is to change the multi-
However, radiologist involve the decision under uncertainty classification design into a single label concept as
Therefore, a clear output cannot be taken out[1]. Therefore, mentioned below. The following is achieved using a
Computer- Aided Diagnosis was developed to get the result publicly available dataset called NIH-Chest X-ray.
effectively with easy and in short amount of time.CAD
systems are not here to replace doctors rather help them get a II. KEY FEATURES
second opinion for the overall diagnoses. Over the past few • Recognize the disease of the chest by feeding
years we have been working on use of Computer-Aided the images to the machine learning model.
Diagnosis and Artificial Intelligence for classification of the • Machine learning model is flexible and can be
image and through the classification acquiring the accuracy . trained for any type of diseases and different
The first step towards classification is to extract the features kinds of chest diseases.
from the images which in turn will act as input to the second • Real-time images are provided to the app which
step for training[2]. The accuracy completely speedy on the in turn is integrated with Machine learning
training of the dataset.Therefore, we are using the best model model and output disease is predicted.
for the
• Information about each chest disease is available on 2019 I. Allaouzi, M. B. Ahmed: Novel Approach for
the app such as different term description related to Multi- Label CXR Classification of Common Thorax
chest or lung diseases. Diseases Problem Transformation Methods:
• Model which is built for detecting disease can be The main idea is to fit data to an algorithm by
integrated with any app because the model is converting the multi-label classification problem
converted to API and requests can be made to the into one or more binary/multi-class sub- problems, and
endpoint URL of the API. then combine their results to form the multi-label
• I prediction. Representative algorithms include Binary
t is hosted globally so anyone can access the API and Relevance [8], Random k-Labelsets [9] and Classifier
integrate it with the app. Chains [10].
Problem Adaptation Methods:
III. RELATED WORK The idea is to fit the well know techniques with the
multi-label classification model. The algorithms include
Using the publicly available dataset called ChestXray14 lazy learning techniques ML-kNN [11], an adaptation of
dataset many models have been introduced[19].In that we decision tree techniques ML-C4.5 [12], an adaptation of
have used three different CNN models and classified there kernel techniques RankSVM [13]. A novel approach
uses.[20]Present a two-staged model with recurrent neural called Ensemble methods [14] was developed on top of
network acting as a decoder. While [21]analyses is done these two approaches. It converts the problem of multi-
about which function is more suitable for the working of label classification into an ensemble of multi-label sub-
CNN model. The feasible works of ChesXNet [22] that tells problems. Representative algorithms include the
us about DenseNet-121 on the chest X-ray images, which has Random klabELsets method (RAkEL) [15], Ensemble
a modified last fully- connected layer and [23] that proposes Classifier chains (ECC) [16], and label space partitioning
a guided two-branch convolutional neural network for chest classifiers [17]. In order to find the most suitable
disease classification. The model consist of both the global approach for our case, we tried to make a comparison
and publicly evaluated model for the training and gives us the between the three above methods.
best result possible.
B. DATA PRE-PROCESSING
C. FEATURE EXTRACTION
The important part of the CXR is to get the features that
will help us classify the images into one or multiple
possible classes. We have used the DenseNet-121 model
is used as a feature extractor. The Dense Convolutional
Network (DenseNet) [8] is a new CNN architecture that
is highly competitive object recognition benchmark
tasks. The core idea of DenseNet is to connecting all the Figure 1: DenseNet with 5
layer and letting multiple information flow through it that
match with it. As shown in Figure 2, this introduces
L×(L+1) 2 connections in an L-layer network, instead of
just L, as in traditional architectures. A DenseNet is
followed by transition layers. Each unit packs two
convolutions, each preceded by Batch TABLE 1. The
DenseNet-121 architecture.Fixed unit vector is been
generated durning the process. The layers between these
dense blocks are transition layers which perform down-
sampling of the layers features passing the network. A
detailed explanation of DenseNet-121 architecture, the
DenseNet we used in this work, is shown in Table 1.
Motivated by the results obtained by DenseNet-121 on
ChestX-ray14 dataset [18], [19], we have trained the
DenseNet-121 model on our dataset, using initial weights Figure 2: Multi-label classification pipeline
obtained from the pre- trained network, on ImageNet,
which gives a good starting point against random VII. CONCLUSION
initialization of the weights.
In this paper, we propose a new approach that
combines the effectiveness of CNN for image feature
extraction and the power of supervised multi-label
classifiers in order to tackle the task of thorax diseases
detection on CXRs. The task has been carried out with a
pre-trained DenseNet-121 model as feature extractor and
different problem transformation methods. The
evaluation process was conducted using performance
metrics average AUC. The results showed that our
method achieved great results and outperformed current
state-of-the-art on ChestX-ray14 dataset. To further
substantiate the results of this study, several
improvements could be made, such as the use of an
attention mechanism to improve CNN’s work and train
our classifier on a more balanced data set to avoid the
problem of imbalance label distribution.
REFERENCES
1. A. Brady, R. Ó. Laoide, P. McCarthy, and R.
McDermott, ‘‘Discrepancy and error in radiology:
Concepts, causes and consequences,’’ Ulster Med. J.,
TABLE 1: The DenseNet-121 Architecture vol. 81, no. 1, pp. 3–9, Jan. 2012. [Online]. Available: