Coder Social home page Coder Social logo

sauravmishra1710 / malaria-detection-using-deep-learning-techniques Goto Github PK

View Code? Open in Web Editor NEW
9.0 1.0 6.0 301.61 MB

Malaria Parasite Detection using Efficient Neural Ensembles. Malaria, a life threatening disease caused by the bite of the Anopheles mosquito infected with the parasite, has been a major burden towards healthcare for years leading to approximately 400,000 deaths globally every year. This study aims to build an efficient system by applying ensemble techniques based on deep learning to automate the detection of the parasite using whole slide images of thin blood smears.

Home Page: https://doi.org/10.35882/jeeemi.v3i3.2

License: Creative Commons Attribution Share Alike 4.0 International

Python 0.50% Jupyter Notebook 99.50%
biomedical-image-processing digitalpathology snapshot-ensemble malaria-detection deep-learning neural-network wholeslide-imaging whole-slide-image explainable-ai interpretable-deep-learning

malaria-detection-using-deep-learning-techniques's Introduction

Malaria Parasite Detection using Efficient Neural Ensembles

PWC

This work is published as part of the Journal of Electronics, Electromedical Engineering, and Medical Informatics and can be accessed online at the Journal Page. Please cite the work if you find these codes useful for your research.

This work is an open-access and licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

CC BY-SA 4.0 CC BY-SA 4.0

LINK TO ABSTRACT: http://jeeemi.org/index.php/jeeemi/article/view/147
LINK TO FULL PDF: http://jeeemi.org/index.php/jeeemi/article/view/147/75

ABSTRACT

Malaria, a life threatening disease caused by the bite of the Anopheles mosquito infected with the parasite of genus Plasmodium, has persisted as a major burden towards mankind and healthcare for years leading to approximately 400,000 deaths globally every year. The traditional diagnosis process for malaria involves examining the blood smear slide under the microscope. This is a very time consuming process and also requires pathologists to be highly skilled for performing the analysis. Timely diagnosis, availability of robust diagnostic facilities, and skilled laboratory technicians are very much vital to bring down the high mortality rate.

This study aims to build an efficient system by applying ensemble techniques based on deep learning to automate the detection of the parasite using whole slide images of thin blood smears. A time efficient technique known as the Snapshot Ensemble (Huang et. al.,) will be used in this study. Snapshot Ensemble is a technique which at the cost of training one single neural network would yield multiple snapshots or weak learners that can later be combined to form one strong model. All the experimental models were evaluated against the following metrics - F1 score, Accuracy, Precision, Recall, Mathews Correlation Coefficient (MCC), Area Under the Receiver Operating Characteristics (AUC-ROC) and the Area under the Precision Recall curve (AUC-PR). The snapshot ensemble model created by combining the snapshots of the EfficientNet-B0 pre-trained model outperformed every other model achieving a f1 score - 99.37%, precision - 99.52% and recall - 99.23%. The results show the potential of model ensembles which combine the predictive power of multiple weak learners to create a single strong and efficient model that is better equipped to handle the real world data. Also, snapshot ensemble proved to be efficient with a limited training budget.

The GradCAM (Selvaraju et. al.,) experiment displayed the gradient activation maps of the last convolution layer to visually explicate where and what a model sees in an image to classify them into a particular class. The models in this study correctly activate the stained parasitic region of interest in the thin blood smear images. Such visuals make the model more transparent, explainable, and trustworthy which are very much essential for deploying AI based models in the healthcare network.

PROGRAMMING RESOURCES

All programming work in the study is done on a cloud based system with

  • CUDA enabled Nvidia Tesla K80 GPU, 4 core CPUs, 20 GB RAM.
  • Python 3.6 using the web-based Anaconda Jupyter environment.
  • The deep learning models are created using Keras library with Tensorflow 2.2 backend enabled with GPU acceleration.
  • All the image processing and computer vision tasks are carried out using the Open Source Computer Vision (OpenCV) library.

RESULTS

EFFICIENTNET-B0 SNAPSHOTS

The callback settings for cosine annealing was kept for 50 epochs and number of cycles set to 5. The snapshots were recorded each at the end of 10th, 20th, 30th, 40th and 50th epochs respectively. Each of the snapshot was evaluated on the test data and the results are summarized in the table 1 below.

Table 1 - Snapshots Test Evaluation:

Table 1 - Snapshots Test Evaluation

  • Ensemble 1 combined every snapshots [1, 2, 3, 4, 5]
  • Ensemble 2 combined snapshots [2, 3, 4, 5]
  • Ensemble 3 combined snapshot [3, 4, 5]
  • Ensemble 4 combined snapshot [3, 4]
  • Ensemble 5 combined snapshot [4, 5]

Five different combinations of the snapshots were tested to create the ensembled model in the following combination strategies. Each of the ensembled model was evaluated on the test data and the results are summarized in table 2 below.

Table 2 - Ensembles Test Evaluation:

Table 1 - Snapshots Test Evaluation

SUMMARY

  • Snapshot Ensemble, enables to create high performance ensembled models by training only a single neural network. This approach not only removes the need of high efficiency computational resources but also saves valuable amount of time required to train multiple large models to combine and create ensembles.

  • GradCAM experiment shows where exactly a model looks in the image to arrive at a decision. We see the model correctly activates the region around the parasite in the parasitized cells and utilizes it to differentiate from the unparasitized cells. Such visuals make the models more transparent, explainable, and trustworthy which are very muchnessential for deploying AI based models in the healthcare network.

Papers With Code

Link: https://paperswithcode.com/paper/malaria-parasite-detection-using-efficient

HOW TO CITE

If you find this work helpful for your study, please cite the paper as follows -

Mishra, S. 2021. Malaria Parasite Detection using Efficient Neural Ensembles. Journal of Electronics, Electromedical Engineering, and Medical Informatics. 3, 3 (Oct. 2021), 119-133. DOI:https://doi.org/10.35882/jeeemi.v3i3.2.

malaria-detection-using-deep-learning-techniques's People

Contributors

sauravmishra1710 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.