Doctor Robo

Doctor Robo is a web app where you can upload your chest x ray and It will tell whether your lungs have Covid 19, Pneumonia or are simply normal !

Comment 1

Note:

Before using project from GitHub please read the README.md file of repository

Idea Behind the project

The idea was to create a web app where patients can upload their x rays and then a model at the backend will check the x ray for different diseases! I also want to implement the model on twitter so people can just tag a twitter account along with their x ray image and then the twitter bot will check their X ray for different diseases and will return it's results in the reply section of the tweet!

What it does

Working on the idea I made a webapp (as described above) where people can upload their chest X ray images and the web app will check if the Lungs have Covid 19, Viral Pneumonia or are Normal. The model has an accuracy of 93.3% on test set! It's important to note that if the diseased lungs x ray images other then that of Covid 19 are passed to web app instead of predicting them Normal it predicts them either Covid or Pneumonia which can still give doctors or patients a clue that something is wrong in lungs! Moreover, we are still working on the weapp so, it will be able to classify other diseases in future.

Moreover, a twitter bot is also included in the github repository! Users can tag the twitter bot with a specific command currently @XrayBotML checkxray and an image of their chest x ray. The bot will then reply back with it's analysis of the x ray image report

How we built it

Following languages are used to build the webapp (frontend, backend,MLmodel and twitter bot):

  1. Python (Used for almost everything on backend)
  2. HTML (Frontend designing)
  3. CSS (Frontend designing)
  4. JavaScript (Very less used)

Following frameworks, python packages and technologies are used for the creation of webapp and twitter bot:

  1. Tensorflow
  2. InceptionV3
  3. Twitter API
  4. Tweepy (To manage twitter API)
  5. Bootstrao (for frontend designing)
  6. Django (For backend)
  7. SKlearn (for creating a model which predicts if person has covid or not based on symptoms)

Challenges we ran into

I ran into the following challenges

  1. ## Finding datasets

Yes, I had trouble finding datsets for creating model but at last I found one on kaggle.com. The dataset consisted of X ray images of patients with Covid 19, Pneumonia and Normal lungs! But, I am still in search of datasets for other deceases such as TB or Emphysema

  1. ## Imbalanced Dataset

Like almost all medical datasets the above dataset was imbalanced. But, I solved this problem by using techniques of "Oversampling" on Pneumonia x ray images and UnderSampling on Normal Images. I also took help from the keras's built in class_weight function. For weighting the classes I used statistics.

Learn more about the model in the CODE NOTEBOOK of the model in the github repository

Accomplishments that we're proud of

Actually, this model, webapp and TwitterBot is an accomplishment that I am really proud of!

What we learned

I learned and refined my skills in the following:

  1. Python
  2. Using django to create a backend
  3. Bootstrao designing
  4. Front End designing
  5. ML modeling
  6. Deaking with Imbalanced datasets

What's next for Doctor Robo

The complete project for Doctor Robo is available here. The report includes each and every detail of the project!

Feel free to collaborate on Github if you find our project useful and interesting

Built With

Share this project:

Updates