Inspiration

We came up with this idea because of the lockdown caused by the coronavirus pandemic people are confined to your homes and it's a bit risky visiting the hospitals as there are chances of getting infected. We all are facing problems because of coronavirus pandemic where people are in a state where anyone suffering from a disease is thought to be suffering from COVID19. Therefore we wanted to help people reduce this state of panic and thought of building a bot which will answer people’s questions regarding symptoms. That way people will gain knowledge of their disease.

What it does

RoboDoc is a messenger bot where people could chat with it and get their symptoms analysed using messages. Based on symptoms sent by user it analysis and most accurate diseases is diagnosed. At present we have added 21 common diseases we will be expanding it to 87 diseases our main objective was to lessen the panic caused by coronavirus pandemic. We have added analysis of Frontal chest x-ray for covid19 and analysis of mamograph for breast cancer detection.

Dataset

For COVID19 detection model using X-rays we used kaggle and github dataset accounting to total 1300 COVID19 and 1200 normal chest x-rays. For breast cancer we used kaggle dataset. For symptoms and disease we used a csv file for NLP training.

How we built it

We are using wit.ai for Natural Language Processing and based on symptoms mentioned by users we are predicting the disease and for detection of covid19 using chest x ray and breast cancer using mamograph we are using tensorflow.js models and javascript

Challenges we ran into

Training using wit.ai was difficult and between the event there were some changes made to wit.ai. Integrating tensorflow.js models with messenger webhook and integrating all of it into one single project was challenging.

We are trying to make our bot perfect and will research methods of implementation that could improve the accuracy of our bot. We will experiment with other architectures for training our model to improve efficiency. This can be achieved approximately in a time span of a month. After this is done we may look for funding and make it available to people.

Accomplishments that we're proud of

We are proud that we could build a chatbot which will help people to know whether they are covid positive or not. There is a messenger bot itself which detects covid using lungs x-rays and gives you an idea whether you have covid by symptoms is a proud thing for us. We were able to deploy a python trained model into javascript and deploy it on a server is an accomplishment to be proud of, as it was one of our major challenges. And Finally we are proud that our bot is working as it should. So basically we are proud that we overcame all the challenges and built an application.

What we learned

Deeper understanding of Facebook Messenger architecture and how wit.ai works. Training of NLP using wit.ai. Machine learning model creation, conversion to tensorflow.js and integrating it with messenger

What's next for RoboDoc

At present we have added 21 diseases we will be expanding it to 87 diseases for predictions using all symptoms.We are trying to make our bot accurate and as it is used more we will train it for more symptoms and diseases. We will research methods of implementation that could improve the accuracy of our bot. We will experiment with other architectures for training our model to improve efficiency. We will be including more medical models for diagnosis of more diseases using x-rays and MRI's.This can be achieved approximately in a time span of a month. After this is done we may look for funding and make it available to people.

Built With

Share this project:

Updates