Inspiration
CovIt is made to remove the hurdles of people for getting correct information related to Covid-19 , booking vaccine appointment for covid-19, as there are so many websites with not so curated information it is difficult for people to understand, so CovIt fills the gap by enabling a 3d chatbot to interact and help people with personal touch.
What it does
CovIt is 3d bot doctor virtual assistant application, where a human bot named doctor dia helps the user to solve there covid-19 related queries by interacting via speech(voice) or simply by chat, the unique feature of the application is, it feels like doctor is in front of you, and you can share your problem with the him very easily, and bot doctor can also book a slot for vaccine for you, instead of filling form by typing, simply speak to bot(dia the docter) she will do it in a minute. it will be very helpful for the people of the india & world, due lack of availability of doctors, patients can directly consult to our AI Powered bot, and get there question clear.
How i built it
I have first divided the project in two parts Frontend Backend
In Frontend i have used blender to make 3d model , then integrated it with oculus lypsync sdk to make the facial movements of bot, and integrated the model in unity engine ,also i have made a easy to use UI to help people.
Authentication: For enabling user to signup easily & securely i have used Azure Playfab Authentication, and for detecting the location of the user city.
Storage: To store user query to improve the AI further, i am storing the data in .JSON separately.
All the query asked by user gets answered from IBM Watson Assistant where i have stored all information related to covid-19, also i have used Microsoft Azure Cognitive for text to speech and speech to text modules in unity to make the bot speck & recognize the voice.
Also user will be avail to query from whatsapp. for this i am using twilio.
Accomplishments that I am proud of
I have made a complete product that can be really helpful solving problems of people and it completes the goals of theme.
Log in or sign up for Devpost to join the conversation.