Inspiration
The inspiration behind DocAI stems from the daily struggles that elderly people and individuals with mobility challenges face. Many elderly people have difficulty walking, holding objects, or interacting with traditional technology, especially when caregivers might be unavailable or busy. We wanted to provide an easy, hands-free way for them to get assistance, whether it’s understanding symptoms, receiving health advice, or simply learning more about their medical conditions. Our goal was to leverage voice technology to make healthcare more accessible and responsive for these individuals, allowing them to receive support without needing to physically interact with devices.
What it does
DocAI is an AI-powered, voice-enabled health assistant designed to help users easily access health-related support through hands-free interactions. The system listens to user symptoms, diagnoses potential conditions, and offers real-time, evidence-based treatment suggestions. It empowers users to understand their health concerns and take proactive steps toward managing their conditions, all through natural voice conversations. The AI is capable of providing users with tailored health advice based on their specific symptoms, medical history, and ongoing queries.
How we built it
The backend powered by Python, which serves as the core language for processing data, running machine learning algorithms, and driving the AI-driven health recommendation engine. This enables the system to accurately analyze symptoms and suggest personalized treatments based on up-to-date medical research. The backend also leverages Pinecone vector database to enhance the AI’s performanceTo bridge the backend and frontend, Flask is used to build robust APIs that handle data transfer and manage the interaction between the AI and the user interface. On the frontend, Next.js was chosen to create a fast, scalable, and responsive UI, ensuring that users have a seamless experience across various devices. For styling, Tailwind CSS was employed to design a clean, modern, and intuitive interface that prioritizes accessibility and ease of use, making it easy for users of all ages to navigate. The UI/UX design elements provided by ShadCN further enhance the overall user experience, combining both functionality and aesthetics to create an inviting environment. Additionally, LiveKit enables real-time, voice-enabled interactions, allowing users to engage in natural conversations with the AI and receive immediate, actionable feedback. This integration of voice technology ensures that DocAI provides an intuitive and responsive healthcare assistant for its users.
Challenges we ran into
One of the biggest challenges we faced was ensuring seamless, real-time voice interactions. Integrating LiveKit for voice capabilities presented difficulties with speech recognition accuracy and maintaining a smooth conversation flow, especially in environments with noise. Additionally, we needed to fine-tune the AI's ability to diagnose symptoms accurately and offer treatments that were both accurate and understandable to users with varying levels of health literacy
Accomplishments that we're proud of
We’re proud of the voice-enabled, real-time experience we've built, allowing users to get the healthcare advice they need through voice commands. HealthSphere is designed with accessibility in mind, and seeing it successfully help users navigate their health concerns without needing a caregiver or manual input is a significant achievement. Additionally, the AI's ability to analyze symptoms and suggest evidence-backed treatment options is something we’re incredibly proud of, as it leverages the latest research to provide real-time healthcare insights.
What we learned
Through this project, we learned a lot about integrating voice technologies into healthcare applications and overcoming the challenges that come with voice recognition in real-time. We also learned how crucial it is to design with accessibility in mind, especially when building tools for elderly users or people with mobility challenges. We discovered the importance of building a reliable and adaptive AI system that can continuously improve its responses, making sure that every user interaction is as relevant and accurate as possible
What's next for DocAI
We plan to integrate several new features that will enhance the user experience and provide even more personalized care. One key addition will be the ability to schedule appointments for the user. This feature will allow users to easily book consultations with healthcare providers directly through the platform, streamlining the process and ensuring that they don’t miss out on necessary medical care. Additionally, we will implement a reminder system to notify users to take their medication at the appropriate times, including details like dosage amounts. This will help users stay on track with their treatment plans and improve adherence to prescribed medications.
Another exciting feature will be post-appointment check-ups. After a specified time window following an appointment, the system will automatically reach out to the user to assess their recovery progress, check if they are experiencing any new symptoms, and offer further recommendations or guidance. Lastly, we plan to introduce the ability to automatically notify caregivers about a user’s current needs, whether it’s a medication reminder, an appointment, or any health concerns that require attention
Log in or sign up for Devpost to join the conversation.