Inspiration

Our primary motivation was to address the unique challenges faced by the accessibility community in managing medication routines. Many people with accessibility needs struggle with remembering medication schedules, dosage, and handling emergencies, leading to serious health consequences. We wanted to create a solution that not only offers timely reminders but also provides a supportive experience tailored to each user’s specific needs. This inspired us to leverage voice technology to build a smart, personalized assistant that can empower individuals to manage their medication more effectively and independently.

What it does

Echo Alert is a skill designed to provide personalized medication reminders and support for individuals with accessibility needs. It offers timely notifications for scheduled medications, provides dosage information, and guides users through emergencies using stored personal data from a dedicated Knowledge Base. The skill enables users to set up reminders easily, track their medication routines, and locate stored medications, all through simple voice commands. With an emphasis on user-friendly interactions, Echo Alert adapts responses based on individual preferences and requirements, making it a reliable companion for managing medication and health needs independently.

How we built it

We created Echo Alert by using Voiceflow to create an easy UI flow that gives medication reminders and assistance to those with accessibility issues. The development procedure included designing a RAG based user-friendly interface that allows users to establish tailored reminders and obtain medication information. To improve the user experience, we included crucial elements including medicine storage reminders, dosage information, and emergency help. Our approach stressed iterative design, which enabled us to refine interactions based on user feedback.

Challenges we ran into

During the development of our application, we faced several hurdles. One of the most fundamental was that we were completely understaffed, which meant we were constrained on working on multiple tasks at once. One of the reasons for a delay was that Voiceflow was down, so any attempt to utilize the majority of its capabilities did not work. We tried to maintain the ease of our skill, thereby ensuring that whether a user was quite adept at using most technological interfaces, our skill would still be reasonable and intuitive otherwise.

Accomplishments that we're proud of

We are happy to have developed a functional prototype of Echo Alert that effectively fulfills the needs of the accessibility community. Achieving seamless interactions and incorporating crucial functions such as medication reminders and emergency guidance are significant accomplishments. We also appreciate the favorable feedback we received during user testing, which demonstrated the app's ability to improve medication management and user assistance. Furthermore, we take pride in having fully mastered Voiceflow, a tool none of us had previously used, which has considerably improved our skill set and confidence in designing speech applications. Despite hurdles, we have improved our problem-solving abilities and resilience by working well as a small team.

What we learned

We began this project by understanding the difficulties faced by the accessibility community and exploring how AI could offer solutions and support. We learned about designing intuitive voice user interfaces (UI), making them not only functional but also user-friendly for individuals with varying levels of technological experience. We also delved into Retrieval-Augmented Generation (RAG) systems, exploring the best practices for handling Knowledge Bases in RAG frameworks. This included optimizing retrieval processes, structuring KBs effectively, and fine-tuning prompting techniques to deliver personalized, context-aware responses. Additionally, we gained insights into k-shot prompting, which enabled us to control and customize how outputs were generated, ensuring they were clear, supportive, and adapted to each user’s needs. This journey provided valuable lessons on combining AI technology with empathetic design to create accessible solutions that truly make a difference.

What's next for Echo Alert

  • Importing into Alexa Console: We plan to use this Voiceflow-designed flow and import it into the Alexa Developer Console to create a more personalized Alexa experience. This will enable seamless, voice-based assistance tailored to individual needs.
  • Expand Knowledge Base: We aim to enhance the Knowledge Base to include more health-related features, such as dietary suggestions, doctor appointment reminders, and tailored health tips, making it a more holistic healthcare assistant.
  • Multilingual Support: Introducing multilingual capabilities will allow Echo Alert to cater to a wider user base, ensuring that language barriers do not prevent users from accessing the medication support they need.
  • Integration with Medical Devices: Future versions will integrate with medical devices like pill dispensers, smart thermometers, or glucose monitors, offering a more comprehensive healthcare experience for users.

Built With

  • javasc
  • llm
  • rag
  • vectordatabase
  • voiceflow
Share this project:

Updates