Telehealth Companion

Inspiration

Since COVID-19, Telehealth has emerged as a critical component of modern healthcare, reshaping how services are delivered and accessed. Digital distance often creates confusion and misunderstanding. This website simplifies interaction between a physician and patient and empowers patients by giving them a full understanding of their diagnosis, so they can plan and follow treatment accordingly.

What it does

Our platform revolutionizes the way telehealth sessions are utilized post-consultation. Here's how it enhances your healthcare management experience:

Video Upload: Users can easily upload their telehealth session videos directly to our secure backend storage. This feature ensures that your consultations are accessible anytime for further analysis.
Advanced Analysis with AssemblyAI: Leveraging the power of AssemblyAI, our companion extracts critical information from your session videos. This includes generating accurate transcripts, identifying different speakers, pinpointing key topics discussed, creating organized chapters for easy navigation, and summarizing the content. This comprehensive analysis transforms your telehealth videos into a rich, easily navigable, and understandable format.
Interactive ChatGPT Assistance: Have questions about your session? Our integration with ChatGPT allows you to ask any questions regarding the video content. The AI, equipped with insights from the session's analysis, provides precise answers, enhancing your understanding and retention of the discussed medical advice.
Personal Notes and Database Save: For a more personalized touch, users can write down their notes and reflections based on the session and the AI's feedback. These personal notes, along with the analyzed results, can be saved to our database for future reference.
Convenient Profile Screen: Accessing your history of saved sessions and notes is a breeze with our user-friendly profile screen. Each save is neatly cataloged, allowing you to quickly revisit and review any session or note. This personal archive not only helps in keeping track of your health journey but also in preparing for future consultations.

How we built it

In creating our innovative platform, we carefully selected technologies that ensure both robust performance and ease of use. Here's a closer look at our tech stack and how each piece contributes to the user experience:

React with Material UI to design user interface.
Google Firebase authentication for user signup and login.
Google Firebase storage to store video.
AssemblyAI to analyze video.
ChatGPT to implement chat bot.
Firebase Realtime Database to store AssemblyAI and user-generated content.

Challenges we ran into

Frontend development posed a challenge as only one team member had prior experience with React and JavaScript. The analysis screen, featuring numerous elements like expandable chapters and a chatbot, proved particularly complex. Addressing user interface issues on the analysis screen demanded a significant investment of time from the team due to its intricate design.

Accomplishments that we're proud of

We take immense pride in successfully building a project from the ground up. Starting with a blank canvas, we've meticulously crafted each element, overcoming challenges and demonstrating our capability to bring ideas to life. Equally commendable is our commitment to effective communication. Throughout the project, clear and open communication has been the cornerstone of our collaborative efforts. Whether navigating the complexities of technology integration or addressing design considerations, our team's ability to convey ideas, share insights, and coordinate seamlessly has played a pivotal role in the project's success.

What we learned

Overcoming the initial hurdle of limited experience in React and JavaScript has been a crucial learning point. Our team gained proficiency in frontend development, underscoring the importance of adaptability and continuous learning in the ever-evolving landscape of web technologies.

What's next for Telehealth Companion

The future holds exciting possibilities for Telehealth Companion. Here are some key areas we're exploring for the next phase:

Feature Expansion: We plan to introduce new features that further enrich the user experience. This may include additional AI-driven insights, personalized health recommendations, and expanded capabilities for users to interact with their health data.
Enhanced Security Measures: Strengthening our commitment to data security, we'll implement advanced measures to ensure the protection and privacy of user information and comply with HIPAA requirements. This includes exploring encryption protocols, secure authentication processes, and compliance with industry standards.