meowley

Inspiration

Doctor visits move fast, and it is easy to forget the details the moment the call ends. We noticed that seniors and patients with complex plans often struggle to remember exactly what their doctor said about medications or next steps. We built Meowley to allow patients to revisit their doctor's advice anytime.

What it does

Meowley allows users to upload their telehealth recordings and interact with them. Instead of re-watching a long video, you just ask a question like, "What was the idea being reinforced from my appointment?"

Finds and plays the exact clip where the doctor answered you.
Creates a summary and a short quiz to help you make sure you understood your session correctly.
Provider view where the professional can see patient statistics.
Converts visits into JSON aligned with FHIR standards, ready for integration into healthcare systems.
Learn about your health in a 3-star gamified environment

How we built it

We built the core of the app using HTML, CSS, and JavaScript, with Claude helping architect the codebase. We used TwelveLabs Pegasus + Marengo for video intelligence and Gemini for summaries, while Google Cloud handles storage and voice-to-text.

Challenges we ran into

The hardest part was getting the video clipping to work perfectly so the doctor's answer did not get cut off. We also spent a lot of time on the UI to make sure it stayed clean and simple. Another big challenge was syncing the captions with the video in real time so that users could read along while the doctor spoke without any lag. We also worked to align with ONC interoperability principles to ensure our data remains portable and compliant with rules against information blocking.

Accomplishments that we're proud of

Our AI does not guess because every answer it gives is backed by a real video clip of the doctor speaking. We created an interface that is very easy to navigate and accessible, ensuring anyone can find the health information they need without feeling overwhelmed.

What we learned

We learned that for health apps, seeing a video is much more helpful and trustworthy than just reading a text summary. We also realized that keeping the code simple and modular makes it much easier to fix bugs and add new features during a fast-paced hackathon.

Instructions

Navigate to the /dataset and download the sample appointment video file.
Navigate to "https://meowley-w5s8.onrender.com/"
Upload the downloaded video file, Meowley then converts it into intelligent insights and smart quizzes for the patient, and statistics for the providers.

What's next for Meowley

We want to add a daily symptom tracker so patients can log how they feel between appointments. To move beyond a standalone tool, we plan to integrate FHIR (the modern HL7 standard) to connect with EHRs like Epic and Oracle Health/Cerner so the app fits directly into clinical workflows. We also plan to add a feature that automatically identifies high-priority medical terms and links them to simple definitions so patients can learn more about their diagnosis without leaving the app.