What it does
Pages you by calling your phone for meetings that don't require your "full attention". On top of that, it gives you a meeting summary on what's been talked so far.
How we built it
We route all meeting audio (Google Meet, Zoom, Teams) to our app. We used OpenAI Whisper to transcribe the audio. We detect names from the transcription and use Twilio to call the user. We also utilize Gemini to generate a quick summary of the meeting. We utilized Flask, Python, Html/Css & JavaScript for the application.
Challenges we ran into
Streaming audio in real-time to whisper while ensuring synchronization. Routing audio through the device also turned out to be a very unconventional problem.
Accomplishments that we're proud of
We integrated multiple processes including transcription in synchronization with live audio. We were also able to trigger very fast calls and quick summaries as soon as a name was called.
What's next for Meeting-Pager
A packaged application that can be distributed quickly across Windows and MacOS systems easily.
Log in or sign up for Devpost to join the conversation.