CallSnap

Inspiration

When we multitask in a call, there might be times when we missed what have been previously said and when you're called you have 0 clue how to answer because you have no clue what they've been saying!

What it does

When your name is called, it minimizes all other windows and provide quick summary of what has been said so you can quickly snap back into the call! It also has a keybind feature.

How we built it

We use Python as our main programming language. Tkinter is used to create graphical user interfaces that give users the ability to configure the application settings.

Challenges we ran into

Harvin: "I figured that we can list down all active programs as process IDs, but I was stuck on how to handle their visibilities (whether they are minimized, maximized, or restored). After thorough research, I discovered that using the win32 modules can handle those tasks."

William: "My biggest challenges were working with Vosk model to provide the best transcription of the meeting audio even when there are other sounds around. Isolating the meeting audio was key and I solved it by learning how to create and user virtual audio cable through Voicemeeter to be routed into our program.

I've never worked with Vosk and Voicemeeter and thus was very confused and discouraged at the beginning, I face problems that feels like it came out of nowhere and was stuck for hours. For example, turns out Bluetooth earphones I was using will automatically mute all other audio during a call, thus I have to borrow Harvin's headphones (Thank you so much btw, none of this would've worked without you) to be able to hear both the meeting and other program's audio at the same time. The road ahead is filled with unknown and unexpected challenges but we must keep going to make what we want!"

Accomplishments that we're proud of

We are proud of the whitelist configuration, which lets users toggle programs' status easily. We are proud of the speech-to-text segment of the program that can be configured using Voicemeeter to only listen to the meeting audio.

What we learned

1. There will always be challenges but perseverance into the unknown is rewarded!
2. BLUETOOTH HEAPHONES WILL MUTE ALL OTHER AUDIO DURING A CALL!! Please use headphones if you still want to hear other audios at the same time 😅

What's next for CallSnap

CallSnap currently runs only on Windows, so the next step we would take for CallSnap is to adapt to more operating systems and improve detection-popup delay times.

Built With

• numpy
• python
• soundcard
• tkinter
• vosk
• win32