SpeakSync

Inspiration

You know how we often get ideas in the shower, the gym, or in the car, and we just wish to mark them down but we can't since we don't have access to our codebase? We wanted to make a voice assistant that can mark your notes down, but we wanted to take things a step further and we questioned, what if we could directly add those improvements to the codebase remotely, say when we're in the shower? We are developing a voice assistant that when you make a phone call and give instructions, it can remotely alter your codebase to incorporate code that follows your instructions

How we built it

We used a combination of multiple different JS frameworks. Most of our API calls were handled by Express.Js, while the Overlay - Terminal commands were run by RobotJs. We used the Twilio API to be able to call our AI agent and used Claude code to make significant changes to project codebases.

Challenges we ran into

Claude code doesn't actually natively support remote automated codebase editing, so we had to develop a novel method of manually typing overlays into the claude terminal and automating type scripts and shells to achieve this.

Accomplishments that we're proud of

Automated codebases are a increasingly popular idea and we are proud that we were able to give a simple phone call the power create and change thousands of lines in a codebase.