HearMe

HearMe is an app that listens to conversations, transcribes them, summarizes them, and translates them into whatever language.

Comment

Inspiration

Last year in my history class, there were two students who didn't know English. And so, the teacher was trying to find a reliable way to translate what she was saying in class. At that time, I thought about the idea of making a real-time translator that stays on as that was the main problem with other in-real-time translators. And now we built it.

What it does

HearMe is a web app that provides real-time speech-to-text captions, with AI-powered gap filling for unclear audio. It also translates speech into multiple languages and can summarize conversations, making communication accessible, inclusive, and easy to understand for everyone.

How we built it

We began by planning how we can really make this into reality. The backend was the easy part, as we have had experience handling AI integration in backend, but we wanted the frontend to be really aesthetic. And so, we used Vercel's frontend generator as inspiration and made it work to our liking. I wanted it to have the glassy look of the new IOS 26 since it looks clean.

Challenges we ran into

It was difficult for us to collaborate and integrate the backend and the frontend, since we were trying to locally host the backend on our computers. Then we instead changed it up, and used our AI provider as our backend server and it works great!

Accomplishments that we're proud of

Since we switched roles for the first time, with me(Shaurya) on front-end and Nikhil on back-end, we are so proud of what we have been able to do in such a short time span and we have learnt a bunch.

What we learned

We have learnt a lot from doing this project and have gained a bunch of experience in what was before, unknown waters.

What's next for HearMe

In terms of next for HearMe, we would love to make it a full app, thats downloadable on Android and iPhones, which may be an update in the future. We also wanna add more features such as dual-language input, transcript editor and more language compatibility, just to name a few. We would appreciate feedback too :D.

Built With

Share this project:

Updates