Connectify

Our software captures foreign speech, instantly translating it into English text for call center software. Agents can engage smoothly across languages, enhancing client experience and satisfaction.

Comment

Inspiration

Our group was talking about existing problems that existed in the telecommunications industry which led us to customer support. This led us to discuss ideas about how to improve customer support and bring it to the next level so that the experience can become more enjoyable. We found that a persisting issue was the fact that a lot of times, customers are not able to communicate their needs through phone calls due to language barriers that exist as English is not their first language. Because we wanted to provide an equal opportunity and experience for all customers including those who feel more comfortable communicating in other languages, we made it our mission to solve this issue.

What it does

Our tool is designed to detect live speech in any foreign language - some examples include, French, Spanish, Chinese, etc. It then converts the speech into text while translating it into the main language, English. The text is then displayed for the agent to see so that they may communicate with the client more efficiently.

How we built it

  1. created next-js react app.
  2. incorporated open AI APIs to transcribe and translate audio

Challenges we ran into

  1. nextjs and react were new concepts for us, so it took us a while to implement what we needed.
  2. correctly connecting the audio input so it is sent to open ai was a new challenge where we needed to solve.

Accomplishments that we're proud of

  1. Correctly saving the audio file to our system and sending it to open AI.
  2. Receiving the correct text translated into English
  3. Collaboration effort
  4. Building under pressure

What we learned

  1. Using next.js and open ai API
  2. Product design
  3. UI design

What's next for Connectify

  1. Translate the agent's response back into the language that the client spoke in - this way there can be seamless communication on both ends
  2. Integrate it on a larger scale - applying the algorithm we used in our application for real phone calls so there is live translation which improves communication
  3. Improved UI design with more features - fully develop a live communication with an agent through speech and text on an online interface

Built With

Share this project:

Updates