Samvaad- LIVE Gmeet Translator Bot

Goals and Future Vision
Samvaad
Slide
What Is Samvaad?
Thank You!
Agenda
Live Demo
Quote
Problem Statement
People Communicating

Inspiration

The biggest inspiration came from Black Wings itself, where our team consisted of 2 Hindi and 2 native-English speakers. We realized how extremely handy it would be to have a bot that behaves like a human translator. Communication is an essential practice in almost every aspect of human life. Miscommunication can be hazardous, and it can happen to anyone, especially when they do not speak the same language.

What it does

Gmeet Optimizer A Google meet bot that joins the meeting by invitation. A Bilingual Translator You don't need a bilingual translator to convey messages to each side; use this bot for all your online meetings. It's Free No need to pay heavy translation charges. Samvaad is entirely free to use

How we built it

We made the bot in the form of a python script that does the following things:

the script ran selenium to nudge chromedriver and help the bot login to our meeting link.
the script then uses pulse-audio to create a null sink input device
simultaneously the recording of the user's voice starts from where python libraries help us auto-detect languages of the mono speech which is written in a txt file (Speech-to-Text)
this text is read by another auto-detect Text-to-Speech in the language opposite to the one in which the input was received (hence bilingual translator) and this is saved to an mp3 file
we reduce the delay and automate responses by making the script bot wait for a silence of a few seconds and the mp3 file is played through the null-sink on the other tab.

Challenges we ran into

Number one has to be time zone differences hence even more difficulty with communication
Chromedriver versions were outdated, and we had to configure different versions for each of our systems.
We spent most of our time trying to find ways to package the script to an executable or docker image, but due to lack of time couldn't.

Accomplishments that we're proud of

Successfully able to pull the idea off, not been implemented before so we did not have many resources to take help from. Also, the fact that our friends and family really liked the end result was quite nice.