Inspiration
We generally miss important part of our meeting like attendance or when professor call's individual name. So we tried to build a bot which help us alerting us.
Why this project?? Pandemic has been a major setback and given unwanted headaches to students and employees around the world working/studying from home. Sitting in front of computers has increased the screen time exponentially. But worry no more, we are here with our beautiful extension "Meeting Wingman". Our extension helps users deal with the screen time issue by not only generating meeting transcript but also implements various other features. Our Meeting Wingman will notify the user via whatsapp messaging or phone sms, if their name or any particular keyword (like attendance) is called out by the meeting instructor.
What it does
So it basically takes input of important keyword in the beginning. When that particular keyword is called in the meeting the bot will alert the user though his selected mode (WhatsApp /SMS).
- Sends whatsapp / sms messages via Twilio
- Notifies user when their name is called in the meeting
- Generates the transcript for the meeting
How we built it
So basically first we take input of the keywords from user. Then bot listen to audio and if the keyword is in the transcript the bot alert it using WhatsApp using Twilio WhatsApp API. Some of the tools we used were
- Chrome devtools (for extension)
- Twilio
- Deepgram API (Speech to text)
- MongoDB
- Nodejs
Challenges we ran into
We were using sockets for first time so it was a challenge for us to use deepgram socket API. This was also our first time using twilio's whatsapp messaging api. We faced lots of issues while creating chrome extension and thus faced major challenges in building the project.
Accomplishments that we're proud of
It was our first time creating a Google chorme extension and was first time using Twilio and Deepgram API
What's next for Meeting Wingman #47
Our web app needs integration from the backend and needs proper authentication feature. As of now we have created the web application and a basic chrome extension as a part of the implementation of our idea. We would in future like to update our extension and make it fully working and downloadable extension. We would also like to add the feature where user can download the transcript in pdf format.
Log in or sign up for Devpost to join the conversation.