Inspiration

Passion for coding, team work, growth mindset, desire to respond to our needs using new technologies and a fun touch.

What it does

Speech to text: takes the audio of a meeting as an input and transforms it into it's transcript, summarizes it and sends it over email. Integrates Chat GPT to our communication platform: with Varutu TopGPT, you'll never have to worry about feeling lonely or bored. Whether you're looking for a witty conversation, a fun fact, or even a cheesy joke, Varutu has got you covered! On top of that, Varutu can provide you an interactive poll with customized suggestions and will take care of finding best outing options for your team, based on criteria you give him.

How we built it

We created and configured:

  • an OpenAI service in Azure
  • Google chat application that captures text from the user, as an input, makes a request to the OpenAI server (Chat GPT backend) and replies back (written in javascript and deployed in Google Apps Script)
  • an Azure Speech service (in Azure cloud) & an application. The app takes an audio file as an input, converts it into transcript using the service and then summarizes it using Azure OpenAI service (C#)
  • in order to develop poll functionality we used Google interactive cards

Challenges we ran into

  • while trying to implement the original project idea, we encountered a timeline limitation in accessing certain endpoints from Google (that needed us to be enrolled in a special dev program, which could be done within a week. So we re-focused and found another idea to avoid this limitation. We ended up summarizing some recorded meetings instead.
  • we didn't have any prior experience with the technology, so we had to invest time in learning it.
  • Varutu was a little shy in the beginning: Alt

Accomplishments that we're proud of

courage+learning+experiment&adapt - we challenged ourselves, we chose an unfamiliar area of technology and targeted a real need from our day by day working environment. Aaaaand we have 2 apps!

What we learned

Many things are not as easy as they seem at first estimation (we thought that we will spend more time in break out activities), but the attitude it's important, don't give up and adapt!

What's next for Top GiPiTi

  • Google Drive integration:
    • whenever there's a new recording, extract the audio in the cloud
    • save the summary in google drive
    • send it by email
    • real time speech to text transcript
  • extend the solution to accept several file types
  • Promote Varutu TopGPT inside the company and help him make new friends

Built With

+ 23 more
Share this project:

Updates