zoombot

zoombot is a chatbot that can talk to meeting participants on Zoom in real time via voice (no chat messaging necessary), in addition to supporting voice commands for Spotify/YouTube audio. It leverages Google Cloud's speech synthesis and speech recognition APIs, along with state-of-the-art chatbot Mitsuku (5-time winner of the Loebner Prize Turing Test). Written in pure Python!

Requires Python 3.8.

Dependencies

Built With

google-cloud
multithreading
python
spotify-developer-api
youtube-web-api

Submitted to

DubHacks 2020

Created by

Project lead. I worked on setting up Google Cloud speech synthesis/recognition APIs, particularly with creating a robust IO stream interface with multithreading support to integrate microphone/speaker audio streaming with streaming clients for Google Cloud APIs.

Daniel Qiang
I worked primarily on getting the audio output stream from youtube and outputting it using Zumba when instantiated.

Abhishek Shah
I worked on the integration of the ZoomBot with the Spotify Developer API to query songs from Spotify. I helped with the audio engineering to stream the audio files to zoom.

Sanjana Sathyanarayanan
I worked to set up the Spotify Developer API credentials and to help engineer the mp3-to-wav file solution as well as set up the Spotify Input Stream. I also implemented validation for the voice queries

Arjun Srivastava