BrodieAI

BrodieAI in its inviting form factor

Inspiration

Inspired by products such as Tab and Humane AI Pin, we were driven to create a conversational AI similar to C3PO from Star Wars.

What it does

A portable bot in a comforting form factor that you can conversate with on the fly, and it always at the ready.

How we built it

We built an API with speech-to-text and text-to-speech algorithms that send audio input from the user, turn it into text, and send it to the OpenAI API. The response from OpenAI is then converted into an audio file and sent back to the client. We used a raspbery pi as a client that enables portability of the product, and uses a button on a breadboard to record audio and call the API we created.

Challenges we ran into

Making API calls in python and sending and receiving .wav files to the API was significantly challenging.

Accomplishments that we're proud of

building a functional API server with TTS and STT capabilities using azure and openai, and building with hardware for the first time, being able to record audio at the touch of a button.

What we learned

How to use raspberry pis and use it as a client to call an API

What's next for BrodieAI

Vision capabilities, enabling it to answer queries about its surroundings after gathering that context and processing it with a computer vision model. (Model already created, need to integrate it into API and enable video/photo captures to be sent to our API)