AI Voice Assistant

Inspiration

• Moving at the time, needed an easy system for keeping track of boxes
• Wanted to create an AI solution that can easily be applied to any CRM

What it does

• Compiled a database of boxes, keeping track of their contents and when and where they were packed
• Chatbot interface for handling NLP queries

How I built it

• Leveraged Deepgram for STT/TTS
• Engineered system prompt and agent persona for friendly, straight-to-the-point interactions
• Implemented persistent memory between sessions, allowing users to ask related questions in succession

Challenges I ran into

• building and reading a robust dataset for providing context when generating responses

What's next for AI Voice Assistant

• tooling for CRM migration and integration

Built With

• deepgram
• openai
• python
• react