RafykyAI

Inspiration Just like Rafyky, the friend who guided Simba when lost, we envision RafykyAI as a helpful companion. Inspired by the Swahili meaning of "Rafyky" (friend), we aim to build AI that assists users in video conferences and beyond, finding answers and completing tasks with ease.

What it does RafykyAI is your friendly voice assistant, always ready to help. Dial in and ask your questions – RafykyAI, true to its name, will be there to provide answers in a voice call, just like a friend guiding you. It's designed to be a helpful presence in your digital world.

How we built it Built with robust technologies: Python, FastAPI, and Pipecat-AI for orchestrating the AI pipeline. We leveraged Twilio for seamless voice calls and Gemini for powerful LLM, STT, and TTS capabilities.

Challenges we ran into Like any good friendship, building RafykyAI had its hurdles. Integrating real-time voice with AI was complex, optimizing for natural conversation flow was tough, and debugging audio issues tested our patience – but we persevered to make RafykyAI a reliable friend.

Accomplishments that we're proud of We're proud that RafykyAI is now a functional voice chatbot, ready to be a helpful friend via phone calls. Successfully bringing together Twilio, FastAPI, and Gemini in a real-time pipeline is a major step in making AI more accessible and friendly. The client-side testing framework ensures RafykyAI is always ready to assist.

What we learned In building RafykyAI, we learned valuable lessons in creating helpful AI. We deepened our understanding of voice pipelines, asynchronous coding, and cloud service integration, all to make RafykyAI a more capable and knowledgeable friend.

What's next for RafykyAI Just like a friendship grows, we want RafykyAI to evolve. Next, we aim to enhance its conversational skills, reduce response times for smoother interactions, explore how it can be even more helpful in tasks and video conferences, and ensure it's always a dependable and friendly AI companion.