Inspiration

Managing money is stressful, especially for students and young professionals figuring out how to budget for the first time. Most finance apps feel cold and complex, which makes people lose motivation fast. We wanted to create something that felt more human, a budgeting experience that talks to you, understands your habits, and helps you build better ones.

What it does

Omnia is a web app where users can talk to an AI avatar to manage their budget. The avatar helps set a monthly budget, divide it into categories, and track expenses through natural conversation. It gives real-time feedback, warns when spending goes overboard, and offers personalized suggestions for saving or investing. It turns financial tracking into a guided, interactive experience.

How we built it

We built the web app with React for the frontend and Express.js for the backend. Gemini powers the avatar’s conversational intelligence, while ElevenLabs provides natural and realistic voice interactions. Together, they create a smooth experience where users can both talk and listen to their virtual finance coach.

Challenges we ran into

Integrating Gemini and ElevenLabs in real time was a challenge. Balancing responsiveness, maintaining conversation flow, and handling speech delays required fine-tuning. Designing a user experience that felt natural while keeping accurate financial logic also took several iterations.

Accomplishments that we’re proud of

We are proud of creating an AI-driven budgeting tool that feels approachable and personal. Seeing the avatar react to user inputs with voice and personality made the experience come alive. We also successfully built a working integration between multiple APIs under tight time constraints.

What we learned

We learned how to manage real-time communication between multiple AI services and how small UX details such as voice timing and avatar animations can drastically change user engagement. We also deepened our understanding of conversational design and how AI can support financial education.

What’s next for Omnia

We plan to add predictive insights to help users forecast future spending and integrate with bank APIs for automatic expense tracking. We also want to explore personalized saving goals and a mobile version so users can interact with their AI assistant anywhere.

Built With

Share this project:

Updates