Inspiration

We wanted a more human and effortless way to manage money without staring at screens or digging through apps. Voice felt like the most natural interface for real-time financial guidance.

What it does

WhisperWallet listens to your voice, understands your budgeting commands, and instantly responds with personalized financial insights. It helps you set budgets, track spending, and check what you can safely spend—hands-free.

How we built it

We combined Whisper ASR, a lightweight intent engine, and a simple budget brain stored in local JSON files for portability. Gradio powers the voice interface, enabling seamless audio input and real-time interaction.

Challenges we ran into

Making audio handling stable in a constrained cloud environment required careful model selection and fallback logic. Ensuring speech recognition remained reliable despite varied accents and noise was also challenging.

Accomplishments that we're proud of

We built a fully voice-driven finance assistant that works end-to-end in the browser with no traditional UI. Achieving reliable ASR and real-time financial reasoning in a lightweight environment is a big win.

What we learned

Voice interfaces demand thoughtful error-handling and simpler flows than traditional apps. We also learned how to optimize ML models for low-resource environments like HuggingFace Spaces.

What's next for WhisperWallet -The Voice-Only AI Finance Companion

We'll add natural-language intent parsing, richer financial insights, and spoken responses for a truly conversational experience. Eventually, WhisperWallet will become a proactive budgeting coach that understands tone, habits, and long-term goals.

Built With

  • a
  • and
  • and-the-hugging-face-transformers-whisper-asr-model-for-speech-recognition.-it-uses-lightweight-json-storage-for-budgeting-data
  • environment
  • external
  • fully
  • gradio
  • huggingface
  • in
  • pydub-for-audio-processing
  • runs
  • services
  • space
  • whisperwallet-is-built-using-python
  • without
Share this project:

Updates