FinSight - Finance without Barriers
Objectives of FinSight
Key Features of FinSight
Methodology/Implementation of FinSight
Project flow of FinSight

FinSight: Voice-Driven Financial Empowerment for the Visually Impaired

Inspiration

The inspiration for FinSight emerged from understanding the barriers faced by visually impaired individuals in accessing and managing their finances independently. Traditional financial systems often fail to prioritize accessibility, leaving this demographic dependent on others for even basic transactions like checking balances or paying bills. With advancements in AI, voice technologies, and biometric authentication, we envisioned a solution that could empower visually impaired users with autonomy, inclusivity, and confidence in handling their finances.

What It Does

FinSight is a voice-based AI customer care platform designed to provide visually impaired users with seamless access to financial services. Its key features include:

Voice-Based Navigation: Users interact with the app via voice commands for an intuitive experience.
Check Balances: Retrieves and reads account balances in real time.
Pay Bills: Enables secure and simple bill payments through voice instructions.
Transfer Money: Processes seamless UPI transactions without relying on additional gateways.
Personalized Financial Advice: Delivers tailored recommendations on savings, budgeting, and investments powered by Google Gemini AI.
Biometric Authentication: Provides secure fingerprint login, eliminating the need for passwords.
Round-the-Clock Support: Real-time responses, notifications, and updates via text-to-speech integration.

How We Built It

Frontend

We utilized the Flutter framework to build a user-friendly, accessible interface. Key plugins included:

TTS (Text-to-Speech): Converts responses into voice output.
Speech-to-Text: Recognizes user commands and transcribes them.
Local Auth: Implements fingerprint-based biometric authentication.
Easy UPI: Integrates UPI payments for seamless transactions.
Contact Service: Fetches and manages user contact information.
URL Launcher: Enables external links for additional resources.

Backend

The backend features advanced AI-driven analytics with Google Generative AI (Gemini) to provide:

Custom financial insights based on user preferences.
Real-time NLP intent recognition for processing voice commands.
A Dart-based script extracts keywords, processes user intent, and generates responses tailored to specific financial tasks.

Challenges We Ran Into

GPay Integration: While the app can initiate UPI payments, NPCI approval is needed to finalize transactions.
Face Biometric Challenges: Ensuring reliability across varying lighting conditions proved difficult.
TTS and STT Services: Adapting to diverse accents and ensuring compatibility across devices required extensive fine-tuning.
Voice Assistant Accuracy: Handling noisy environments and natural speech patterns posed challenges in achieving accurate command recognition.
Maintaining Accessibility: Designing a simple, responsive interface suitable for visually impaired users while preserving functionality and performance was a constant balancing act.

Accomplishments That We’re Proud Of

Empowering Accessibility: Created a solution that directly addresses the needs of visually impaired users.
Seamless Biometric Login: Implemented secure and user-friendly fingerprint authentication.
AI-Driven Insights: Integrated advanced analytics for personalized financial recommendations.
Real-Time Voice Interactions: Enabled smooth communication using TTS and Speech-to-Text technologies.
Hassle-Free Transactions: Streamlined UPI payment functionality for easy financial management.

What We Learned

The importance of designing for inclusivity and accessibility.
Effective integration of multi-platform plugins in Flutter.
Leveraging AI to deliver personalized, meaningful insights to users.
Challenges of building robust voice assistants in real-world conditions.
Balancing a clean UI with functional depth for differently-abled users.

What’s Next for FinSight

NFC Tag Integration: Introduce tap-to-pay transactions for added convenience.
Expanded Accessibility Modes: Include features like larger buttons, high-contrast screens, and voice-guided navigation.
Advanced Voice Assistant: Enable multi-language support, handle complex queries, and deliver enhanced personalized insights.
Face Biometric Authentication: Improve reliability to offer a secure alternative to fingerprint authentication.
Enhanced UI/UX: Focus on creating a more intuitive interface with larger text and a cleaner layout.

By constantly evolving and improving, FinSight aims to redefine financial accessibility for visually impaired users, ensuring they can manage their finances with independence and confidence.