LoanFlow AI

Voice-enabled AI for mortgage teams that simplifies borrower intake, loan tasks, and file management.

Comment

LoanVoice — AI Mortgage Pre-Qualification in 3 Minutes

Inspiration

The mortgage process is slow, fragmented, and filled with friction. Borrowers are forced to fill out long forms, repeat information, and wait days just to understand what they can afford. On the other side, loan officers and operations teams spend hours handling repetitive intake, verifying data, and managing workflows across disconnected systems.

We wanted to rethink this entire experience.

Instead of building another chatbot or form-based tool, we set out to create an AI system that could replace the first stage of the mortgage process entirely. A system where a borrower can simply speak naturally, get real answers instantly, and move forward with confidence.

At the same time, we wanted to build something that could extend beyond the borrower experience and support real lending operations through structured workflows, automation, and intelligent routing.

What it does

LoanVoice is an AI-powered mortgage pre-qualification and lending assistant that takes a user from conversation to a lender-ready loan profile in minutes.

Users can choose to interact through voice, chat, or video. Using ElevenLabs for real-time speech-to-text and natural voice synthesis, the platform enables a seamless, human-like conversation with an AI mortgage advisor named Morgan.

During the conversation, LoanVoice:

  • Collects borrower financial data through natural dialogue
  • Extracts structured data in real time
  • Calculates debt-to-income (DTI) instantly
  • Matches users with relevant loan products (FHA, VA, Conventional, USDA)
  • Generates an approval signal (Strong, Likely, Possible, Difficult)
  • Provides personalized insights and improvement paths

Once complete, the platform delivers:

  • A full results dashboard with affordability insights
  • Downloadable PDF summaries
  • Email and shareable outputs
  • AI-generated voice/video summaries
  • A direct path to connect with a lender

What normally takes days of back-and-forth can now happen in about three minutes.

How we built it

We built LoanVoice as a full-stack, agent-driven system rather than a single AI model.

At the core is an orchestrator that routes user input to specialized agents responsible for different parts of the workflow, including:

  • Borrower intake and data extraction
  • Financial analysis and DTI calculation
  • Loan matching and scenario evaluation
  • Verification and compliance checks
  • Monitoring and operational insights
  • Action handling and lender system integration

To power the voice experience, we integrated ElevenLabs for both:

  • Real-time speech-to-text streaming
  • Natural, low-latency voice responses

The platform is built using:

  • React + Vite
  • Node.js + Express
  • SQLite
  • Docker
  • FRED API

We also implemented a tool registry and connector layer to safely integrate with lender systems.

Challenges we ran into

The biggest challenge was designing a system that could handle real financial workflows safely.

Mortgage lending involves sensitive data, strict compliance requirements, and actions that cannot be executed blindly.

We also had to bridge real-time voice input with structured data workflows while maintaining accuracy and reliability.

Accomplishments that we're proud of

  • Voice-first mortgage intake powered by ElevenLabs
  • Real-time DTI calculation and loan matching
  • Multi-agent orchestration architecture
  • Full results dashboard with actionable outputs
  • Lender-ready export and handoff capabilities
  • Audit logging and safety controls

What we learned

AI in lending requires structure, guardrails, and trust.

Voice becomes powerful when combined with real-time processing and intelligent orchestration.

Designing for real-world constraints from the beginning leads to stronger, more scalable systems.

What's next for LoanVoice

  • Expand lender integrations
  • Improve financial modeling accuracy
  • Strengthen compliance and audit systems
  • Optimize conversion to loan officers
  • Scale across markets and regions

Our long-term vision is to build a complete AI-powered mortgage workflow copilot.

Built With

Share this project:

Updates