Inspiration

Expense tracking is a chore everyone puts off — receipts pile up in email, UPI notifications get buried, and by the time you sit down to reconcile a month of spending, half the details are forgotten. We wanted an agent that handles this completely on its own.

What it does

ReceiptRunner is an autonomous agent that:

  • Watches Gmail for receipt attachments and UPI transaction alerts
  • Uses Gemini to extract vendor, amount, date, and category from each one
  • Saves structured expense records to Firestore
  • Automatically compiles a formatted monthly PDF report with AI-generated spending insights
  • Runs entirely on its own schedule via Cloud Scheduler — no manual triggering required

How we built it

  • Gemini (via Vertex AI) for multimodal receipt extraction and UPI text parsing
  • Google ADK / GenAI SDK to structure the extraction pipeline
  • Cloud Functions (Gen 2) to host the extraction and report-generation agents
  • Firestore to store structured expense data
  • Cloud Scheduler to trigger extraction autonomously on a recurring basis
  • Secret Manager to securely store Gmail OAuth credentials
  • ReportLab to generate the final PDF reports

Challenges we ran into

  • Debugging Cloud Functions deployment issues (entry point mismatches, .gcloudignore excluding the virtual environment, Windows-specific PowerShell quirks)
  • Navigating regional/multi-region availability for newer Gemini models on Vertex AI
  • Wiring OAuth credentials securely through Secret Manager instead of local files
  • Making the pipeline idempotent so repeated runs don't create duplicate expense records

What we learned

  • How Cloud Functions Gen2, Cloud Scheduler, and Vertex AI fit together to build a genuinely autonomous agent
  • The importance of designing for idempotency from the start when a pipeline runs on a recurring schedule
  • Practical debugging across the full GCP stack — IAM, Secret Manager, Firestore, and Vertex AI permissions

What's next

  • Support for more transaction sources (credit card statement emails, other payment apps)
  • Smarter categorization using spending history
  • A simple dashboard for browsing expenses beyond the monthly PDF ## What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for ReceiptRunner

Built With

Share this project:

Updates

Submission history