Inspiration
Expense tracking is a chore everyone puts off — receipts pile up in email, UPI notifications get buried, and by the time you sit down to reconcile a month of spending, half the details are forgotten. We wanted an agent that handles this completely on its own.
What it does
ReceiptRunner is an autonomous agent that:
- Watches Gmail for receipt attachments and UPI transaction alerts
- Uses Gemini to extract vendor, amount, date, and category from each one
- Saves structured expense records to Firestore
- Automatically compiles a formatted monthly PDF report with AI-generated spending insights
- Runs entirely on its own schedule via Cloud Scheduler — no manual triggering required
How we built it
- Gemini (via Vertex AI) for multimodal receipt extraction and UPI text parsing
- Google ADK / GenAI SDK to structure the extraction pipeline
- Cloud Functions (Gen 2) to host the extraction and report-generation agents
- Firestore to store structured expense data
- Cloud Scheduler to trigger extraction autonomously on a recurring basis
- Secret Manager to securely store Gmail OAuth credentials
- ReportLab to generate the final PDF reports
Challenges we ran into
- Debugging Cloud Functions deployment issues (entry point mismatches,
.gcloudignoreexcluding the virtual environment, Windows-specific PowerShell quirks) - Navigating regional/multi-region availability for newer Gemini models on Vertex AI
- Wiring OAuth credentials securely through Secret Manager instead of local files
- Making the pipeline idempotent so repeated runs don't create duplicate expense records
What we learned
- How Cloud Functions Gen2, Cloud Scheduler, and Vertex AI fit together to build a genuinely autonomous agent
- The importance of designing for idempotency from the start when a pipeline runs on a recurring schedule
- Practical debugging across the full GCP stack — IAM, Secret Manager, Firestore, and Vertex AI permissions
What's next
- Support for more transaction sources (credit card statement emails, other payment apps)
- Smarter categorization using spending history
- A simple dashboard for browsing expenses beyond the monthly PDF ## What it does
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
What's next for ReceiptRunner
Built With
- cloud-functions
- cloud-scheduler
- firestore
- gemini
- gmail-api
- google-adk
- google-cloud
- python
- secret-manager
- vertex-ai