Inspiration

In freelance software development, one of the biggest challenges is trust. Clients pay for deliverables, but how can they confidently know whether the agreed work has actually been completed? Developers also need a fair way to demonstrate their progress and receive payment without unnecessary disputes. We realized that defining a milestone, verifying its completion, and processing its payment are often treated as separate activities. We wanted to connect all three. That idea led to ProofPay AI — a platform where software delivery is evaluated using repository evidence, reviewed by the client, and connected to PayPal payments. Our guiding principle was simple: **Don't just pay for promises. Pay with evidence.

What it does

ProofPay AI is an AI-assisted milestone verification and payment coordination platform connecting clients and software developers. It provides an end-to-end workflow:

  1. Create milestones:Clients define deliverables, assign developers, connect GitHub repositories, specify payment amounts, and establish acceptance criteria.
  2. Collect development evidence: ProofPay retrieves relevant repository evidence, including source files, commits, and available pull-request information.
  3. AI-powered verification: Google Gemini analyzes the collected evidence against each acceptance criterion and generates structured findings:
    • Supported
    • Not supported
    • Inconclusive
  4. Transparent approval:** Clients review the AI-generated report before approving a milestone. Inconclusive findings require explicit acknowledgement before approval.
  5. PayPal invoicing:** After approval, ProofPay creates and sends an invoice through PayPal Invoicing.
  6. Verified payment confirmation:** The backend verifies PayPal webhook signatures and checks the invoice's actual payment status before marking the milestone as paid. The result is a connected workflow for delivery evidence, human approval, invoicing, and payment confirmation. ## How we built it We developed ProofPay AI as a full-stack web application with separate experiences for clients and developers. Frontend — React and Vite: Built the dashboards, authentication screens, milestone management, verification reports, invoice views, and payment history. Backend — Node.js and Express.js: Implemented REST APIs, authentication, role-based authorization, milestone management, verification workflows, and payment processing. Database — MongoDB and Mongoose:Store user accounts, milestones, acceptance criteria, verification reports, invoice information, and payment-related records. AI — Google Gemini API: Analyze collected GitHub evidence against individual acceptance criteria and generate structured, evidence-referenced findings. GitHub API:** Collect repository files, commits, and available pull-request information for verification. PayPal Invoicing and Webhooks: Handle invoice creation and payment confirmation. The backend validates webhook signatures and independently checks invoice payment status before updating milestone state. We also implemented controlled milestone state transitions to ensure that verification, approval, invoicing, and payment follow a defined workflow. ## Challenges we ran into One of our biggest challenges was making AI-generated verification reliable enough to support a financial workflow. An LLM can produce convincing explanations even when the available evidence is incomplete. For example, finding a test file does not prove that the tests passed or that code coverage exceeds a particular threshold. We addressed this by introducing three distinct findings: supported, not supported, and inconclusive. We also implemented backend validation to ensure that:
  7. AI findings correspond to the actual acceptance criteria.
  8. Evidence references point to items that were genuinely collected.
  9. Invalid or inconsistent AI responses are rejected.
  10. Inconclusive results cannot silently become positive approvals. Another challenge was coordinating asynchronous GitHub collection, Gemini analysis, milestone transitions, PayPal invoice creation, and webhook processing. We addressed this through controlled state transitions, webhook signature verification, invoice-status checks, and idempotent webhook handling. These challenges taught us that integrating AI into financial workflows requires more than a good model. It requires careful backend validation, security, and predictable system behavior. ## Accomplishments that we're proud of
  11. Built a working full-stack platform with separate client and developer workflows.
  12. Integrated GitHub repository evidence collection with Google Gemini-powered criterion-level verification.
  13. Implemented structured AI findings with supported, not-supported, and inconclusive outcomes.
  14. Added backend validation of AI-generated findings and evidence references.
  15. Implemented explicit client acknowledgement for inconclusive findings.
  16. Integrated PayPal Invoicing into the milestone approval workflow.
  17. Implemented verified PayPal webhooks with invoice-status checks and idempotent event processing.
  18. Successfully tested the Gemini verification flow and PayPal Sandbox payment-confirmation workflow.
  19. Built a complete application rather than stopping at a static prototype. Most importantly, we are proud that ProofPay does not treat an AI-generated answer as unquestionable truth. It makes uncertainty visible and keeps the final approval decision with the client. ## What we learned Building ProofPay taught us how to combine LLM-based reasoning with traditional software engineering. We learned that:
  20. AI outputs need validation before they influence important business workflows.
  21. Repository evidence must be interpreted carefully; missing evidence is not automatically proof of failure.
  22. Human approval is important when AI assessments involve financial decisions.
  23. Payment webhooks must be verified and processed safely to prevent incorrect or duplicate state changes.
  24. Reliable integrations require careful handling of asynchronous operations, external API failures, and application state. We also gained practical experience integrating React, Express, MongoDB, GitHub APIs, Google Gemini, and PayPal into one connected application. ## What's next for ProofPay-AI We see ProofPay as a foundation for more reliable evidence-based software delivery and payments. Our next priorities include:
  25. Secure automated testing:Execute repository test suites inside isolated environments to obtain stronger verification evidence.
  26. Deeper code understanding: Analyze code changes, commit history, and relationships between implementation and acceptance criteria.
  27. Evidence provenance: Build richer audit trails connecting every AI finding to its original repository evidence.
  28. Improved verification: Introduce more robust semantic analysis and deterministic checks alongside LLM assessments.
  29. Expanded integrations: Support additional development platforms, project-management tools, and payment workflows. Our long-term vision is to make software milestone payments more transparent, evidence-driven, and accountable. ProofPay AI — Define the work. Verify the evidence. Approve with confidence.

Built With

Share this project:

Updates

Submission history