Inspiration
Merchants lose billions each year to checkout abandonment, manual billing latency, and chargeback dispute overhead. While conversational AI chatbots are everywhere, most remain passive observers that merely output text without financial agency.
We asked: What if digital commerce had true autonomy? What if an AI agent could dynamically negotiate deals with buyers inside checkout within strict merchant profit margins, proactively shield against fraud by pausing suspicious funds in escrow, and execute billing operations hands-free over real payment rails?
That vision inspired PayAssist AI.
What It Does
PayAssist AI is an autonomous agentic commerce operating system powered by Google Gemini 2.0 Flash and PayPal REST APIs v2:
Agentic Smart Checkout (AI Deal Negotiator):
Instead of losing prospective customers to rigid price points, an autonomous commercial agent converses with buyers directly in checkout to negotiate startup concessions, annual pre-commitments, and volume bundles. When agreed within preset merchant margin guardrails, the agent dynamically recalibrates and re-renders official PayPal Smart Buttons live in the DOM for immediate capture.Autonomous Sentinel AI Shield (Fraud & Escrow Guardian):
Sentinel continuously inspects streaming payment telemetry using Bayesian anomaly risk scoring (0–100). When card-testing bot velocities or high-risk offshore anomalies strike, Sentinel autonomously enforces a PayPal Escrow Hold before settlement, protecting merchant seller standing 24/7.Multimodal Hands-Free Voice Invoicing:
Merchants can operate their business hands-free using integrated Web Speech recognition and Neural Speech Synthesis: "PayAssist, draft an invoice for Acme for $1,500 and send it." Gemini executes the PayPal Invoicing API v2 tool call and confirms execution aloud.Enterprise AG Grid & AG Charts Financial Command:
High-performance AG Grid tables across Transactions, Invoices, Customers, and Sentinel Live Streams with instant quick-filtering, status pills, customer avatar badges, and 1-click CSV exports, paired with AG Charts linear regression cash-flow forecasting.
How We Built It
- Payment Rails: PayPal REST APIs v2 (
/v2/checkout/orders,/v2/invoicing/invoices,/v1/payments/payouts), PayPal OAuth2 client credential lifecycle management, and the official PayPal JavaScript SDK. - AI Core: Google Gemini 2.0 Flash (
@google/generative-ai) function-calling engine with 8 registered executable tools. - Frontend: React 18 SPA with Tailwind CSS, custom AG Grid Community (v33), AG Charts (v11), and Lucide Icons.
- Backend & Persistence: Node.js Express server with WebAssembly SQLite (
sql.js), pre-seeded with 6 months of historical ledger transactions. - Cloud & Tooling: Configured with a production
render.yamlinfrastructure-as-code blueprint and anapimatic-context.jsonOpenAPI 3.0 context definition.
Challenges We Ran Into
- Dynamic DOM Button Recalibration: Ensuring PayPal Smart Buttons could cleanly unmount, recalculate pricing concessions within strict merchant margin boundaries, and re-render without page refreshes or race conditions.
- Modular Multi-Theme CSS: Overcoming nested CSS import loops by cleanly isolating AG Grid stylesheets from Tailwind build pipelines.
- Zero-Native Dependency Architecture: Replacing native C++ database addons with WebAssembly SQLite (
sql.js) to guarantee any judge can clone, install, and run the project with a single command on any operating system without build errors.
Accomplishments That We're Proud Of
- A true end-to-end working prototype that executes real PayPal Sandbox captures and Gemini function calling.
- A live Threat Injection Sandbox where judges can simulate live bot attacks with 1 click.
- Built-in "60-Sec Judge Tour" modal embedded directly in the header for effortless evaluation.
What We Learned
- How to model real-world financial guardrails around LLM tool calling to prevent unintended commercial concessions.
- How to orchestrate real-time Bayesian risk scoring with PayPal's order capture and escrow capabilities.
- Best practices for embedding AG Grid and AG Charts into high-velocity fintech interfaces.
What's Next for PayAssist AI
- Autonomous Dispute Resolution: Expanding Gemini function-calling to autonomously submit delivery proof to the PayPal Disputes API.
- Multi-Currency Cross-Border Optimization: Automated FX conversion hedging using PayPal Payouts Rails for global remote workforces.
Built With
- ag-charts
- ag-grid
- agentic-ai
- apimatic
- express.js
- fintech
- gemini-api
- google-gemini
- javascript
- node.js
- paypal
- react
- render
- rest-api
- sql.js
- sqlite
- tailwindcss