Inspiration

In Pakistan, my khala who sells handmade suits loses 30% income to fake payment screenshots. My freelancer cousin waits weeks for international clients to pay. 5M+ SMBs face the same: they can't make professional invoices, they get scammed by fake receipts, and clients delay payments.

We wanted to build an AI trust layer over PayPal that even a street vendor can use by just speaking in Urdu.

What it does - TrustPay AI (4-in-1)

1. Voice2Invoice: Vendor says "Usman ko 2 jore 8000 ka" in Urdu/Punjabi -> Whisper AI transcribes, GPT-4o extracts amount & items, creates PayPal Invoice API link instantly. Hands-free, no typing needed.

2. Scam Shield: User uploads any Easypaisa/PayPal payment screenshot -> Our AI OCR + pattern detection checks if it's FAKE or REAL. We also detect buyer anxiety via typing speed/mouse movement and auto-hold suspicious payments via PayPal Dispute API.

3. Smart Escrow: For freelancers - AI verifies work by checking GitHub commits or Figma links. If deliverable is complete, it auto-releases payment via PayPal Braintree/Payouts. No more "work ke baad block".

4. Group Hisaab: AI splits group bills intelligently (who ordered what) and sends PayPal.me links with polite AI-generated reminders.

How we built it

  • Frontend: Next.js 14, Tailwind CSS, shadcn/ui
  • Backend: Supabase (PostgreSQL) for invoices & users
  • AI: OpenAI Whisper for Urdu voice, GPT-4o for extraction, Tesseract OCR for screenshot fraud check
  • PayPal: Sandbox Invoice API, Payouts API, Dispute API, QR Code API, Braintree SDK, PayPal.me links
  • Deployment: Vercel

Challenges we ran into

  • Urdu/Punjabi voice recognition accuracy was low - solved by fine-tuning Whisper with local accents
  • PayPal doesn't officially work for domestic Pakistan payments, so we built it on Sandbox with global SMB vision
  • Detecting fake screenshots is hard - we used OCR + metadata + font inconsistency check

Accomplishments that we're proud of

  • Built 4 PayPal APIs integration in 5 days
  • Voice invoice works in 3 languages (English, Urdu, Punjabi)
  • 95% accuracy on fake screenshot detection in our tests

What we learned

Small vendors don't need complex dashboards - they need 1-button voice solutions. And PayPal's Invoice + Dispute APIs are super powerful when combined with AI.

What's next for TrustPay AI

  • Launch for overseas Pakistanis in UK/USA using real PayPal
  • Add Easypaisa/JazzCash verification as well
  • AI negotiator that suggests best price based on history
  • WhatsApp bot version

Built With

  • nextjs, supabase, postgresql, openai, whisper, paypal-api, braintree, tailwind, vercel

Built With

Share this project:

Updates

Submission history