Inspiration
In Pakistan, my khala who sells handmade suits loses 30% income to fake payment screenshots. My freelancer cousin waits weeks for international clients to pay. 5M+ SMBs face the same: they can't make professional invoices, they get scammed by fake receipts, and clients delay payments.
We wanted to build an AI trust layer over PayPal that even a street vendor can use by just speaking in Urdu.
What it does - TrustPay AI (4-in-1)
1. Voice2Invoice: Vendor says "Usman ko 2 jore 8000 ka" in Urdu/Punjabi -> Whisper AI transcribes, GPT-4o extracts amount & items, creates PayPal Invoice API link instantly. Hands-free, no typing needed.
2. Scam Shield: User uploads any Easypaisa/PayPal payment screenshot -> Our AI OCR + pattern detection checks if it's FAKE or REAL. We also detect buyer anxiety via typing speed/mouse movement and auto-hold suspicious payments via PayPal Dispute API.
3. Smart Escrow: For freelancers - AI verifies work by checking GitHub commits or Figma links. If deliverable is complete, it auto-releases payment via PayPal Braintree/Payouts. No more "work ke baad block".
4. Group Hisaab: AI splits group bills intelligently (who ordered what) and sends PayPal.me links with polite AI-generated reminders.
How we built it
- Frontend: Next.js 14, Tailwind CSS, shadcn/ui
- Backend: Supabase (PostgreSQL) for invoices & users
- AI: OpenAI Whisper for Urdu voice, GPT-4o for extraction, Tesseract OCR for screenshot fraud check
- PayPal: Sandbox Invoice API, Payouts API, Dispute API, QR Code API, Braintree SDK, PayPal.me links
- Deployment: Vercel
Challenges we ran into
- Urdu/Punjabi voice recognition accuracy was low - solved by fine-tuning Whisper with local accents
- PayPal doesn't officially work for domestic Pakistan payments, so we built it on Sandbox with global SMB vision
- Detecting fake screenshots is hard - we used OCR + metadata + font inconsistency check
Accomplishments that we're proud of
- Built 4 PayPal APIs integration in 5 days
- Voice invoice works in 3 languages (English, Urdu, Punjabi)
- 95% accuracy on fake screenshot detection in our tests
What we learned
Small vendors don't need complex dashboards - they need 1-button voice solutions. And PayPal's Invoice + Dispute APIs are super powerful when combined with AI.
What's next for TrustPay AI
- Launch for overseas Pakistanis in UK/USA using real PayPal
- Add Easypaisa/JazzCash verification as well
- AI negotiator that suggests best price based on history
- WhatsApp bot version
Built With
- nextjs, supabase, postgresql, openai, whisper, paypal-api, braintree, tailwind, vercel
Built With
- braintree
- gpt-4o
- nextjs
- openai
- paypal
- paypal-invoice-api
- postgresql
- supabase
- tailwindcss
- tesseract-ocr
- typescript
- vercel
- whisper