PhiaBuy

Inspiration

I was inspired by Amazon Alexa to shop like that, but for all shops, not just the Amazon store.

What it does

A browser extension that finds the clothing you want from social media and automatically checks it out and confirms purchases through voice commands.

How we built it

We use Zo to host the shopping agents powered by Gemini that go find clothing on Uniqlo, and we use Playwright to navigate the site to the checkout page. This backend is accessed via an endpoint that the Chrome extension calls when the user activates the extension via AssemblyAI voice commands. We use TypeScript to render the overlay.

Challenges we ran into

We struggle with automating the browser on the shopping site's iframe display in our overlay due to certain sites not allowing it, or iframes being out of sync with the page.

Accomplishments that we're proud of

Finding a workaround for the browser automation.

What we learned

Browser automation is not there yet.

What's next for PhiaBuy

Hopefully, we can make it work on all clothing sites without issues.

Built With

• assemblyai
• gemini
• playwright
• typescript
• zo