Inspiration
We believe the future of human-computer interaction is thought. While the technology isnt there yet - voice, the most basic way we communicate, is a big step towards creating ultra-fast & intuitive web interactions. We wanted to see how far we can go with voice interfaces, rethink and redesign a fully voice-native UI, where everything can be steered by speech.
What it does
We are building a fully-voice driven product discovery experience for ecommerce where users navigate and explore products entirely by speaking - no clicks, no typing. We focus on outdoor activities (tents+backpacks) in our PoC. The user can currently:
- Start shopping by voice - "I need a lightweight tent for hiking"
- Customly filter products/adjust prefferences - "Show only fully-waterproof ones"
- Comparing wide range of products
- Reselect and expand on product offer
- Add to favourites
- Summarising and checking out the session
How we built it
- Source the data from the largest outdoor products supplier
- Transcribe query with Whisper
- GPT downstream processing (function calling for specific steps)
- Elevenlabs TTS to engage with user
Challenges we ran into
- Processing voice input and output with unpredictable LLMs.
- Lack of sleep :)
Accomplishments that we're proud of
Our app is the future of not only ecomerce, but all of the web interactions, that are going to change rapidly.
Actually building out a working MVP - in 24h we successfully expressed the concept of our vision in a very nice looking and actually working web app.
What we learned
The most important lesson that we took is loosing on every single step of our journey, many, many times to at the end finish our amazing app before 24h deadline came. The hard work does pay off - this is what we’ve learnt.
What's next for Revoice
- Making the UX faster and more efficient.
- Adding more feature for users to much easier iterate over wide range of products available in our api.
- Creating products collections and tags.
- Adding custom display types (instead of just regular grid)
better version of video is also here: https://www.loom.com/share/dc3880898cfb4e989801541f5f579d52?sid=c5178e64-fedd-429e-b699-a48527ce6d08
Built With
- aceternity
- elevenlabs
- fastapi
- gpt-4o
- openai
- tailwind
- typescript
- uv
- vite
- whisper
Log in or sign up for Devpost to join the conversation.