Inspiration
We can identify the challenges faced when using the current solution from a YouTube video titled "How a Blind Person Shops Online."
In the video, she had to touch various parts of the screen to obtain information. This approach significantly restricts usability, as the user must move the scanning box for each text box displayed.
To utilize voice input, one must first locate the search box on the screen, activate the keyboard, and then press the microphone button on the keyboard.
Doesn't that already seem quite complex?
What it does
KALON offers a user-friendly conversational voice interface that simplifies the entire online shopping process for everyone, from searching to checking out.
Having someone knowledgeable about product information makes it much easier to find what you want. That's why a conversational AI shopping assistant is necessary. This shopping assistant will also provide insights about products during the conversation, helping you find the items you truly need.
With this system, anyone who can engage in a conversation will have access to a similar level of usability and experience. Through conversation, we can offer users more relevant product recommendations.
How we built it
We can implement the shopping assistant AI with Chat GPT API. To make it interact with voice, Whisper API needs to be integrated. The products and the customers' information are to be embedded with Chat GPT so that it can give the users relevant and updated recommendations and consulting.
Challenges we ran into
It was challenging to empathize with the user's pain points, as we are all able-bodied and sighted individuals. In order to create a unique shopping experience, we had to comprehend the real-life difficulties and challenges they face.
It was the first time the UX/UI designers worked on a project where they had to concentrate on voice UX design, as a result, they were learning as they went.
Additionally, it was difficult to find the appropriate expertise to implement the solution. Our goal was to develop a minimum viable product (MVP), but we were uncertain about the best approach.
Accomplishments that we're proud of
We established a solid brand identity and came up with a very profound solution that everybody can take advantage of.
What we learned
We hadn't previously recognized the challenges people with visual impairments encounter in their lives. However, we took the time to understand their experiences and consider how we could help. For instance, we studied Menena Cottin's "Black Book of Colors" to comprehend how to communicate colors to a blind person.
Gaining this understanding allowed us to empathize with their struggles and informed our approach to designing a more inclusive solution. By focusing on accessibility, we were able to create a product that addresses the unique needs of visually impaired individuals while also offering a user-friendly experience for everyone.
What's next for KALON
We will make a prototype so that we can test our solution on the market.




Log in or sign up for Devpost to join the conversation.