posted an update

Going forward, we would like to let users simply upload any product instruction manual, and watch as our cutting-edge AI technology instantly comprehends its content. Then, harnessing the power of your smartphone camera, our platform seamlessly identifies your surroundings and pinpoints the product you're interacting with. While our current prototype focuses on OCR integration for text recognition, we aim to further enhance our platform by implementing real-time video processing capabilities, allowing users to receive guidance while viewing product demonstrations.

Empowerment lies at the heart of our platform. Once the user inputs their query, our intelligent model springs into action, deciphering the nuances and intricacies of their request. Not content with mere comprehension, our model goes the extra mile, proactively seeking clarification when needed to ensure crystal-clear guidance. Whether it's directing the user to rotate or manipulate an object, pinpointing the exact button to press among a myriad of options, or simply elucidating the function of a particular button, our AI-driven solution delivers unparalleled assistance tailored to each user's unique needs. Due to severe time constraints, integration of AR was not possible.

Our vision extends beyond individual applications to embrace a broader ecosystem of seamless integration and enhanced user experiences. Through the introduction of an API version of our app, coupled with reusable UI components and plugins, we aim to revolutionize the landscape of interactive guidance for physical products. Similar to the familiar walkthroughs encountered in software applications, our solution empowers companies to craft immersive experiences that gamify user interactions, elevating the overall product experience to new heights. Not only does this approach enrich user engagement, but it also delivers substantial cost savings by reducing the reliance on manual assistance and call center resources. With our innovative solution, companies can unlock a new realm of user-centric experiences while optimizing operational efficiency and resource allocation.

Log in or sign up for Devpost to join the conversation.