ScanWell | Team MapMinds

Showcasing the different onboarding screens when the application is opened. Gives the brief idea on the features available to utilize.
Showcasing product navigating screen in AR, through the camera of the phone. Helps users to navigate with the help of AR AI assistant.
Setting up the health profile. Critical data for the AI to use the data and make smart decsions while purchase and shopping.
User scan the product, AI powered search will showcase the nutrient details, allergen details and much more for the users.
Checkout of the product through the ScanWell application.
AR/VR visualization of the current screens of ScanWell application for Product Details.
AR/VR visualization of the current screens of ScanWell application for Payment process.
Showcasing the initial 4 steps of the products user flow.
Showcasing the last 4 steps of the products user flow.

Inspiration

Living with food allergies can make even simple tasks like grocery shopping feel overwhelming and isolating. With hidden allergens, confusing product labels, and limited real-time guidance, people often struggle to make safe and informed choices. We were inspired to solve this problem using the power of Augmented Reality (AR) and Artificial Intelligence (AI) to create an engaging, supportive, and seamless shopping experience for individuals managing allergies and health-conscious lifestyles.

What it does

ScanWell is an AR-powered mobile app that transforms the grocery shopping experience for people managing allergies and health goals.

Personalized Health Profiles: Users can create customized profiles with dietary restrictions, allergens, and health goals.
Real-Time AR Product Scanning: Instantly scan products in-store to reveal allergen warnings, nutritional details, and eco-friendly ratings.
AI Shopping Assistant: A 3D animated virtual assistant guides users through their shopping journey, offering personalized product suggestions and healthier alternatives.
Gamified Sustainability Rewards: Encourages users to make eco-conscious choices by earning rewards for sustainable shopping.

How we built it

User Flow & UI Design: Designed the user interface and experience in Figma, focusing on a seamless integration between mobile UI and AR elements.
3D Modeling & Animation: Used a pre-made AI assistant model from Sketchfab and animated it using Mixamo for natural interactions.
3D Store Visualization: Created realistic store environments and product scanning scenes using SketchUp and rendered them in Enscape.
Video Production: Compiled and edited the demo video using Clipchamp and DaVinci Resolve, combining Figma screens with 3D visuals to simulate the user experience.
AR Concept Exploration: Explored Immersal SDK for AR navigation, but due to technical complexity, it was not fully implemented in this version.

Challenges we ran into

Technical Barriers with AR Integration: Implementing real-time AR navigation using SLAM technology was more complex than anticipated, limiting us to showcasing the concept rather than building a functional prototype.
Limited Development Time: Balancing design, animation, and video production within the short timeline made full implementation challenging.
Blending AR with UI Design: Creating a smooth user experience that transitions between standard app features and immersive AR interactions was difficult.
Hardware Limitations: Lack of access to AR/VR headsets restricted our exploration to mobile AR, limiting the dynamic features we envisioned.

Accomplishments that we're proud of

Successfully developed a well-researched and user-centered concept addressing a real-world problem.
Designed and animated a 3D AI assistant to enhance user interaction in the app.
Created an engaging 60-second demo video combining UI prototypes and 3D visuals to effectively communicate our solution.
Explored advanced AR tools like Immersal SDK, even though full integration wasn’t possible.
Seamlessly collaborated as a team to adapt ideas and deliver a polished presentation despite technical challenges.

What we learned

Gained valuable insights into integrating AR and AI technologies for practical, user-centered applications.
Improved our teamwork and adaptability, responding quickly to feedback and finding creative solutions within time constraints.
Create UI for the AR application, where micro-interaction and haptic feedback for the user input.
Meta UI kit along with Apple's Vision Pro UI usage and guidelines.
ShapesXR as an prototyping tool for the AR/VR environment for a designer.
Taking feedback constructively from the mentors and each other as a team.

What's next for ScanWell | Team MapMinds

AR Navigation Integration: Fully implement SLAM-based AR navigation to guide users through stores in real-time.
Advanced AI Personalization: Develop smarter AI-driven recommendations that adapt to user preferences and habits over time.
AR Glasses Expansion: Extend the app to AR glasses and MR headsets for a hands-free, immersive shopping experience.
Community Features: Build a supportive community where users can share tips, product reviews, and healthy living goals.

Built With

aftereffects
blender
chatgpt
davinciresolve
enscape
figma
shapesxr
sketching
sketchup
veedai

Submitted to

XR Design Challenge

Created by

Worked on the process flow development as a product. Created UI POC screens for 2D application along with AR/VR environments. Combining all the process flow created, visual storytelling, UI screens, 3D environment created working protype of the product was created for multiple features showcased. In addition to this, worked on the video created for the teaser.

Supragna K
Worked on concept development, project ideation, and 3D environment design. Curated content to align with the project’s visual storytelling. Created animations for the 3D AI assistant to enhance user interaction within the environment and managed the iterative feedback loop to refine the design. Contributed to the final video and created a Future Scope video showcasing the project’s potential in immersive environments.

Manali Bansode