Inspiration
Believe it or not, the retail industry is DYING. Online giants such as Amazon are taking over! Retail stores are struggling to keep up and need to embrace new way of visualizing data. Our product aims to provide in-depth analysis of product placement and an insight into the customer mind. It's like “putting yourself in their shoes”, literally.
What it does
HoloAnalytics uses data about customer locations in your store to generate a heat map of popular paths that your customers take. This is done by generating a cluster map using Azure machine learning. The map is projected onto the floor, and allows you to walk through the store seeing dominant areas and paths. You can then look at an item and ask for additional financial metrics to see how well the product is selling. It's easy to then see how these products are affected by their placement. You might see that a certain product sells well when placed beside another, or in a certain area.
How we built it
Our project was built in the Unity game engine and programmed in C#. Using the Azure API, we were able to generate a heat map displaying foot traffic in a store. Furthermore, we used the Vuforia API in order to have additional information displayed when the Hololens camera is pointed towards the product pricing labels.
Challenges we ran into
Coupling speech to unity commands Setting up Vuforia Generating plot image
Accomplishments that we're proud of
Seeing the project all the way through the end Each member feels is happy with their completion
What we learned
Hololense voice commands Hololense gaze commands Azure ML studio Unity
What's next for project
Adding features to detect whether the product is placed correctly (organize vs messy arrangement, vertical arrangement vs horizontal, whether products should be placed together (example: milk and bread should not be placed side by side
Built With
- azure
- c#
- cognitive
- machine-learning
- microsoft-hololens
- unity
- voice

Log in or sign up for Devpost to join the conversation.