Physical products can only display a limited amount of information, and companies chose to display what sells - not what you need to know.
NutriMonsters overlays physical products with an AR-filter to only display the information you really need to know, stripping away any manipulative influence of brands or claims.
We used the logos of the NutriScore, a food labelling system already used throughout Europe (France, Spain, UK, Belgium, Switzerland, Germany). The NutriScore is a summary of the nutritional quality of foods. Its disadvantage is: consumers don't understand why a product gets a good or a bad rating. By choosing how much information to display at which distance, NutriMonsters helps consumers to quickly browse but also to see more detailed information when needed.
The MVP is an app for Android and MagicLeap: the app detects images through Vuforia and pulls nutritional information through a Rest API from OpenFoodFacts, the largest open-source food database with over 1 Million food products.
We see image recognition as an addition to barcode reading, not a replacement; The advantage of image recognition is when comparing two products at the same time; it is more intuitive and allows to recognize a product from further away than barcodes. We built this prototype with upcoming wearable glasses in our mind.
This technology is also applicable for diabetics (to show glycemic index/load), people with intolerances or people concerned about unethical or unsustainable products, especially in cosmetics.
We believe that primary packaging may be redundant in a world of deliveries. This AR shopping experience is an omnichannel experience that combines the advantages of the online world (variety) with the offline world (discovery) and sets us up for ghost supermarkets, where products wouldn't be in the store anymore but are displayed on displays.