Inspiration
I had the opportunity to hear a visually impaired women tell her story of how she is unable to know the color of her lipstick before applying it - because all lipstick containers from a given cosmetic manufacturer are the same for all colors. While discussing this problem with other women, the ones that have become far sighted (as they have gotten older) informed me that they cannot read the labeling on cosmetic containers and packaging due to the small print. Additionally, they communicated that they cannot remember how long they have had a product and their concerns of using mascara and products containing sunscreen beyond their expiration. One women informed me that her dermatologists always asks if she is using makeup with sun protection and whether she makes sure that the sun protection has not expired. This is difficult for her.
What it does
A programed chip is placed on the cosmetic container. The chip is programmed with two values: the product description, e.g. Rebellious Rose Pure Color Lipstick and a number that denotes whether the expiration of the product should be remembered, e.g., a 1 means that the product expires.
A mobile app reads the product description and the expiration denotation (number). The app speaks the product description for the user, and when applicable, speaks the number of days remaining until the product expires.
How we built it
The chip was programmed using an app that is available in the App Store (ST Micro NFC Tap) and the mobile app was written using Apple's Swift programming language and Xcode development environment.
Challenges we ran into
Estee Lauder lipstick and mascara containers are made of metal. Metal interferes with the wireless communication between the chip's embedded antenna and a cell phone's antenna. I solved this problem by 3D printing a small plastic backing that I placed between the chip and the metal makeup container. The plastic backing acts an an electromagnetic insulator, which keeps the metal from scattering the wireless signal.
Accomplishments that we're proud of
This app provides an elegant solution in that it is simple for the user while the technology that the user does not see is complex.
What we learned
This project provided an opportunity for me to learn the importance of feeling beautiful and some of the challenges that women experience with impaired vision while selecting and using cosmetics. Additionally, it provided me with awareness of including accessibility in mobile apps and how to implement it using Apple's programming frameworks.
What's next for Cosmetic Helper
I would like to see this app become a feature in Estée Lauder's new Voice-Enabled Make-up Assistant app. I would also like to see this app enhanced in two ways: by adding the ability for the user to reorder the product that the app interacts with and by adding an App Clip (a short version of the Voice-Enabled Make-up Assistant app) that is launched (even without downloading the app from the App Store) just by using a phone to read the chip that I have placed on the makeup containers. I have researched this capability and know that this is possible.
