MirrorMe

Your buddy on campus!
Your buddy at night!
Communicate with your buddy via voice commands and facial recognition!

Inspiration

A great friend makes a huge difference! MirrorMe introduces a buddy you can always have with you for positive reinforcement and mindfulness. Your buddy has a lot of personality and loves to join you in whatever activity you're doing, whether it's spending some time to focus and study or taking a mid-day siesta.

What it does

MirrorMe uses speech and facial recognition to update user models which alter your buddy's behavior and actions. Speech-to-text allows your buddy to join in on recognized activities and respond back to the user. Machine learning allows your buddy to select activities which are most successful in improving mood and healthy habits.

Challenges we ran into

Navigating potential frameworks for the project was a difficult journey. Between implementations as a web app or storage options for potential databases, the choices were endless. Learning tools like Microsoft Azure, Google Cloud Natural Language, Google Cloud Speech to Text, and Flask were also big time commitments. Additionally, generating animations in HTML and CSS pushed the limits of our planning skills!

What's next for MirrorMe

MirrorMe taps into psychology research which promotes community and self-reflection in positive habit building. Adding in more responses and actions to help your buddy would greatly improve bonding and boost your buddy as a companion. Realtime links between input and responses would also help make smooth transitions and create a more natural experience.