HealthHero

Login Page
Home Page
Capture Page

Inspiration

Our app was inspired by our experiences at hackathons fueled by snacks, caffeine, and little sleep. Feeling the impact of these choices, we built an arcade-style health app that uses image recognition to score food and track daily health, giving real-time insights into balanced choices.

What it does

Login Authentication: Secure login via email or Google Sign-In via Firebase.
Homepage: Displays an avatar with heart and gut health bars.
Capture Page: Allows users to upload images of food, which our AI analyzes to update a health score based on food choices.
Past Results Storage: Keeps track of previous food scores to help users monitor diet patterns using Firestore database. It also identifies potential allergens in the food.
Real-Time Health Bar Updates: Health bars on the avatar page update with each food image upload, showing real-time feedback on heart and gut health for balanced choices.

How we built it

React Frontend: Organized modularly with key pages like Login, Home, and Capture.
Firebase Authentication: Supports secure email/password and Google login, using React Context for global access to user session data.
Health Scoring with OpenAI: The Capture page uses OpenAI’s API to analyze food images, scoring them as “Good,” “Neutral,” or “Bad” for heart and gut health.
Real-Time Health Updates: Firebase Firestore stores health scores and history, dynamically updating heart and gut health bars on the avatar based on food choices.
Modular Components: Custom components (HealthBar, Navbar, etc.) provide an arcade-inspired interface, showing real-time health insights based on user actions.

Challenges we ran into

We first started with a React-Native app but realized there is a learning curve for making an Android app. Therefore, we switched to a React web app, so we can have a working product.
We also did not fully design the layout before working on our separate tasks, so we had to resolve a lot of merge conflicts.

Accomplishments that we're proud of

We have a working product and became merge masters⚔️(kind of).
Our UI / UX also follows the 90s Japanese Arcade theme well given the time constraint.

What we learned

We learned about authentication using Firebase and storing user data using Firestore. Using CSS and JavaScript, we also learned about React states and structuring an app.
Knowing how to resolve merge conflicts and merging often is good.

What's next for HealthHero

Develop a Custom LLM: Build a specialized language model for image and motion capture recognition. This would allow users to log not only food but also photos or videos of physical activities (like running or sauna sessions) for health tracking.
Launch on iOS/Android: Release a mobile app, enabling users to easily snap photos on the go to keep their avatar healthy and maximize their health score.
Personalized Food Insights: Provide future-focused food recommendations, suggesting healthier alternatives and assessing portion sizes for balanced eating—not just food quality but also quantity.
Expand Health Metrics: Grow the user base and partner with private healthcare clinics to add health bars for additional metrics (e.g., skin, colon). With user consent, integrate clinic data such as bloodwork and checkups to enhance the health bars and deliver targeted health recommendations throughout the day.
Wearable Integration: Partner with Garmin or Apple Watch to incorporate not only uploaded images and food photos but also health metrics from iOS Health and smartwatch data. This comprehensive data flow keeps health bar status accurate and dynamic.
Personalized Avatars: Enhance the user experience with custom arcade-style avatars unique to each person. Use an AI model to create personalized icons or offer a large selection of avatar profiles, so everyone feels like the hero of their own health game.
Gamification Features: Introduce a reward system with badges, points, and prizes for health achievements. Users earn awards for consistently maintaining their health bars above target scores, completing challenges, or achieving milestones in areas like heart health, exercise, and balanced diet. Leaderboards, streaks, and leveling up add a competitive edge, motivating users to stay engaged and achieve long-term health goals.