Inspiration
Have you ever attempted calorie counting by hand? It wears you out. We came to the conclusion that the most significant obstacle to upholding a healthy lifestyle is not a lack of drive, but rather the difficulty of tracking. Weighing quantities, typing in item names, and looking up nutritional information one at a time are laborious tasks that frequently cause people to give up midway through.
We desired a different kind of interaction one that is more immediate, more sympathetic, and more human. Imagine carrying around a personal dietitian who truly understands you rather than just crunching stats. GastroGuard, a "Personal Health Guardian" that transforms a tedious task into an organic dialogue, was born.
What it does
GastroGuard is an AI-powered health assistant that monitors and records every calorie intake using a multimodal approach. Its core workflow is designed for speed and ease:
- User Action: The user selects a mealtime (e.g., "Lunch").
- AI Activation: An interactive chatbot opens immediately.
- Multimodal Input: Users can input what they are eating via Text, Voice, or simply by snapping a Photo of their food.
- Intelligent Analysis: GastroGuard analyzes this input to break down complex nutritional data and check for food safety (e.g., for users with specific conditions like gastritis).
- Report: Within seconds, the user receives a comprehensive nutritional report along with personalized health advice.
How we built it
The heart of GastroGuard is Gemini 2.5 Flash, the latest AI model that enables deep multimodal context understanding. We built this application with a user-centric architecture:
- Frontend: React Native/Web with an intuitive chat interface.
- Backend: Python Flask managing business logic and AI orchestration.
- Core Engine: Gemini 2.5 Flash integration for vision processing (food images) and natural language understanding (text/voice).
One of our key features is accurate nutrient density calculation. To guarantee this precision, we integrate the FatSecret API, ensuring all nutritional data is sourced from a globally recognized and accurate food database. We use the following formula to ensure every recorded calorie matches real-world portions:
Total Calories = Sum (Weight × (Calorie Density / 100))
Where Weight is the estimated weight of the food component and Calorie Density is the energy density per 100 grams sourced directly from FatSecret.
Challenges we ran into
The biggest challenge we faced was "The Quota Wall". During the development, we relied heavily on the Free Gemini AI Quota. However, due to the complexity of multimodal analysis (especially image processing), we frequently hit API Rate Limits very quickly. The application often became unresponsive/error in the middle of demos.
Accomplishments that we're proud of
- Seamless Multimodal Experience: Successfully integrated image and voice inputs so users can log meals in under 5 seconds.
- Context-Aware Analysis: Our AI doesn't just count calories, it provides safety warnings (like "Warning: Spicy!") for users with sensitive stomachs.
- Premium UI/UX: Created a clean, responsive interface that feels "premium," encouraging users to keep interacting with the app.
What we learned
We learned that sometimes "less is more" from this endeavor. We developed our efficiency when working with resource-constrained APIs, such as the Gemini Free Tier. The largest model's entire power isn't needed for every query. We discovered how to strike a balance between the response speed that users require and the accuracy of complex AI models. Additionally, we discovered that developing a chatbot is more important for the user's comfort than the bot's intelligence.
What's next for GastroGuard
We believe this will be our next course of action :
- IoT Integration: Connecting GastroGuard with smart scales or wearables for real-time health data.
- Community: Adding social features where users can share healthy recipes and achievements.
- Premium Tier: Access the Gemini Ultra model without quota limits for deeper micronutrient analysis.
Built With
- axios/fetch
- css3
- fatsecretapi
- flask
- googlegeminiapi
- python
- react
- typescript
- vite
Log in or sign up for Devpost to join the conversation.