HeySalad - Your AI Food Analysis Companion
Inspiration
In today's fast-paced world, making healthy food choices can be challenging. We noticed that while many nutrition apps exist, they often require manual logging of ingredients or scanning barcodes, creating friction in the user experience. We wanted to build something that could instantly analyze food with a simple photo and provide personalized nutritional insights powered by Azure AI services.
HeySalad was born from our shared passion for technology and healthy eating. We believe that making informed dietary choices should be accessible to everyone, regardless of their nutrition knowledge.
What it does
HeySalad is an AI-powered food analysis application that lets users:
- Take a photo or short video of any meal
- Receive instant nutritional information (calories, macros, etc.)
- Get personalized recommendations based on dietary preferences
- Track compatibility with specific diets (Low Carb, High Protein, Vegetarian, etc.)
- View a health score that rates the nutritional value of the meal
Our AI assistant, Kelly, provides friendly, actionable insights that help users understand not just what's in their food, but how it aligns with their personal health goals.
How we built it
HeySalad leverages several Azure technologies to deliver a seamless experience:
- Frontend: React with TypeScript and TailwindCSS for a responsive, modern UI
- Image Analysis: Azure Computer Vision for food recognition and ingredient detection
- Nutritional Analysis: Azure Functions to process the identified ingredients and calculate nutritional values
- Personalization Engine: Azure Machine Learning to tailor recommendations based on user preferences
- Data Storage: Azure Cosmos DB to store user profiles and dietary preferences
- Authentication: Azure AD B2C for secure user management
- Deployment: Azure Static Web Apps for hosting the application
We designed HeySalad with a vibrant, appealing brand identity using a color palette of Cherry Red, Peach, and Light Peach, with custom typography to create a friendly, approachable experience.
Challenges we ran into
Building HeySalad wasn't without its challenges:
Food Recognition Accuracy: Training the AI to accurately identify complex dishes and estimate portion sizes required extensive refinement.
Nutritional Database Integration: Creating a comprehensive system to map identified ingredients to accurate nutritional data proved challenging.
Real-time Performance: Optimizing the analysis to deliver results within seconds while maintaining accuracy required careful engineering.
Cross-browser Camera Support: Ensuring consistent camera functionality across different devices and browsers required additional testing and adaptations.
Azure Service Integration: Orchestrating the various Azure services to work together seamlessly took significant effort, particularly when handling authentication flows.
Accomplishments that we're proud of
Despite these challenges, we achieved several key milestones:
- Created an intuitive, friction-free user experience that makes nutritional analysis accessible
- Achieved high accuracy in food identification across a wide range of cuisines and presentation styles
- Built a responsive application that works well on both desktop and mobile devices
- Implemented a sophisticated recommendation system that provides personalized, actionable advice
- Developed a cohesive design system that creates a delightful, engaging user experience
What we learned
This hackathon taught us valuable lessons about:
- Azure AI capabilities and how to optimize them for specific use cases
- The complexities of nutritional analysis and food recognition
- User experience design principles for health applications
- Cross-functional collaboration between AI, frontend, and backend development
- Effective integration of multiple Azure services into a cohesive application
What's next for HeySalad
We're excited about HeySalad's future and have several planned enhancements:
- Meal Planning: Generate personalized meal plans based on user preferences and goals
- Social Features: Allow users to share meals, recommendations, and achievements
- Integration with Wearables: Connect with fitness devices to provide more personalized recommendations
- Grocery List Generation: Create shopping lists based on recommended meals
- Restaurant Menu Scanner: Analyze restaurant menus and provide suggestions for healthier options
- Extended Food Database: Expand our food recognition capabilities to more diverse cuisines and ingredients
HeySalad is just the beginning of our journey to make healthy eating more accessible and enjoyable through AI-powered insights. We believe that with the right information at the right time, everyone can make better food choices that align with their health goals.
Log in or sign up for Devpost to join the conversation.