- Inspiration:

The idea of AR-Guiñano arose from the need to democratize cooking and make it more accessible to people without prior experience. Many individuals stick to a limited set of dishes and waste ingredients due to a lack of culinary knowledge. By combining augmented reality, artificial intelligence, and cultural learning, we aim to transform the cooking experience into something practical, educational, and entertaining.

- What it does:

AR-Guiñano detects the ingredients available in the user's pantry using augmented reality glasses and generates personalized recipes based on cultural and gastronomic preferences. The application guides the user step-by-step through visual overlays, adaptive narration, and contextual alerts, ensuring accurate and educational meal preparation.

- How we built it:

We utilized a combination of advanced tools:

· Google AI Studio to train ingredient detection models.

· OpenAI GPT API for generating personalized recipes and cultural narratives.

· Unity with AR Foundation to create an immersive interface.

· MozillaTTS and Coqui TTS for adaptive narrations.

All these technologies work together to provide a cohesive and user-friendly experience.

- Challenges we ran into:

· Adjusting object detection models for various household environments.

· Creating an intuitive user experience that integrates natural gestures.

· Enriching recipes with cultural data in an attractive and educational manner.

- Accomplishments that we're proud of:

· Achieving accurate ingredient detection with customized models.

· Designing an interactive and adaptive AR interface.

· Delivering a culinary experience that promotes cultural inclusion.

- What we learned:

We learned to effectively integrate complex technologies like computer vision and natural language processing. Additionally, we discovered how personalization and cultural storytelling enhance the user experience and amplify its social impact.

- What's next for AR-Guiñano:

· Expanding multilingual and cultural recipe options.

· Integrating with IoT devices to optimize the cooking experience.

· Creating communities to share recipes and tips.

Built With

• apis
• bbdd:open-food-facts
• coquitts
• google-ai-studio
• google-mediapipe
• mozillatts
• openai
• unity-with-ar-foundation