Smart Kitchen Companion

Smart Kitchen home dashboard showcasing curated Italian recipes
Active recipe walkthrough screen for Creamy Herb Tagliatelle
Cooking controls interface featuring an 8-minute step timer with start/reset buttons
AI ingredient substitution popup
Pantry inventory selection interface allowing users to pick or search ingredients they currently have on hand
Recipe matches screen displaying dishes ranked by pantry availability percentages
Hands-free voice commands panel providing simulated Alexa voice triggers
Interactive shopping list view organized into "Need to Buy" and "In the Cart" sections

Inspiration

Cooking in a modern kitchen while following recipes on a phone or tablet is often frustrating—screens lock, hands are messy, and smaller screens are hard to read from across the counter. We wanted to transform the biggest display in many homes—the living room or kitchen TV—into an intelligent, hands-free cooking assistant. By combining Amazon Fire TV's wide 10-foot viewing experience with multimodal AI, Smart Kitchen Companion makes cooking seamless, interactive, and effortless.

What it does

Smart Kitchen Companion is a TV-native web application tailored for Amazon Fire TV that acts as a hands-free sous chef:

Curated Cuisines & Recipes: Features 25 recipes across 5 global cuisines (Italian, Indian, Mexican, Asian, Mediterranean).
10-Foot UI & Guidance: Large typography, high contrast, and visual step-by-step cards designed for easy reading from a distance.
Smart Step Timers: Built-in interactive timers for cooking steps to keep meal prep organized.
AI Ingredient Substitutions: Instant alternative suggestions powered by Gemini / Google AI Studio when an ingredient is missing or requires dietary adjustment.
Pantry Matcher: Filters recipes based on available ingredients in the user's kitchen to minimize food waste.
Hands-Free Assistance: Integrated voice guidance simulation and speech features for smooth step progression.

How we built it

Frontend & UI: Developed using React, TypeScript, and Tailwind CSS, structured specifically for 16:9 Fire TV screens.
AI Intelligence Engine: Configured Google AI Studio (Gemini) prompt architectures for ingredient substitution logic and pantry matching.
Rapid Prototyping & Hosting: Built and previewed in Bolt.new, then deployed live for instant browser-based interaction.
Version Control: Managed and published via GitHub (Smart-Kitchen-Companion-Alexa-FireTV).

Challenges we ran into

Designing for a 10-foot TV user experience presented unique UI/UX constraints compared to traditional desktop or mobile apps. We had to ensure text was legible from several feet away, keep interface controls clean, and optimize recipe cards for high contrast. Integrating dynamic AI substitution responses while keeping the workflow intuitive without overwhelming the user on a TV screen also required several iterations.

Accomplishments that we're proud of

Built a polished, fully interactive Fire TV web app MVP covering 25 detailed recipes across 5 cuisines.
Seamlessly combined step timers, AI substitutions, and a pantry matcher into a unified 10-foot interface.
Successfully pushed and hosted a clean, public open-source project directly to GitHub.

What we learned

We gained valuable insights into designing web applications specifically for TV platforms, leveraging generative AI for real-time contextual assistance (such as culinary substitutions), and rapidly building hands-free interface workflows for smart home ecosystems.

What's next for Smart Kitchen Companion

Deep integration with the Alexa Skills Kit (ASK) for hardware-level voice control using the Alexa Voice Remote.
Native syncing with Amazon Fresh and Alexa Shopping Lists to automatically add missing recipe items.
Personalized dietary filters (vegan, gluten-free, keto) and personalized AI meal planning.