Inspiration

Cooking should be joyful, not stressful. We noticed that most recipe apps are cluttered, require constant screen interaction, and don’t adapt to users’ dietary needs or hands-free cooking. Inspired by the idea of a truly accessible, voice-driven kitchen assistant, we set out to build an app that listens, speaks, and guides users through every step—leaving their hands free for what matters most: cooking!

What it does

Voice Chef is a mobile-first web app that lets users discover, save, and cook recipes using only their voice. On first launch, users simply speak their dietary preferences. From then on, they can search for recipes by speaking a cuisine, dish, or ingredient, confirm their choice with a shake, and receive step-by-step spoken instructions while cooking. The app highlights the current step, auto-scrolls instructions, and allows users to pause or resume the narration—all with a clean, intuitive interface.

How we built it

Single shot with bolt!

Challenges we ran into

  • Ensuring accurate speech recognition across diverse accents and noisy environments.
  • Smoothly synchronizing TTS narration with dynamic text highlighting and auto-scrolling.
  • Handling device shake detection reliably across different browsers and hardware.
  • Creating a seamless, intuitive onboarding flow with minimal UI elements.
  • Managing API rate limits and response variability from the recipe API.

Accomplishments that we're proud of

  • Achieved a truly hands-free, voice-first cooking experience.
  • Designed a clean, distraction-free interface that adapts to user needs.
  • Integrated multiple modern web APIs (Speech, DeviceMotion, Talkify) into a cohesive experience.
  • Enabled users to save and revisit favorite recipes with a single tap.
  • Delivered accessibility features that make cooking more inclusive for everyone.

What we learned

  • The importance of clear, concise voice prompts to guide user interactions.
  • How to combine speech recognition, TTS, and device sensors for innovative user experiences.
  • The value of persistent storage for personalizing and simplifying repeat app usage.
  • Best practices for mobile-first, accessible design in web applications.

What's next for Handy Recipes

  • Voice-activated timers and ingredient checklists for even more hands-free convenience.
  • Personalized recommendations based on saved preferences and past searches.
  • Multi-language support for global accessibility.
  • Integration with smart kitchen devices for a fully connected cooking experience.
  • Community features for sharing and rating recipes.
  • Offline mode for uninterrupted kitchen assistance.

Built With

Share this project:

Updates