CHOP CHOP: Your Hands-Free Cooking Assistant

Problem Statement

Many home cooks struggle with multitasking and managing their time effectively while preparing meals, which often leads to overcooked or undercooked food. College students and individuals with ADHD may also experience difficulties with procrastination and maintaining focus in the kitchen. CHOP CHOP aims to alleviate these challenges by providing a fun and interactive cooking experience that enhances coordination and multitasking abilities.

Solution Overview

CHOP CHOP is a hands-free cooking assistant that leverages Google Gemini for generative AI and optimized advice, alongside gesture control through the Leap Motion hand tracking sensor. By providing structured cooking tasks and leveraging AI to generate detailed task lists, our project helps home cooks manage their time and streamline the cooking process.

Key Features

1. Gesture Control with Leap Motion

   • Users can navigate tasks hands-free by utilizing gestures detected by the Leap Motion sensor:
     • Swipe Gesture: Move to the next task or fast-forward.
     • Tap Gesture: Add more time to the current task.
     • Clap Gesture: Pause or stop the timer.

2. AI-Powered Task Generation

   • Prompt Engineering: Users can input specific cooking prompts (e.g., “I want to cook a medium-rare sirloin steak with unchopped onions and chopped broccoli”).
   • Detailed Task Breakdown: The AI generates a structured list of cooking steps, including time estimates and coordination of overlapping tasks.

3. Interactive Task List

   • Each task in the list features a "Start" button with a countdown timer that dynamically updates based on user interaction (start, pause, fast-forward).
   • Users can easily visualize their progress through the cooking process.

How It Works

• User Input: Users provide a cooking prompt, and the AI generates a detailed task list tailored to their recipe.
• Task Management: Users can interact with the task list, starting timers and navigating tasks with gestures.

Technology Stack

• Frontend: Developed with Next.js to manage routing and user interactions efficiently.
• Backend: Integrates Google Gemini AI capabilities for prompt engineering and task generation.
• Gesture Control: Utilizes the Leap Motion SDK for accurate gesture recognition.

Future Developments

• Enhanced AI Integration: Further refinement of AI prompts to improve task generation accuracy and efficiency.
• Expanded Voice Command Features: Adding more voice functionalities for seamless kitchen assistance.
• User Feedback Mechanism: Implementing a system for users to provide feedback on tasks and improve the AI's learning process.

Conclusion

CHOP CHOP is designed to revolutionize the cooking experience for home cooks by combining gesture control, AI-driven task management, and voice commands. By addressing the challenges of multitasking and time management, we aim to enhance the overall quality of cooking and make meal preparation more enjoyable for everyone.

Built With

• leap-motion
• nextjs
• python