Inspiration

We wanted to explore a simple idea: what if ordering a pizza was as easy as asking for one?

Traditional food ordering involves searching menus, clicking through options, customizing items, and managing the cart. We wanted to make this experience more natural by allowing users to simply talk to the website.

What it does

Voice Enable Pizza App is a voice-first pizza ordering experience powered by OpenAI and WebMCP.

Users can talk naturally to the AI to browse pizzas, customize their order, add or modify items in the cart, and review their order.

Instead of the AI just telling the user what to do, it can actually interact with the web application through WebMCP tools and perform the requested actions.

How we built it

We built the application using React for the frontend and integrated an OpenAI-powered voice agent using an OpenAI API key.

We exposed the key pizza ordering capabilities through WebMCP tools, allowing the AI agent to understand natural-language requests and interact with the web application.

This connects voice conversations directly to real actions such as browsing pizzas, customizing items, and managing the cart.

Challenges we ran into

The biggest challenges were making voice interactions feel natural, handling ambiguous or incomplete requests, designing reliable WebMCP tools, and keeping the AI's understanding synchronized with the actual application state.

We also had to carefully design the interaction between the voice agent, WebMCP tools, and the React application so that actions performed by the AI were correctly reflected in the UI.

Accomplishments that we're proud of

We're proud that we built more than just a voice chatbot. The AI can actually interact with a website and perform actions using WebMCP.

We successfully connected natural voice commands with a real pizza ordering flow, creating an experience where users can simply describe what they want instead of manually navigating every step.

What we learned

We learned that building an AI agent that can take real actions requires much more than generating good responses. Tool design, state management, context, and handling ambiguous user requests are equally important.

We also learned how WebMCP can provide a powerful bridge between AI agents and web applications, enabling agents to interact with websites in a structured way.

What's next for Voice Enable Pizza App

We want to make the voice experience more conversational and robust, improve personalization and order recommendations, and expand the range of actions the agent can perform.

Beyond pizza, we believe the same approach could be applied to e-commerce, restaurant ordering, travel, bookings, and many other web applications — creating a future where users can tell websites what they want instead of learning how to navigate them.

Built With

Share this project:

Updates

Submission history