💡 Inspiration

Online shopping has become convenient, but finding the right product is still time-consuming. People often switch between multiple shopping platforms, compare dozens of products, check reviews, manage different carts, and struggle to keep track of their purchases.

We asked ourselves a simple question:

What if you could simply tell an AI what you need, and it could handle the entire shopping journey for you?

That idea inspired us to build CartPilot AI — an intelligent, voice-powered shopping assistant that puts the user in control while making shopping smarter, faster, and easier.

🚀 What It Does

CartPilot AI transforms traditional online shopping into an AI-assisted experience.

Instead of manually searching through products, users can describe what they want in natural language or use voice commands.

Our platform aims to provide:

  • AI Shopping Assistant: Understands user requirements, budgets, preferences, and product specifications.
  • Smart Product Discovery: Finds relevant products and helps users explore suitable options.
  • Intelligent Comparison: Compares products based on price, specifications, ratings, and other available information.
  • Voice-Powered Navigation: Allows users to control different sections of the application using natural voice commands.
  • Smart Shopping Cart: Helps users manage selected products and review their purchases.
  • PayPal Checkout: Enables secure payment through PayPal's Sandbox integration.
  • Unified Shopping History: Brings CartPilot purchases and authorized or user-imported external shopping records into one dashboard.
  • AI Spending Insights: Helps users understand their shopping habits and spending patterns.

Our core principle is simple: AI can assist with shopping decisions, but the user always makes the final purchase decision.

🛠️ How We Built It

We designed CartPilot AI as a full-stack AI-powered application.

Our technology stack includes:

  • Frontend: React.js, Tailwind CSS, and Google Stitch-generated UI components.
  • Backend: Python and FastAPI.
  • AI Intelligence: Google Gemini API for natural-language understanding, conversational assistance, and product recommendations.
  • Product Discovery: Channel3 API integration architecture for product discovery.
  • Database: SQLite with SQLAlchemy.
  • Payments: PayPal REST API and PayPal JavaScript SDK using Sandbox.
  • Voice Interaction: Browser-based speech recognition and speech synthesis where supported.

We focused on building a modular architecture so that additional shopping platforms, product providers, and AI capabilities can be integrated in the future.

🧩 Challenges We Faced

One of our biggest challenges was designing an AI shopping assistant that does more than simply respond to questions.

We wanted the AI to understand user requirements, interact with different application features, and execute meaningful actions.

Another challenge was integrating voice commands with application navigation and shopping functionality while maintaining a smooth user experience.

We also had to consider the limitations of external shopping platforms. Not every marketplace provides public APIs for accessing individual customers' purchase histories or completing purchases through third-party applications. We therefore designed our unified shopping history around authorized integrations, receipt imports, and manual imports rather than relying on unauthorized access.

Integrating secure payment processing was another important challenge. We designed the PayPal checkout flow to validate transactions on the backend and require explicit user approval before payment.

📚 What We Learned

Building CartPilot AI helped us understand how AI can be combined with real-world applications to solve everyday problems.

We explored:

  • Integrating generative AI into practical applications.
  • Building full-stack applications using React and FastAPI.
  • Designing voice-driven user experiences.
  • Working with payment APIs and secure transaction flows.
  • Structuring databases for shopping and order management.
  • Designing modular integrations with external platforms.
  • Balancing automation, security, and user control.

🌟 What's Next?

We envision CartPilot AI becoming a unified intelligent shopping companion that works across multiple shopping platforms.

Our future goals include expanding multilingual voice interaction, adding more authorized marketplace integrations, improving personalized recommendations, and introducing smarter shopping automation.

CartPilot AI — One Voice. Smarter Shopping. You're Always in Control.

Built With

Share this project:

Updates

Submission history