posted an update —

Hugo Tour Guide

A next-generation AI travel companion designed to offer personalized, immersive experiences while you explore new cities and cultures. By combining state-of-the-art natural language processing, voice interactivity, and intelligent route planning, Hugo Tour Guide transforms the way you travel.


Inspiration

We are passionate travelers who spend up to two months each year exploring the world. However, traditional travel guides and packaged tours often fall short when it comes to truly personalized, in-depth experiences. We frequently find ourselves piecing together recommendations from diverse sources such as Reddit, Google Reviews, and local forums—resulting in disjointed itineraries and inefficient planning.

Moreover, the idea of hiring a local guide, though appealing, is often cost-prohibitive (typically over $200 per day) and can be hindered by language barriers. With experiential travel on the rise—72% of consumers in a Booking.com survey expressed a preference for immersive, culturally rich experiences over generic sightseeing tours—we saw an opportunity. We envisioned an AI that could serve as a knowledgeable, interactive, and multilingual travel companion, effectively replacing the traditional local guide.


What it Does

Hugo Tour Guide is your personal AI travel companion that adapts to your interests and journey in real time. Key features include:

  • Dynamic Preference Capture:
    Through voice or text interactions, the AI gathers details such as age group, occupation, hobbies, culinary interests, art, history, and even the planned duration of your city walk.

  • Personalized Itinerary Planning:
    Combining your preferences, current travel history, and external data sources (e.g., top Reddit recommendations, popular forum posts, and Google Maps reviews), Hugo Tour Guide generates one or more tailored route options.

  • Interactive Route Adjustment:
    Whether before or during your journey, you can adjust your itinerary using voice or text commands—adding, removing, or swapping out points of interest. The AI learns from these adjustments to refine future recommendations.

  • Guided Tour Mode:
    Once you confirm your route, the AI maps out the itinerary and provides live, interactive explanations. You can click on any mapped location for detailed information and follow up with additional questions during the tour.

  • Multilingual Support:
    To accommodate international travelers, the app supports multiple languages including Chinese, English, Japanese, and Korean.


How We Built It

Our development process leveraged modern web and AI technologies:

  • Front-end:

    • Built with React for a responsive and intuitive user interface.
    • Integrated with EventLab API for high-quality text-to-speech conversion.
    • Utilized OpenAI API for accurate and natural speech-to-text conversion.
  • Back-end:

    • Developed in Python with seamless integration of OpenAI API and Google Maps API.
    • Multiple intelligent agents were created to handle distinct tasks such as route planning and attraction introduction.
  • Personalization:

    • The AI model, based on OpenAI, was fine-tuned with extensive prompt engineering to ensure recommendations feel natural and deeply personalized to each traveler.

Challenges We Ran Into

Two primary challenges shaped our development:

  1. OpenAI Model Accuracy:
    We aimed for recommendations that truly resonate with individual preferences. Achieving this required significant prompt optimization and exploring multi-language support to maintain high accuracy across different linguistic environments.

  2. Natural Voice Interaction:
    Delivering a voice experience that mimics natural human conversation was challenging. We tested various speech synthesis APIs to find one that offered a smooth, natural, and comfortable interaction—vital for an engaging travel companion.


Accomplishments That We're Proud Of

Within just two days, we successfully built a prototype that delivers precise and personalized travel recommendations. We continually optimized the human–AI interaction experience by refining backend recommendation logic and enhancing voice interactivity. The result is a system that not only meets but exceeds user expectations in delivering seamless, real-time travel guidance.


What We Learned

Our journey reinforced that while modern AI tools are incredibly powerful, they require meticulous fine-tuning and optimization to meet real user needs. Key insights include:

  • Guiding User Input:
    People often provide vague descriptions of their preferences. Our AI needs to prompt and guide users to articulate their true needs, leveraging both prompt engineering and interactive design.

  • Building Trust Through Transparency:
    Users are more likely to trust the AI’s recommendations if they understand the decision-making process. Clearly conveying how choices are made helps build confidence in the system.


What's Next for Hugo Tour Guide

Looking ahead, our focus is on evolving the MVP into a fully market-ready product. Planned improvements include:

  • Product Optimization:

    • Streamlining front-end and back-end code by removing temporary implementations.
    • Enhancing UI design and integrating a user account system.
  • Data-Driven Personalization:
    Recording historical dialogues and user interactions to deliver increasingly personalized experiences.

  • Expanding Use Cases:

    • B2C: Targeting digital nomads and backpackers who value deep exploration and flexible itineraries, promoting exclusive tour experiences via digital nomad communities.
    • B2B: Partnering with boutique museums lacking in visitor traffic. Our city walk feature can help drive footfall, while our digital guide enhances museum tours—creating a win-win collaboration where museums promote our product in exchange for a digital guide solution.

Team Information

  • Yilun Sun – Product Manager and Designer
  • Qiang Fang – Backend Engineer
  • David Chen – Frontend Engineer
  • Aiden Zhao – AI Engineer

Technical Details


Hugo Tour Guide is committed to revolutionizing the travel experience by combining the best of AI and human interaction. We look forward to helping you explore the world like never before.

Log in or sign up for Devpost to join the conversation.