Talk Tour

• 

  Our Front End GUI

Inspiration

Being a tour guide is not exactly an easy job. With a diverse group of people from different backgrounds, it proves a challenge for tour guides to provide detailed and personalized tours. Each individual comes with unique interests, preferences, and levels of knowledge, which means a one-size-fits-all approach doesn’t always work.

Building upon this problem, we developed Talk Tour, a personalizable online tour guide.

What it does

Talk Tour has the ability to automatically generate a customized tour experience for each user. Based on input information the user gives at the start of the set up process, Talk Tour will come up with a tour route at their local area. Additionally, Talk Tour is also a companion, being able of talking to the user in real time and even recognize objects through taking pictures.

How we built it

Talk Tour is built with a Python back-end and a TypeScript React front-end. Our back-end is integrated with Google Maps API, Google Cloud Vision API, and OpenAI API. Our front-end was generated with v0dev, ensuring both clarity and charm.

Challenges we ran into

It was hard for us to develop a stable connection between the front-end and back-end. The Google Maps API is also not consistent and had different formats for different functions.

Accomplishments that we're proud of

This is the first time for all of us to develop a web app. We were able to integrate Conversational AI and Computer Vision into our project in the back-end. Although the front-end development spun us around, we had a good time working with AI.

What's next for Talk Tour

We aim to give the project some finishing touches and create an android app for the project. Integrating Augmented Reality to our project was also something we thought of at the beginning, and we will implement it in the future.

Built With

• conversational
• google-maps
• openai
• python
• typescript
• v0dev