Inspiration

We thought about the way of utilizing OpenAI's API such as ChatGPT and Whisper for real-world issues and came up with a food ordering system, where Whisper is used for transcribing a customer's order and ChatGPT is used for chatting with a customer.

What it does

It is a smart AI cashier. It can deal with any difficult situation. Needless to say, it can take an order without any mistakes. This chatbot can talk with a customer, so you can ask for recommendations or ask about any unique preference such as no pickles or a lot of ketchup like a human cashier.

How we built it

Our product is built with React and Bootstrap using TypeScript and Python. It is deployed on EC2 server in AWS.

Challenges we ran into

One of the biggest challenges was inputting voice from a browser and sending it to Whisper's API. Another issue is using API and React because both of us haven't ever used any APIs and we have to understand HTTP communication. Finally, this is also our first time joining a hackathon seriously, so we had difficulty with time management, especially what we can make within two days.

Accomplishments that we're proud of

We were able to utilize a recent popular AI tool ChatGPT to solve real-world problems. We developed the smartest cashier chatbot ever with ChatGPT, which can interact with human beings naturally.

What we learned

We learned that ChatGPT and other OpenAI resources can be utilized to solve real-world problems. We also learned how real-world development goes in a team. We cannot create such a great application in 48 hours because time and resources are limited. In terms of technical tools, we learned how API works with frontend tools (React) using asynchronous functions. For chatbot, it is important to respond quickly, we choose 1024max token

What's next for AI Smart Order

We can implement whisper API into our product so that a user can talk to a cashier to order food. Also, a chatbot can read out their response so the user would feel like talking to a waitress.

Share this project:

Updates