Inspiration
For those who are second-generation immigrants, and even those who aren't, we all encounter a language barrier at one point or another. Whether we're visiting a foreign country, learning a new language at school, or trying to communicate with relatives over Chinese New Year's dinner, there are many times when we simply wish we knew what to say.
What it does
Introducing Dialog, a tool to learn languages in a practical and fun way. Dialog adapts to each user's proficiency level and learning pace, while offering personalized conversations for every situation you might find yourself in.
How we built it
We used OpenAI's Whisper API to convert speech to text. The text is then fed through GPT 3.5 Turbo and begins the role-play simulation with the user. The responses of the GPT are fed through Google API's text-to-speech synthesis, which is then read out to the user.
Challenges we ran into
- not enough time to implement additional features (e.g. chat history)
Accomplishments that we're proud of
- successfully submitting a project : D
- working with multiple API's
- creating 3D vectors and incorporating them into our site
What we learned
- the power of AI and how well it simulates reality
- hackathons are tiring
What's next for Dialog
There are many additional features we hope to implement later on to improve user experience.
Built With
- google-cloud
- nextjs
- openai
- spline
- typescript
Log in or sign up for Devpost to join the conversation.