Inspiration: Duolingo X GTA, Stardew Valley
What it does: Local Lingo revolutionizes language learning by turning it into an immersive adventure.
Key features include:
3D models of The World: Using a virtual rendition of the real world, they can explore their desired location and find locals to talk with. This is done using Google and Cesium's 3D maps tiles which provide access to models of the entire world.
AI Integration: All dialogue in the game is created using Generative AI and the story can go in infinite directions depending on your response. GPT-3.5 reads your response and determines whether it’s appropriate given the situation. If your response is flagged as invalid you can always redo the scene!
Hand-drawn Sprites: All sprites are drawn digitally by hand to create a unique aesthetic, charm, and polish. Each NPC’s facial expression changes based on their dialogue, adding to immersion.
Daily and Story Quests: Players can practise their language skills in real-world scenarios by completing quests. Daily quests motivate players to log on and advance the story by practicing every day.
Minigames: Players can play minigames with locals to improve fluency. The player can play a word-matching game with Gabriel in the park. The mini-games use vocabulary from previous dialogue.
How we built it:
Unity, Google Maps API, OpenAI
Challenges we ran into:
Working with Unity makes sharing our work difficult, in the end, we scrambled to merge all of our code.
Accomplishments were proud of:
AI integration, the mini-game, the mini-map, the 3D world and the sprites. Local Lingo is also a unique and creative idea that hasn’t been done before, taking plenty of deliberation.
What we learned:
Intricacies of Unity, Cesium and Google Maps 3D Tiles, OpenAI
What’s next:
Expanding the map to more countries and languages, and boosting performance.
Log in or sign up for Devpost to join the conversation.