Inspiration
Despite advances in language translation over the past decades, the love of language learning will never be lost. Instead of traditional painstaking ways of learning languages through textbooks, we envision an engaging and interactive way to learn new languages that immerses users in real-life contexts. This is especially true for fans of Japanese culture and manga, who can benefit from a more immersive and practical learning experience.
What it does
BubbleTalk is an innovative Japanese learning app and manga translation site that uses AI-powered technology to enhance the language learning experience. It features a comic word detector that accurately identifies Japanese words in manga, providing instant translations and explanations. Users can read their favorite manga with the added benefit of learning Japanese in context. The app has a word bank for new vocabulary and will also offer interactive exercises, quizzes, and flashcards to reinforce learning, making it a comprehensive tool for Japanese language enthusiasts.
How we built it
We built BubbleTalk using OpenAI and Flask. A comic word detector leverages machine learning algorithms to detect and correctly identify Japanese words within manga panels. The integration of OpenAI's technology allows for high-accuracy translations and nuanced understanding of the Japanese language as well as text to speech for pronunciation learning purposes.
Challenges we ran into
Due to time constraints, we weren't able to make the translation overlay look as nice and clean as we would have liked, but we are motivated to continue improving our app!
Log in or sign up for Devpost to join the conversation.