Inspiration
We wanted to learn languages using YouTube videos but oftentimes good captions are not available if at all and lesson planning is very time consuming.
What it does
Learn languages using your favorite TV shows/Youtube/video input by uploading it to our website and using the custom quiz and summary feature to test comprehension and learn context.
How we built it
We built LanGain using Supabase and node.js for our backend. For our frontend we use React, html, typescript, and css. Additionally, we used the gsap library to allow for a better interactive and tech-savy user interface for those interested in learning a new language through our app!
Challenges we ran into
We had various difficulties when working on this project, specifically with the APIs and being able to fully integrate them into our project in the way that would be beneficial to our main goal. Another challenge we ran into was that once we had the APIs fully integrated, we discovered restrictions and limitations the APIs had.
Accomplishments that we're proud of
We are proud of our automated quiz generation which allows for custom comprehension evaluation and gives tips for improvement based on these quizzes.
What we learned
We learned how to intelligently integrate APIs into our software framework and how to work better with LLM and AI workflows and products.
What's next for AI Language Learning App
For new features we will add custom phrase searches to give learners phrases in context and implement the ability to search for certain scenes.
Built With
- react
- supabase
- twelvelabs
- typescript
Log in or sign up for Devpost to join the conversation.