Inspiration
Translation
What it does
It will give real time translated subtitles, preferably using AR glasses.
How we built it
We built it using Vosk SpeechToText, Google translate API for translation, OpenCV for facial tracking and adding subtitles to video(AR), Tkinter for GUI.
Challenges we ran into
Different blocks of the project were not working together, we had to pull an allnighter. Finding an open-source way to do real-time speech to text was the hardest.
Accomplishments that we're proud of
We are proud of the fact that we had a working demo in time for presenting.
What we learned
ALWAYS SUBMIT ON TIME, we also learned about different speech to text models and how doing it realtime is a real challenge.
What's next for TypeInt Instant Language Translator
We might fix up all the bugs and publish this project publicly to allow others to try and use it.
Built With
- google-translate
- pythonopencv
- tkinter
- voskspeechtotext
Log in or sign up for Devpost to join the conversation.