LectureLingo

Speech to text Translation for students in lecture

Comment

Inspiration

My own experience as a student has deeply inspired this project. 14 years ago, I arrived from Syria and struggled immensely due to language barriers in the classroom. The feeling of being isolated and unable to fully comprehend the lessons left a lasting impact. I'm determined to ensure that no other student experiences that same sense of exclusion.

What it does

This speech-to-text website is specifically designed to help students who struggle to understand lectures due to language barriers. It works by first capturing the lecturer's words in real-time. Next, the captured speech is converted into accurate text, making it easier for students to follow along. Finally, the website seamlessly translates the transcribed text into the student's preferred language, breaking down language barriers and ensuring full comprehension of the lecture material.

How I built it

To build this project, I leveraged several core technologies. Django WebSockets were instrumental in creating a real-time connection between the website's frontend and backend, ensuring rapid translation updates for the user experience. The integration of the Deepgram API into the Django backend allowed me to implement the crucial functionality of converting the user's spoken words into accurate text. Finally, I utilized the Google Translate library to provide seamless translation capabilities, empowering students to select their preferred language and bridge the language barrier.

Challenges I ran into

The most significant challenge I faced was undeniably integrating Django's backend with the frontend. This hurdle kept me occupied for a substantial two days. However, the satisfaction of overcoming the problem was incredibly rewarding.

Accomplishments that we're proud of

Overcoming Personal Challenges and Creating Opportunity: Moving from Syria to Canada presented significant hurdles. Not only did I conquer the challenge of learning English, but I also harnessed this experience to develop a tool that will assist others facing similar language barriers. Tackling a Complex Project: Building a real-time speech-to-text translation website is no small feat. I'm proud of the problem-solving and persistence I demonstrated in integrating various technologies to create a solution. Expanding my Skillset: This project pushed me to master new tools and frameworks. I successfully learned how to use Django, Django WebSockets, the Deepgram API, the Google Translate library, and the intricate connections between frontend and backend development.

What I learned

Django Mastery: I dove into the world of Django, a powerful web framework new to my skillset. Frontend/Backend Harmony: I learned how to seamlessly connect Django's backend with HTML, JavaScript, and CSS to create a dynamic user experience. API Expertise: Working with APIs extensively has deepened my knowledge and understanding of their functionality.

What's next for LectureLingo

While I'm incredibly proud of LectureLingo's current capabilities, there's always potential for improvement and expansion. Here are the key features I aim to implement in the future:

Idiom Translation and Definition Tool: Natural language is full of idioms and phrases that can be a major roadblock for non-native speakers. I'd like to develop a system that identifies idioms, translates them accurately, and provides definitions on hover for the user.

Expanded Language Support: Expanding the range of languages supported is crucial for maximizing LectureLingo's inclusivity. Integrating additional translation APIs will allow me to cater to a wider range of students with diverse linguistic backgrounds.

Offline Functionality: I plan to implement offline functionality to support students who may have unreliable internet connections, ensuring they can still access and benefit from the translations.

User Profiles: To streamline the user experience, I'll introduce user profiles. This will allow students to easily save their preferred language settings and track their progress over time.

Share this project:

Updates