TransLesson

TransLesson: From speech to notes with Corgi the Scribe! Making lectures accessible and multilingual.

Comment

Inspiration

College courses have historically been dominated by lecture-style lessons. by Our journey began when we realized that deaf students and international learners faced significant barriers in accessing these auditory content. We envisioned a world where knowledge is not bound by auditory capabilities or language barriers. The inspiration came from a simple idea: What if every spoken word in a lecture could be immediately and accurately transformed into written text, available in multiple languages?

What it does

TransLesson is a transformative tool that converts lecture audio into written text, making content accessible for deaf students and international learners. By bridging auditory and language barriers, it allows users to revisit lectures at anytime and ensures that content is available in multiple languages.

How we built it

We leveraged advanced speech-to-text algorithms to transcribe lectures quickly and accurately. The platform was constructed as a cross-platform mobile app. To support multilingual capabilities, we integrated specific translation APIs like Google Translate and React Native Community Voice. In addition, our user-friendly interface, decorated with our mascot 'Corgi the Scribe', offers guidance throughout the user's journey.

Challenges we ran into

  • Maintaining precise transcriptions, especially when dealing with specialized jargons or varied accents.
  • Understanding mobile design and architecture as compared to traditional web apps
  • Can’t deal with the $99 fees to create an Apple Developer Account to fully test our app on IOS devices.
  • We went through numerous, terrifying, horrible challenges (we were not always a group of 3).
  • Debugging the numerous errors we came across

Accomplishments that we're proud of

  • Providing a means for deaf students to access lecture content easily.
  • Aiding international students in understanding lectures in their non-native languages.
  • Successfully integrating real-time multilingual support.
  • Creating a database for past notes and lectures

What we learned

  • The nuances and challenges in speech recognition technology.
  • How to combine new languages and frameworks like React Native and Spring.
  • Working together via Github

What's next for TransLesson

  • Further refine the accuracy of transcriptions and expand the range of supported languages.
  • Allowing the sharing of notes between different students
Share this project:

Updates