ed2gether

Inspiration

Students with disabilities often face barriers in online learning environments, especially during video calls. Real-time communication can be difficult for those who rely on sign language or need additional visual/audio support. Recognizing the need for inclusive and engaging digital learning, we created ed2gether — a platform that reimagines online education by combining accessibility, creativity, and communication.

What it does

ed2gether comprises two main tools:

• EduMeet: A real-time video communication platform enhanced with speech-to-text transcription and sign language interpretation to support students with hearing impairments.

• EduToon: An AI-powered tool that transforms educational documents into animated video explainers with narration, making learning more engaging for visual and audio learners.

Together, these tools make remote education more inclusive and effective.

How we built it

Frontend: React + Vite + TypeScript

Backend: Python + Flask

Database: Supabase

APIs: Gemini, Novita

Libraries: gTTS, PyPDF2

Acknowledgement: https://github.com/laplaces42/sign-language-interpreter

Future Improvements

1. Multilingual Speech-to-Text Transcription: Enhance the transcription feature to support multiple spoken languages beyond English, such as Mandarin, Malay, Tamil, or Spanish. This would allow users from diverse linguistic backgrounds to access real-time captions in their native languages, increasing the platform’s accessibility for international classrooms and multilingual communities.
2. Gesture-to-Speech Output: Enable bidirectional communication by converting recognized signs into synthesized speech, supporting Deaf-to-hearing interactions.

Built With

• css
• fastapi
• flask
• gemini
• html
• javascript
• novita
• python
• react
• supabase
• websockets