Culture Connect

Home Page
Login Page
Video Call Page
Video Call

Inspiration

Our inspiration for CultureConnect came from the experience of one of our team members' families. Both of his parents are Hispanic and immigrated to America in search of better opportunities but faced a significant challenge: the language barrier. Their struggle to learn English inspired us to create an app that not only teaches languages but also simplifies the process, making it more accessible and less overwhelming, especially for immigrants adapting to a new culture.

What it does

CultureConnect is a web application that allows users to connect via video calls while automatically translating conversations in real time using AI. Users can join existing call “lobbies” or start their own calls. The platform helps bridge language barriers through live transcription and translation, making sure everyone can participate and feel heard.

How we built it

Frontend: Used Vite.js and Tailwind CSS for an intuitive and responsive user interface.
Backend / Realtime: Leveraged Socket.IO for live communication and WebRTC for real-time video streams.
Translations: Integrated Goggle's speech-to-text AI services on the client side, sending audio data to a translation service for real-time translation.
User Authentication and Data: Utilizing Firebase for user profiles (including name and native language) and secure login.

Challenges we ran into

Real-Time Translation: Ensuring that audio data is processed quickly without noticeable lag required careful handling of audio chunks and concurrency.
WebRTC Integration: Handling peer connections, ICE candidates, and media streams simultaneously was tricky to implement.
User Experience: Creating a clean, intuitive interface with a team of mainly backend only developers was challenging as some of us were required to dip our toes into UI/UX design and implementation.
Scalability: Designing the application so it can grow to accommodate a large number of concurrent calls.

Accomplishments that we're proud of

Implementing near-real-time language translation during video calls, allowing participants to speak in their native languages.
Building a responsive and user-friendly lobby system where anyone can create or join a call effortlessly.
Providing a seamless video conferencing experience by integrating WebRTC with Socket.IO for synchronization and data transfer.
Ensuring a secure, user-focused design that stores profiles and preferences in Firebase for quick setup each time users log in.

What we learned

Real-Time Architecture: We gained experience with streaming audio data via Socket.IO and orchestrating peer connections with WebRTC.
Scalable Design: We learned how to structure our components and server-side logic to handle multiple calls without collisions.
User-Centered Design: Collecting feedback on how people interact with real-time translations helped us fine-tune the experience for clarity and accessibility.

What's next for Culture Connect

Multi-Language Chat: Adding a real-time text chat feature where typed messages are also translated instantly.
Support for Additional Languages: Expanding our language database for more comprehensive global coverage.
Mobile App: Rolling out a dedicated mobile application for iOS and Android to allow seamless communication on the go.
Community Features: Building interactive forums and group calls to spark cross-cultural conversations, cultural exchanges, and language learning sessions on a global scale.