LinguaLeap

Social Interaction Language App to Bridge global conversations through live AI voice game matches and social community practice.

Comment

LinguaLeap: Bridging Global Conversations with Social AI Voice Matches

Inspiration

Traveling across non-English speaking countries opened my eyes to a profound reality: language is the ultimate bridge to human connection. Sitting in local cafes, navigating transit, or asking for help, I repeatedly experienced the frustration and isolation of not being able to communicate in the most fundamental form. It hurts when you cannot share a basic interaction or express gratitude in a local tongue.

Existing language apps felt like isolated flashcard drills that prepared you for tests, not for real conversations. I was inspired to create LinguaLeap—a social, AI-powered interactive language learning app designed to transform language acquisition into live, voice-driven multiplayer games and community practice.

What LinguaLeap Does & How We Built It

LinguaLeap turns language practice into an engaging, real-time multiplayer experience:

  1. Voice Match Gameplay: Players challenge global opponents or friends in 10-round speech matches. Players tap START TURN, hold the microphone to speak in the target language, preview their live transcribed speech, and submit it for real-time AI evaluation.
  2. AI-Powered Evaluation: Powered by Google Gemini AI and Cloud Functions, the backend evaluates phonetic accuracy and translation context, awarding \(+10\) points per accurate turn.
  3. Global Radar & Friendly Matchmaking: Features a real-time global matchmaking radar matching players based on language, skill level, and geographical proximity.
  4. In-App Monetization via RevenueCat: Integrated using purchases_flutter to manage Free vs. Premium tiers. Premium subscribers unlock advanced language strength levels (Intermediate & Pro), unlimited topics, and full immersion group challenges.

Tech Stack & Architecture

  • Frontend: Flutter & Dart (Cross-platform iOS & Android)
  • State Management & UI: Provider, Shadcn UI (shadcn_ui), and custom Material themes
  • In-App Purchases & Subscriptions: RevenueCat (purchases_flutter)
  • Backend & Real-Time Sync: Firebase Authentication, Cloud Firestore, Cloud Storage, and FCM
  • Serverless AI Logic: Firebase Cloud Functions (TypeScript) & Google Gemini AI API
  • Speech Engine: speech_to_text with dynamic locale resolution and permission handling

Mathematical Models & What We Learned

Building LinguaLeap taught us deep insights into real-time audio pipeline management, serverless architecture, and subscription monetization with RevenueCat.

1. Gamification & Progression Model

Player progression follows a discrete level step function based on cumulative scores:

$$\text{Level}(S) = \left\lfloor \frac{S}{1000} \right\rfloor$$

$$\text{Progress}(S) = \frac{S \bmod 1000}{1000}$$

Where the updated score after turn \(t\) is calculated as:

$$\S_{t+1}=S_t+10\cdot\mathbb{I}\left(\operatorname{AI_Validation}\left(\text{transcribed},\text{target}\right)=\text{true}\right)$$

Where \(\mathbb{I}( \cdot)\) is an indicator function returning \(1\) for correct pronunciations and \(0\) otherwise.

2. Global Matchmaking Compatibility Score

To ensure fair play, matchmaking compatibility $$\mathcal{M}(u_1, u_2)$$ between user \(u_1\) and \(u_2\) is formulated as:

$$\mathcal{M}(u_1, u_2) = \mathbb{I}\left(L_{u_1} = L_{u_2}\right) \times \mathbb{I}\left(S_{u_1} = S_{u_2}\right) \times \exp\left(-\gamma \cdot d(p_1, p_2)\right)$$

Where \(L\) represents learning language, \(S\) represents skill strength, \(d(p_1, p_2)\) is the Haversine geographical distance between location coordinates, and \(\gamma\) is a distance decay parameter.

Challenges We Faced

  1. Microphone Hardware Contention:

    • Challenge: On Android/iOS, running background audio recorders concurrently with speech recognition caused hardware input locks, leading to empty transcriptions.
    • Solution: We re-engineered the audio pipeline to grant exclusive, unhindered mic access to the speech-to-text engine with an asynchronous \(250\text{ ms}\) result buffer, guaranteeing seamless speech capture.

  2. Real-Time Multiplayer Timer Synchronization:

    • Challenge: Syncing 30-second turn countdowns and waiting periods across devices with varying network latencies.
    • Solution: Leveraged Firestore server timestamps to derive elapsed time dynamically relative to device clocks between two or multi players.

  3. Seamless Paywall Integration with RevenueCat:

    • Challenge: Dynamically restricting advanced language strength levels (Intermediate/Pro) and unlimited group topics without degrading user experience.
    • Solution: RevenueCat's SDK allowed us to query entitlement states effortlessly and present paywall screens smoothly when free users attempt to access premium features.

What's Next for LinguaLeap

We plan to introduce live AI speech pitch analysis, multi-party voice rooms, and localized offline lesson caching to continue making global conversations accessible to everyone.

Built With

Share this project:

Updates

posted an update —

1. Custom-Made AI Learning Topics

  • Personalized Topic Generation: Users aren't restricted to pre-built curricula. Learners can create custom learning topics tailored to their specific hobbies, career paths, travel destinations, or personal interests.
  • On-Demand AI Synthesis: Powered by Google Gemini AI, custom topics dynamically synthesize new vocabulary, structured lesson tracks, and quiz questions on demand.

2. Automated 15-Day Learning Refresh & Content Rotation

  • Zero Learning Stagnation: To prevent rote memorization and keep learning fresh, LinguaLeap implements an automated 15-Day Content Refresh Mechanism.
  • Systematic Rotation: Quizzes, conversational prompts, and lesson exercises automatically refresh and rotate every 15 days, exposing learners to new vocabulary and real-world expressions over time.

3. Daily 7:00 AM Learning Push Notifications & Alerts (FCM)

  • 7:00 AM Daily Practice Reminders: Users receive automated daily practice push notifications every morning at 7:00 AM to build consistent daily study habits. Users can easily enable or disable daily reminders in Settings.
  • Instant Match Invites & Mentions: Integrated with Firebase Cloud Messaging (FCM) to deliver instant push notifications for global match challenges, friendly group invites, and active chat mentions.

4. Group Classrooms & Live Presence

  • Interactive Community Hubs: Dedicated group study rooms with real-time chat, native text translations, and live presence indicators.
  • Friendly Voice Match Launch: Members can initiate instant friendly Voice Matches directly inside group chat.

5. App-Wide 30-Language Localization

  • Native Global Accessibility: Built with full Flutter localization supporting 30 global languages (English, Spanish, French, German, Arabic, Japanese, Chinese, Hindi, Portuguese, Russian, Italian, Dutch, Swedish, Swahili, Polish, Korean, Yoruba, Igbo, Hausa, etc.).
  • Localized Rules & Interface: All dialogs, game rules, and navigation elements render 100% natively in the user's active device language.

6. Adaptive Language Strength Levels

  • Dynamic Difficulty Curves: Game prompts automatically scale across Beginner, Intermediate, and Pro levels based on user skill and learning progression.

Log in or sign up for Devpost to join the conversation.

Submission history