VisuLingo

Inspiration

The idea is to leverage realistic enviornments (with gaussian splatting) to provide simulated real-world situations in which the user can practice speaking a foreign language.

What it does

Visulingo is an immersive WebXR language learning app where you practice real-world dialogues inside interactive 3D scenes, with AI-powered pronunciation feedback and progress tracking.

How we built it

We started the project at the SensAI hackaton in Barcelona earlier this year using Unity. See: https://devpost.com/software/visulingo Now, we have moved over to a modern WebXR stack that integrates a Supabase backend. The app is much more developed now with multiple lessons, a step-by-step guidance system, a character to guide the user and much more.

Challenges we ran into

Coming from developing mainly in Gameengines, working with WebXR was a very different workflow (I really like the spatial editor!). Apart from technical challenges, Usertesting revealed pretty early on that we needed to guide user a lot more and break down the tasks into smaller chunks to make it not overwhelming.

Accomplishments that we're proud of

We launched! It is a live website and anyone can use it. This is the biggest achievement of all.

What we learned

Validating the core concept early (in a previous hackaton) gave us the confidence to continue pushing until we reached a level of completion that we were happy with to do user testing with. Essentially constantly making updates and testing them asap.

What's next for Visulingo

We are currently working on the Hotel checkin lesson and doing marketing on Twitter to get some more beta testers. The application should become more robust and polished over the next few weeks - we are really focusing on analytics not only to identify pain points but also things that engage users to double down on.