Lexi

• 

  Minigame: Word Boxing

• 

  Minigame: What is it?

• 

  Practice: Listen and Say

Inspiration

Our team brings extensive experience teaching English as a foreign language in Taiwan where teaching English to young learners is a thriving industry. The app's concept stems directly from the traditional method of using flashcards to present vocabulary. However, we've innovated by replacing physical flashcards with 3D objects, which are seamlessly integrated into the user's environment through mixed reality (MR) technology. While the app proves valuable for individual study, its MR capabilities also make it ideal for classroom settings. Students can interact with virtual objects while maintaining awareness of their physical surroundings, including furniture, classmates, and the instructor.

What it does

Lexi levels up your language skills in mixed reality.

-Engage in fun, highly replayable mini-games that blend movement and learning -Benefit from physical interaction, leading to improved retention and accelerated language acquisition -Challenge yourself and others by climbing the leaderboards

How we built it

Unity, Meta building blocks, Voice SDK

Challenges we ran into

We were planning to use throwing as a major mechanic in our minigames, but found that throwing using hands did not feel natural using hands. We opted to use alternative interactions like grab, pinch and punch.

Accomplishments that we're proud of

We're pleased that we could support basic pronunciation checking using the Dictation feature of the Speech SDK.

What we learned

Using building blocks speeds up the process of creating MR apps in Unity by a lot!

What's next for Lexi

The app can easily be expanded by adding additional vocab, grammar points, more mini-games and support for learning additional languages. Ideally the app will provide a comprehensive curriculum that guides a student from building basic language through to an intermediate level. Alternatively, it could also be expanded to work as supplementary exercises alongside one of the many existing curriculums for language learning.

Built With

• unity