Inspiration

Practicing pronunciation and getting timely feedback are essential for improving language skills. The assessment is conventionally driven by experienced teachers, which normally takes a lot of time and big efforts, making high-quality assessment expensive to learners.

What it does

Introducing Fluent speaker App, which evaluates speech pronunciation and gives speakers feedback on the accuracy and fluency of spoken audio by computer-assisted, artificial intelligence-based language learning features from Azure Cognitive Services.

How we built it

Several technologies were integrated:

  1. Xamarin (cross-platform development targeting Windows, Android and iOS devices)
  2. Cognitive Services (more specifically, Speech and Pronunciation Assessment capability)

Challenges we ran into

Getting real devices to test (Android, iOS)

Accomplishments that we're proud of

Successful implementation on more than one platform (Windows 10 and Android tested, iOS not yet but it should be supported).

What we learned

  1. How to incorporate Pronunciation Assessment in mobile applications
  2. Having access to school or teachers might not be accessible to everyone, so the education barrier can be tackled by giving everyone the chance to learn on their own.

What's next for Fluent Speaker

  1. Support more languages (such as Spanish)
  2. Introduce a gamification/reward system
  3. The user can share their accomplishments

Built With

Share this project:

Updates