SpeakOS

A dedicated environment, the equivalent of a whole auditorium - down to a personal tutor, all within the comfort of your home. Introducing SpeakOS, the Augmented Reality public speaking coach.

Comment

Inspiration

Many people struggle with public speaking. Whether it be giving speeches to large crowds, being able to be mindful during conversations such as by holding eye contact, or successfully replying to a series of questions in an interview. We believe that society can be thoroughly bettered through the improvement in social skills related to public speaking of the vast majority. Therefore, we created SpeakOS with the aim of helping others significantly improve their public speaking from the privacy and comfort of their own homes.

What it does

SpeakOS has three core features:

  1. A script speed test where users have to read a script as quickly as possible and can adjust the difficulty of the script. There are a total of 9 combinations that users can try out. It also highlights correctly pronounced words and incorrectly pronounced words in green and red respectively.
  2. An eye tracking game where users must make eye contact with and click multiple different circles symbolising faces. They can change the difficulty by adjusting the time they are given.
  3. An AI interview coach where a user can input a topic they would like to be questioned about. 5 questions will then be generated according to the users' input. They will have to talk about their answers and will then be judged by an AI system and given a final report.

How we built it

We built this application with SwiftUI for VisionOS.

Challenges we ran into

At first, due to the unique 3D constraints of app development for AR we faced difficulty in placing items and finding user gazes. However, after using vectors and with a little bit of practice we overcame this.

Accomplishments that we're proud of

We are proud about the potential impact of our application in helping tackle loneliness and helping create a kinder and more sociable planet. Furthermore, we created a whole app in 24h and our UI is fully developed for Liquid Glass whcih we think looks incredible!

What we learned

We learned about the challenges of designing and developing for AR but also by how large of a margin the pros outweigh the cons.

What's next for SpeakOS

SpeakOS hopes to develop features that can be more personalised to cater to individual needs.

Built With

  • swiftui
  • visionos
Share this project:

Updates