Inspiration

I our daily work we as a business inqubator company have to pitch regularly. Public presentation is also an important part of our business development program 10 Saturdays, where we help our participants to bring theirs ideas to the pitching moment.

What it does

PromptAR is an AR pitch assistant that, through Spectacles AR glasses, displays your speech as a teleprompter directly in front of your eyes. With adjustable scrolling speed and a visible timer, you can experience your moment on stage with less stress. PromptAR is controlled through gesture-based UI and includes an embedded AI assistant to help you quickly find answers to even the trickiest questions.

How we built it

We used Lens Studio with its native GenAI for prompting the UI for AR, for time and for an LLM response. For the gesture control we had used the Assets from the library.

Challenges we ran into

GenAI response was hard to adjust without access to the source code, moreover the outcome of GenAI was unpredictable and sometime unreliable, therefore for every iteration we had to create a separate project to keep the results.

Accomplishments that we're proud of

In this short term without experience in AR development, we were able to deliver an MVP of the product that presumably can help many people.

What we learned

We have learned about the setup of Lens Studio; that the GenAI in this studio still need improvements to become an easy and powerful vibe-coding adds-on; we learned, but too late, that it is better to create with 3d party vibe-coding tool .js file for the Lens Studio objects, which might be more efficient, but we did not have time to try it out.

What's next for PromptAR

We would like to compliment the AR solution with the mobile app that will help to upload test, customize text view, speed of teleprompter, and work on the AI component and audio recorded during public speaking.

Built With

  • asr
  • genai
  • lens
  • openai
Share this project:

Updates