spectaculAR trAIner

• 

• 

  TrAIner Model

• 

  TrAIner Model Posed

Inspiration

Our inspiration came from hearing about star football player, Jayden Daniels using AR to improve his football skills, which helped him become one of the top rookies in the game. Additionally, working out at home and struggling to perform exercises correctly highlighted the need for accessible fitness solutions. Not everyone can afford a personal trainer, which motivated us to create SpectaculAR trAIner to bring expert guidance to anyone, anywhere.

What it does

SpectaculAR trAIner leverages body tracking technology and generative AI to analyze movements—such as squats—using an external camera. The system communicates with Snap Spectacles via a web socket, providing real-time feedback and corrective suggestions in the user’s field of vision. This creates an immersive and interactive workout experience that helps users perfect their form and stay motivated.

How we built it

We developed SpectaculAR trAIner primarily using Snap Lens Studio, utilizing its built-in body tracking template and generative AI capabilities. Our team customized the body tracking template to precisely detect when a squat is performed and leveraged the integrated ChatGPT to provide real-time feedback based on the tracked movement. By connecting these elements, we created a seamless system that analyzes user performance and delivers instant guidance through Snap Spectacles. Additionally, we incorporated a 3D AI personal trainer model, designed in Blender, to enhance the user experience.

Challenges we ran into

We faced several challenges, including: Configuring a secure web socket server for real-time communication. Achieving accurate squat detection with precise body measurements. Importing and optimizing our 3D AI trainer model from Blender into Lens Studio.

Accomplishments that we're proud of

We’re proud of successfully bringing our idea to life despite having minimal prior development experience. Overcoming technical challenges and seeing our system provide real-time feedback was a major milestone for our team.

What we learned

Through this project, we learned: How to rig and color a 3D character in Blender. Effective use of Snap Lens Studio for augmented reality applications. The importance of accurate movement tracking and system optimization.

What's next for spectaculAR trAIner

We aim to expand SpectaculAR trAIner by: Integrating additional exercuses. Developing a group workout feature for social fitness experiences. Enhancing AI capabilities for more personalized coaching.

Built With

• javascript