Video demo: https://cap.so/s/rzq1d01y2av6d7a
Inspiration
Working out alone at home can be tough—no real-time feedback, no motivation, and no one to tell you if you're doing an exercise correctly. We wanted to change that. Imagine training with Arnold Schwarzenegger, Serena Williams, or even Goku, getting real-time feedback on your form and motivation straight from legendary figures. That's how TwelveAbs was born: an AI-powered personal trainer that makes home workouts engaging, interactive, and effective.
What it does
TwelveAbs is an AI personal trainer that provides real-time feedback on your exercise form using your camera. You can talk to your virtual trainer, receive coaching, and even get motivation from iconic figures like Arnold Schwarzenegger. Whether you're a beginner or just need an extra push, TwelveAbs ensures you're training effectively—right from your living room.
How we built it
We used Next.js on Vercel for the frontend and Python for the backend. Authentication is handled through Clerk, while the AI is powered by ElevenLabs, which generates the voices (yes, that includes Arnold's legendary voice) and provides conversational AI. To evaluate exercise form, we leverage GPT-4o-mini, processing camera input to give real-time feedback.
Challenges we ran into
One of the biggest challenges was getting the conversational AI to work seamlessly with the vision-based exercise evaluation. Ensuring that the AI could analyze movements accurately while keeping conversations engaging and responsive was no small feat. But after a lot of fine-tuning, we made it work.
Accomplishments that we're proud of
We’re particularly proud of the user experience—hearing Arnold’s voice telling you to "get to the chopper... I mean, lower your squat!" is both fun and motivating. The way the AI adapts feedback to the user makes the experience feel personal, engaging, and genuinely helpful.
What we learned
One major insight? There’s a huge market gap for AI-driven personal training that combines real-time vision analysis with conversational AI. Most existing solutions focus on one or the other, but not both. We also realized the potential for real-time AI video streaming, which could open doors to even more interactive fitness experiences.
What's next for TwelveAbs
The future of TwelveAbs is built on three key pillars:
- Smarter AI & vision integration: Enhancing the AI’s ability to provide accurate, human-like feedback that resonates with users.
- Partnerships with fitness influencers: Creating AI avatars of real trainers to make workouts more personalized while tapping into their communities.
- Wearable integrations: Connecting with smartwatches and fitness trackers to incorporate real-time biometric data into the coaching experience.
This is just the beginning—we believe AI can revolutionize personal training, making it accessible, fun, and incredibly effective for anyone, anywhere. 🚀
Log in or sign up for Devpost to join the conversation.