Gym Bro

Gym Bro is a workout coaching website that uses your webcam to analyze your workout form in real time.

Comment

Inspiration

Working out alone can be boring, and most fitness tools either feel too passive or too complicated. We wanted to build something that feels more alive, a coach that actually reacts to your movement, gives you feedback on your form in real time, and adds personality through hype, combo streaks, and playful callouts.

What It Does

Gym Bro is a workout coaching website that uses your webcam to analyze your workout form in real time.

How We Built It

Tech Stack:

  • Python.
  • OpenCV for webcam capture.
  • MediaPipe pose landmarker for pose tracking.
  • Python http.server for the local web server.
  • HTML/CSS/JavaScript for the browser UI.
  • ElevenLabs text-to-speech for voice live coaching.

Architecture:

  • Python manages the webcam and pose processing.
  • Frames are analyzed locally.
  • The annotated feed is streamed into the browser.
  • A JSON endpoint exposes exercise state, rep counts, combo state, and feedback.
  • The browser renders the live UI and handles optional voice playback.

Challenges We Ran Into

  • Transferring python code to a useable maintainable format for the actual webpage.
  • Getting reliable rep detection from noisy pose landmarks.
  • Making different exercises work with simple angle-based heuristics.
  • Handling camera startup issues cleanly on Windows.
  • Preventing voice feedback from overlapping or becoming chaotic.
  • Keeping the experience responsive while Python handled capture, analysis, and browser updates.

Accomplishments That We're Proud Of

  • Successfully implementing live pose tracking through a camera feed.
  • Added multiple coaching modes instead of just a single one.
  • Got real time form scoring working across several exercises.
  • Added a voice system with ElevenLabs with personality while keeping it usable.
  • Made the UI feel more game-like with combo streaks and live feedback.

What We Learned

  • How AI and machine learning can be utilized to efficiently track and mark poses and landmarks in real time.
  • There is a lot more that goes behind the scenes to making a webpage.
  • Simple features can become much more complex than originally anticipated.
  • Voice timing and feedback pacing matter a lot in workout tools.
  • A small amount of personality makes coaching feel much more engaging/unique.

What's Next For Gym Bro

  • More exercises.
  • Actually releasing the website (not locally).
  • Better form heuristics and personalization.
  • Saved history and progress tracking.
  • Persistent combo leaderboards.
  • Better multiplayer/social features.
  • Cleaner remote setup for using the coach across devices.

Built With

Share this project:

Updates