Inspiration

As a badminton coach, I have seen a lot of people struggle to learn proper footwork and swing technique. Many of them cannot identify what they are doing wrong, which slows their progress and can even lead to injury. That inspired me to build a tool that gives people clear, personalized movement feedback.

What it does

Coach Tide uses AI to analyze a reference video of a movement, whether it is a sports drill, workout, or dance routine. It breaks the movement down into detailed step-by-step instructions with timestamps. In Practice Mode, users get live feedback on how accurately they are matching the reference video and what they need to correct. It also includes a Record and Deep Analysis mode, where the user’s webcam performance is recorded and compared against the reference video to identify specific mistakes and when they happen.

How we built it

Frontend: React, React Router, custom CSS Backend: Python, Flask REST API Computer Vision: Google MediaPipe for pose and skeleton tracking AI Analysis: Google Gemini 2.5 Flash for step extraction and movement analysis Database: MongoDB Atlas for storing tutorials and user history Authentication: Flask-based authentication with password hashing for secure accounts

Challenges we ran into

The biggest challenge was frontend development, since I did not have much experience with it. Getting the layout and design aligned properly took a lot of trial and error. Another challenge was adapting the app to the ocean theme late in development. Practice Mode was also difficult because the scoring and feedback were inaccurate at first, so I had to spend a lot of time refining the logic to make it more useful and realistic.

Accomplishments that we're proud of

I am especially proud of the Practice Mode, since it gives live scoring and correction feedback based on the reference video. I am also proud that I built this project solo as a first-year student.

What we learned

I learned how to use MediaPipe for pose detection, how to build a frontend with React, and how to connect frontend and backend systems into one complete application.

What's next for Coach Tide

Next, I want to expand Coach Tide beyond sports and fitness by adding guided support for meditation and yoga, so users can improve posture, form, and consistency in even more types of movement practice.

Share this project:

Updates