What it does

Phormatics is an accessible social approach to physical education. The two components are the personal trainer portion and the social network portion. The personal trainer portion uses computer vision to analyze form, and a chat bot to suggest workout scheduling. The social network portion allows users to log in using Facebook, unlocking a fitness oriented social network.

How we built it

For the backend, we used pose estimation with Tensorflow (with help from GitHub user "ildoonet") to resolve an estimation for various joints on the human, then dynamically calculated critical angles depending on the exercise. We developed a rep counting function by establishing critical points in the exercise and using those points to count reps/determine deviation. The front end was created purely using Bootstrap, HTML, CSS and Javascript libraries. The chat bot was built using jquery, HTML and CSS.

Challenges we ran into

  • We had to compromise either accuracy or speed by editing the camera input resolution
  • We encountered issues applying mathematical concepts to resolving form issues in the user
  • We had to leverage the front-end design to deliver an effective and rich user experience

Accomplishments that we're proud of

  • Effectively produced a dynamic critique system based off form
  • Generated a clean, user-friendly design
  • Integrated Facebook Login API to allow easy sign up and social network management
  • Full support for various exercises (squats, bicep curls, shoulder press)
  • Responsive video input with drawn overlay
Share this project: