-
-
T pose
-
warrior pose 2
Inspiration
[please try out the actual app in the link below] A year ago, I wanted to lose weight by following exercises on youtube, but ended up injuring my back during one of the exercises. I also never lasted past day 3 of those 7-day programmes because I find exercising to be a chore. So, I wanted to build an open-sourced app that tells me whether 1) I am doing the exercise correctly 2) make exercises more fun through games 3) enjoy doing the exercise with someone else. *image gallery contains the sample poses it can detect. **there's some difficulty uploading the unity project onto github, so I attached a google drive link to the unity project instead.
What it does
A sample usage is shown as in the video. Simply stand in front of the device and the in-app instructions will tell you what to do - whether you are standing too far for detection, or whether you are not doing the pose correctly. This is a REAL-TIME app that can detect few yoga poses like T pose, warrior pose 2, tree pose to see if you are doing it correctly. It CAN DETECT more than 1 person, so you can enjoy doing it with a friend !!
- First, it identifies your joints and draw lines to connect the joints. If it cannot identify your joints, it will tell you to move further until it can see your body.
- Next, it calculates the angles between various joints - e.g. your arm joint, shoulder joint, hip joints, knee joints, feet joints, hand joints. This is used to tell which arm or leg or body part you are bending or not.
- Lastly, the app checks the calculated angles against the various poses and see whether it matches +-15 degrees of any of the poses.
- It also has one Augmented Reality (AR) game - hit the hand for proper stretching before the exercises. When you raise your hand and hit the images, the images will disappear.
- NO USER DATA is collected or retained in the usage. The app does not collect user data and deletes all usage data (if any) once the session ends. It is a very very incomplete prototype as of now. ## How we built it unity, barracuda etc. ## Challenges we ran into It was a huge time crunch because I mistook the deadline. As a result of the rushed work, lot of ideated features could not be implemented, and pose detections aren't as accurate as expected. I was trying to publish it to webGL (so people can access this from the web) but failed and given the short time frame, I decided to focus on building it for windows platform. I couldn't build finish the AR games in time, which is the main advantage of the unity platform. Given more time I think I could better leverage on this advantage of unity and make fitness more fun. ## Accomplishments that we're proud of Actually getting the prototype app out and somewhat working on windows, though it is in a very very basic stage. It was very fun doing poses and testing out the app to see whether it works ## What we learned A lot about AI, computer vision and trying to integrate it in unity, which is a game engine. ## What's next for AI yoga trainer w AR games A lot of potential - merging AI with AR games is something that has immense opportunities. Would be great to include more AR games (make stretching more fun), concurrent fitness sessions (where you do yoga with friends, told by AI whether you are doing it correctly), virtual 3D fitness trainer who does the pose along with you (so you have someone to train with), etc.
Log in or sign up for Devpost to join the conversation.