MetaPhysical

Inspiration

All of us worry about our physical health, and two of us play sports. Andy specifically has a meniscus tear from improper running form and from volleyball, so improving form is something that is extremely important.

What it does

MetaPhysical is a second perspective on working out, providing us with an external view on ourselves while we do things physically: weight lifting, running, playing sports, anything. It gives us insight as a coach to improve our form with statistical backing in order to create the most optimal workouts. Not only does it prevent injuries, but it can also improve muscle growth from improved form.

How we built it

We used lovable as the foundation, and we kept building on it with various iterations of ideas and tests, and also using a Meta Quest 3 in order to create a system that works all throughout—from the website over to the cloud, and into the VR headset.

Challenges we ran into

A major problem we had was syncing up the page for the VR headset and the camera interface, since it was difficult to get live updates. However, by utilizing the cloud, we were able to integrate the two interfaces, even through different devices miles away.

Accomplishments that we're proud of

Being able to develop the algorithm to detect a specific exercise being performed is something we are very proud of, since we initially had the stump of having no data to train off of to do detection. However, we decided to try creating our own data to build on top of an algorithm to have the most functionality from start to finish.

What we learned

We learned that oftentimes, pairing different pieces together can be the hard part, since, for example, the VR headset and the laptop was very difficult to link up, which took up a huge chunk of time to get working.

What's next for MetaPhysical

MetaPhysical looks forward to possibilities. While currently it is run on a Meta Quest 3, we want to try broadening its capabilities to both those who can't afford expensive things, or those who want the top equipment. To make it cheaper, we can replace the VR headsets with vibrating bands that indicate when our forms are faulty. To make it perform better, we can connect more than one camera to the cloud, and use multiple threads of computer vision information to create an even more accurate prediction of what workout is being performed, with more consistency.

Built With

• bun
• css
• github
• html
• javascript
• lovable
• typescript