Domain.com entry: finteract.online Domain.com entry: excerise.space
Microsoft Azure Related Use: While not described fully in the video, Microsoft Azure was the heart of our solution. It was what hosted our application, we used the cognitive services vision API to recognize faces and bodies to move our characters, and we used the Communications Services APIS to create live and secure chat rooms and video between users. Without it our solution would be infinintely more complex to build.
This project was inspired by a viral Tik-Tok video that we saw where a user controls a flappy bird using his nose. We realized that there was great potential in this idea. Millions of people were motivated by the gamification of exercise and with many people stuck at home without access to a gym, there is no better time to make working out at home fun!
What it does
Fineract is a web app that helps you stay fit through playing games where you control the character’s motions through your body. There are multiple games on the platform!
Game #1: Play Flappy Bird! Control the bird by using the height of your head during a pushup. When you go down, the bird goes down. When you push up, the bird goes up. You can even challenge a friend to a head-to-head battle, to see who's arms can last the longest, with video chatting (trash talking) live available.
Game #2: Play the Dino Game! Inspired by the chrome no internet game, you can jump over cacti and duck under birds. This time, you must physically jump and your dino will hurdle the cactus. Do a squat and your character will duck under the bird!
Additionally, you can pause, restart and exit the game using simple hand gestures.
How we built it
Challenges we ran into
A key obstacle that we faced—and thankfully, eventually overcame—was designing the user experience for our platform. With each member coming from a unique background, our team was overflowing with ideas on how our product should look and feel. Initially, it was difficult to decide whether we wanted a simple, lightweight platform or one that was more feature-rich. In making this decision, we consulted our favourite and least favourite apps to gain an understanding of what our final product could eventually look like. In the end, we came to a consensus to prioritize making the app accessible to all individuals. For this reason, we decided to make two different games: the infamous flappy bird and the classic Google Chrome dino game. By first integrating two very well known games, we were able to make the learning curve for our UI as shallow as possible. Another very important challenge we ran into was the limitations of our physical strength. Our quads were sore; arms were heavy. Unlike most hackathon developers, we were out and about the entire weekend!
Accomplishments that we're proud of
With over 20,000 lines of code and 100+ commits, we are very proud of the final product we managed to produce in such a short amount of time. Our team took on the challenge of implementing very ambitious modules and ended up successful while we were at it.
What we learned
Every single team member walked away from this project with a great deal of knowledge in many different technological disciplines. We learned how to use and handle canvases in React, implement TensorFlow.js to detect the position of a human through a webcam, and build a stable multiplier game using WebSockets.
What's next for Fineract
Fineract aspires to become the goto fitness app for anyone looking for a fun and engaging platform to improve their fitness. To expand our reach to a broader audience, we seek to target the specific needs of individuals. More specifically, our future plans include: Creating even more games tailored towards exercising a particular muscle group Adding various difficulty levels so that anyone—ranging from elite athletes to toddlers—can achieve their fitness goals on Fineract Embedding more refined peer-to-peer interaction features to bring endless socialization to every workout All in all, we hope to bring more timeless games to the platform to make working out not only about the body, but the mind as well.