Inspiration

Lockdown has been hard, there is no doubt about that! But with our city under a complete lockdown over again it's even harder to stay motivated to do anything especially with all the online college work. We wanted to create an application that helps us get a little exercise in a fun way!

What it does

We have a wearable component that makes the character in unity engine jump.

How we built it

We built it using Unity, esp8266, firebase and python

Challenges we ran into

So many, we tried many libraries and tools before settling on this one. We started by looking at various hand tracking methods, but with none of having apple devices and all of us pretty new to the game dev and unity world, there weren't many libraries, tutorials or instructions to go about it. So starting with libraries and sdks for computer vision and hand tracking, we finally settled for a hardware wearable that runs by a power bank and sends data to firebase, which is extracted by a python script which inturn send the jump command to the UDP Socket which the unity script is connected to and on detection of the jump command makes the character jump.

Accomplishments that we're proud of

It started working!

Art Credit: https://www.raywenderlich.com/

Built With

Share this project:

Updates