Ultrahand

Inspiration

In modern day gaming, haptic feedback are quite popular and is being emersed everywhere in VR on oculus quest. We thought it will be a good idea to have a game of Jenga while being able to feel haptic feedback while playing the game.

What it does

You will wear a modified gloves that we did and you will be playing in a VR environment playing Jenga. While playing Jenga, while grabbing or pinching the Jenga Blocks will make a haptic feedback on your gloves where your hand will be able to feel.

How we built it

We took some vibration motor and solder wires on it to extend the length of the vibration motor. We then connect it to esp32 where we wrote http which allows hotspots to be connected to our computer. This allows data to be transfer and receive, so we know when to let the to apply haptic feedback on the gloves. On the VR, we have created a unity game that contain hand tracking and interaction with 3D Object. Whenever we pinch or palm grab in the VR game, it will make the esp32 know to apply vibration motor which will give you haptic feedback from the game to your gloves.

Challenges we ran into

Some challenge we faced is soldering of the wires to the vibration motor because the wires connecting to the vibration motor was very thin and can easily break. Our esp32 had some powering problem, we first use put lithium batteries in series because a singular lithium battery was too little voltage for our esp32. We decided on a bigger batteries which made the gloves more heavier. One of our biggest challenges was making the Jenga game on unity with the Oculus Quest 2. The most challenging part of make the Jenga was the physics of it which was very painful to do and Oculus Integration Package was very big which took running the game a long time. Making a game in Unity is a very task throughout this hackathon and I have no clue how we manage to get something working.

Accomplishments that we're proud of

We were proud of getting the haptic feedback working correctly between the esp32 and Oculus Quest 2. We finished making the modified gloves which look very cool and work very well just with the esp32 working.

What we learned

We learn that making a unity game with the Oculus Quest 2 was very hard, but I learn how to do physics on 3D Object and code C# script in Unity. We also learn how to solder and learn how to connect to hotspot.