We where inspired by the Tap Strap Virtual Keyboard and their proposed challenge to creatively use their hardware. Our initial goals was to challenge ourselves all while exploring new things and have fun testing something we have never used before.
What it does
Currently the our project takes the raw data from finger accelerators, and then parses it into graphs. Then after searching through those graphs we are able to make our own custom hand gestures to use as controls in a game environment.
How we built it
We took the tap strap and using the provided windows sdk, we retrieved the raw data from the tap strap. With the data in hand we graphed the output of the sensors available to see how the data changes with movement. Using the patterns we saw on the graphs, we created our own custom gestures to use.
Challenges we ran into
One of the many challenges we ran it to was trying to figure out a new programming environment called Visual Studio. Since none of the SDKs worked on Linux, we had to quickly come up with a solution on a windows machine. None of us had ever used Visual Studio before and it was a new thing the we all had to figure out. Another challenge was that since two of us where beginners we struggled as a team to figuring out what to each could contribute and how we could equally share the experience.
Accomplishments that we're proud of
We are proud that we got personalized hand gestures that map to certain buttons on a keyboard to play a game through the Tap Strap Virtual Keyboard. Also, we where able to figure out how to navigate through a new interface and a new programming language all while making it work the way we wanted.
What we learned
We learned how to improve the efficiency of data parsing and how to properly interpret such data. We also learned how to briefly use Visual Studio along with how to better communicate with each other as we got sleep deprived and frustrated with our project.
What's next for TapVRap
We want to implement a second hand with more hand gestures. We also want to make it VR compatible since we were not able to implement such feature at this time. We also want to get the gyroscope working in order to have joystick like controls.