Hand Gesture Recognition

why can't we submit our code?

Inspiration

Biomedical applications, Ironman

What it does

Controls a media player with hand gestures captured from a camera

How we built it

Using android studio, java, opencv, and getting little to no sleep for a couple days

Challenges we ran into

No prior knowledge of android studio or java; integrating several applications into a single project. Also uploading the completed project.

Accomplishments that we're proud of

Successful hand detection, gesture recognition, and media control, all with no prior knowledge of android studio or java

What we learned

Android studio and java (duh), also opencv

What's next for Hand Gesture Recognition

Today IPO Tomorrow the world

Please check out our link to the apk file below if you would like to test it on your device!

Built With

Submitted to

SpartaHack IV

Created by

I worked on the implementation of hand detection and gesture recognition algorithm with OpenCV. I also assisted in integration of the media player service.

zobeideThePlayer
Created variations of media players for integration, helped with integration code between opencv, recognition software, and media player; spent an inordinate amount of time debugging.

IMAAHACKER
I helped with the code for hand detection, and got intro experience with Java and Android Studio.

Hamil441

Updates

IMAAHACKER posted an update — Jan 21, 2018 03:01 PM EST

google drive link added; file relies on dir "hackathon/opencv/..."

Log in or sign up for Devpost to join the conversation.

IMAAHACKER posted an update — Jan 21, 2018 02:51 PM EST

github repo broken; file too large; figuring out solution

Log in or sign up for Devpost to join the conversation.

zobeideThePlayer posted an update — Jan 21, 2018 11:06 AM EST

This project realized hand detection and gesture recognition with OpenCV on Android Studio. We also implemented a Media player service to demonstrate the capability of our algorithm.

The project utilized the camera on Android devices and records hand gestures as an input method. Upon opening the main app "opencv", this program shows the preview of the front camera on the main window and starts to play music on the local media. The main screen (camera preview) is divided into 4 quadrants and user can notice their hands are detected in the camera preview.

Moving your hands in the 4 quadrant and performs a "open-palm to fist" action triggers control to the media player in the background. Depending on the position of your hand image in the screen: bottom quadrant controls play/pause; top quadrant replays the current song from beginning; left quadrant plays the previous music; right quadrant plays the next song. When a actions is triggered, there will be visual effects in corresponding quadrants.

This program requires access to the camera and storage of user’s Android device.

Log in or sign up for Devpost to join the conversation.

IMAAHACKER started this project — Jan 21, 2018 09:49 AM EST

Leave feedback in the comments!

Log in or sign up for Devpost to join the conversation.