This project realized hand detection and gesture recognition with OpenCV on Android Studio. We also implemented a Media player service to demonstrate the capability of our algorithm.
The project utilized the camera on Android devices and records hand gestures as an input method. Upon opening the main app "opencv", this program shows the preview of the front camera on the main window and starts to play music on the local media. The main screen (camera preview) is divided into 4 quadrants and user can notice their hands are detected in the camera preview.
Moving your hands in the 4 quadrant and performs a "open-palm to fist" action triggers control to the media player in the background. Depending on the position of your hand image in the screen: bottom quadrant controls play/pause; top quadrant replays the current song from beginning; left quadrant plays the previous music; right quadrant plays the next song. When a actions is triggered, there will be visual effects in corresponding quadrants.
This program requires access to the camera and storage of user’s Android device.
Log in or sign up for Devpost to join the conversation.