-
Our Little Robot
Inspiration
Controling objects with other parts of the body so you would not have to use your body. Working with object detection, image processing and in particular tracking eye movements.
What it was supposed to do
A mobile app that detected the users pupil and tracked the direction it is looking at, connected wirelessly with to the app is a robot that would move based on the direction of the users gaze.
How we built it
OpenCV image processing library, Arduino & Lego Mindstorm Robot and closer to the end of the hack Android Mobile Vision API
Challenges we ran into
Hardware and Software issues: including a defective WIFI chip, communication through each of the different software packages and detecting the pupil and the direction it is facing.
Accomplishments that we're proud of
Using OpenCV to Detect the Faces & Eyes, making a C# serial interface that sends the commands to the arduino and getting the results from the Android Vision API.
What we learned
Image Processing, Object Detection, Android Develpment
What's next for EyeMoveRobot
Being able to accurately detect the location of the pupil and the direction it is facing using OpenCV and using applying some machine learning
Log in or sign up for Devpost to join the conversation.