Inspiration

Our inspiration is from the smart home IoT control that Mark Zuckerberg is building recently. We want to make the entry process to a home or office to be remotely accessible and secure.

What it does

Our knock-knock project is able to recognize people at the front door and send the image to the home owner's phone. By replying to the message, the owner will be able to decide if the person should come in and if he wants to save to person's information into the database for future facial-recognition.

How we built it

We built the face recognition technology using Microsofts Face API. This API included features such as recognizing faces and generating ids. Previously generated id's were used to compare with the current face id's to see the similarities. We also built the text messaging base using Twilio API. MMS and SMS functions were used.

Challenges we ran into

The most challenging part of every hackathon is the time constraint. We had to ensure that our project was complete in 2 days with thorough testing. We learned a lot about python post requests and used a lot of different API's that we hadn't used before that added to the difficulty of the task. We did not have a monitor available and had to run the raspberry pi 'headless', which meant using vnc viewer and ssh to run commands and make changes on the pi. Opencv took a long time to compile on the raspberry pi. Also many videoCapture functions don't work on mac system, which took us some time to fix.

Accomplishments that we're proud of

We are very excited about the work we have done in general. We are proud of stepping into the world of smart IoT devices through this project. We are also proud of the way we used multiple API's from multiple sources and brought them together through our implementations. We think that this product could be a cheap and effective solution to increase household security especially in areas that have higher crime rates than usual. Also, if the owner of the house or anyone who is living in the house is ever locked out this technology will remotely open the door through our commands. We think that having such opportunity through a simple idea is something to be proud of.

What we learned

Through this process we learned the basics of face recognition and we started exploring the world of home security.

What's next for Knock-knock

Next we are thinking to add the a sensor on the door so that it could tell us how far the person is from the front door. If the distance is in a certain range, our "knock knock" program will run automatically. This will save a lot of energy.

Share this project:
×

Updates

Mehmet Alp Aysan posted an update

We are thinking about adding a motion sensor so that the camera only opens up when a certain comes close enough to the door. This will save a lot of energy and will make our project much more efficient. We are also thinking of some more functions such as talking to the people on the door or a service for delivered items.

Log in or sign up for Devpost to join the conversation.

Mehmet Alp Aysan posted an update

We built the face recognition technology using Microsofts Face API. This API included features such as recognizing faces and generating ids. Previously generated id's were used to compare with the current face id's to see the similarities.

We built camera functions such as taking a screen shot using open CV. This allowed us to use Microsoft's face API any time we wanted it.

We built the text messaging base using Twilio API. MMS send, SMS send and receive functions were used.

Log in or sign up for Devpost to join the conversation.