One of our teammates houses got robbed recently and we wanted to create an affordable surveillance system that would prevent and alert companies and families of suspicious individuals.
What it does
Using a camera module, any machine that can run python takes video input using opencv and sends it to our secure servers. The video input are decoded into frames and are analyzed using our face classification model built on top of tensor flow. We are able to differentiate between friendly faces and potential intruders using our implementation of the facenet algorithm that relies on the faces stored in the user's private database of employees/residents. Users are alerted via the ios app and can choose to take action from there. The ios app also keeps a secure log of employees that have entered the company and logs their hours and also triggers a security system if an unknown person is present.
How we built it
We used opencv to attain frames form the video input. We then sent these frames to the backend built on flask. Here we used the facenet algorithm to create 128 dimensional vector embeddings that represent each face. We then compared these embeddings using the suport vector machine algorithm to determine if the face is of an employee/resident or an intruder. This was then transmitted to the ios app which would display logs of employees/residents entering the location and also alerts of intruders entering the building. The alerts give the user an opportunity to call the cops, or disable the security alarm.
Challenges we ran into
We had some issues increasing the speed at which faces were detected at and also the video transmissions due to the internet speeds and processing limitations
Accomplishments that we're proud of
Managing to get this thing to work despite all the bugs and hurdles we ran into
What's next for Spectre
We want to improve the facial recognition algorithm and also expand to more IoT devices to make this service more accessible and portable for everyone. We also plan to connect it to a criminal database so that if wanted felons are detected by the camera, officials can be alerted immediately