S3 bucket family photos, stranger photo and Deeplens MAC address file
Rekognition collection and faces
Cisco CMX detects deeplens location on the map
Email notification of stranger's location and picture
The motion notification from normal security camera such as Samsung is annoying. I don't want a notification when my pet or kids move around the house. I only want an alarm notification when a stranger come to my house, and I want to see the face of the stranger immediately without playback the video recording.
In some scenario, stranger intrusion notification in real-time is not good enough. For example, the security guard needs the accurate location of the stranger to take immediate actions. Therefore the notification should have stranger's location information.
What it does
In this project, we send realtime SMS/email notification of stranger's location and photo using Deeplens and Cisco CMX WiFi location service (https://www.cisco.com/c/en/us/solutions/enterprise-networks/connected-mobile-experiences/index.html)
How we built it
Below are the working flow we build the system:
- Build lambda function to detect face object, send face image and Deeplens MAC address to S3
- Deploy above lambda function and face detection model to Deeplens
- Build lambda function to call Rekognition API to compare detected face with faces in collection named "family", check if it's a known face in the collection or not. If an unknown stranger face detected, publish message to SNS topic, which trigger an email notification. Setup this lambda function trigger by S3 new image upload event
- Setup SNS topic for email message notification
- To obtain location information of stranger, we imported testing map and location hierarchy into CMX account, placed APs in the map in CMX cloud service (https://location-test.cmxdemo.com/tm). In the meanwhile, we enhance lambda function in 3, to read MAC address from S3 file, and call CMX client API with MAC address as query parameter to obtain Deeplens device location
Challenges we ran into
Deeplens device OS is not stable. Software automatically upgrade and it introduced regression on the device. Sync with AWS Deeplens support team. Eddie and the team helped solve the issue with support overnight. Finally I'm able to test out the project on the device. Appreciate the professional online support from AWS team!
Accomplishments that we're proud of
It's unbelievable we were able to accomplish a deep learning project within a couple of weeks! With limited knowledge of deep learning, we were able to achieve using it to solve the real life problem in such a short time. Moreover, we were inspired by the Deeplens, and we came up with many interesting ideas when we brainstormed in the beginning.
Even my 11 year old daughter showed interests in Deeplens. She came up with ideas such as using Deeplens to detect an elderly person's fall off the bed or in coma state on the floor (We are planning to achieve this idea in the next creation project). I'm so proud she presented Deeplens and the idea to her middle school science class. It attracts a lot of attentions and questions from her fellow middle schoolers.
What we learned
Deeplens and AWS AI ecosystem are very powerful to build solutions to help human better life. Amazon is on the right path of leading the industry to achieve the AI evolution. We are inspired and we are glad to have the opportunity of experiencing such an amazing product.
What's next for myCreation
Actually, the use case we solved in this project can be generalized as below: an intelligent system to detect the event, capture the image of the event, send real-time notification with accurate location for immediate response.
The next of our creation, we want to build a system to help seniors living alone. We want to use Sagemaker to train a deep learning model to detect person fall on the floor event and deploy this model to Deeplens -- to automatically detect elder person fall on floor or in coma state, and send real-time notification with accurate location of the fall event to urgent care team or relatives for fast reaction of rescue or assistant.