AI Powered Hot Car Death Prevention

This setup includes an AI based IOT edge device that can detect and notify people when an infant is left in a hot car.

Comment 27

Inspiration

Every year on average 38 infants die from being left in the car. I can’t even imagine what goes through the family after an incident like this happens. In an age of AI and smart connected devices these type of deaths need to be prevented.

Having an edge device run the CV modules is cost effective because device is not sending images for processing to the cloud and also addresses any privacy concerns.

As a parent of a 2 year old I feel devastated when I see news like this and I wanted to propose a solution that prevents this.

What it does

Solution used Azure Custom Vision model that has been trained to run on Azure IOT Edge runtime. This device predicts the presence of a child in a car and continuously monitors the temperature to provide Realtime alerts and phone calls to designated numbers. Also provides exact street address and vehicle details.

How I built it

I used the following components to build this solution.

  1. Configured Raspberry Pi to run Debian Buster and installed Azure IOT edge Runtime on it.
  2. Using the custom vision demo model for running AI module on edge devices as reference I created a new custom model by tagging child in a car seat for prediction.
  3. Configured the temperature simulator module and deployed it to Azure IOT hub.
  4. Azure IOT hub as a response to the IOT device messages is setup to trigger a function to call the Twilio API for making emergency calls and send messages with Car Details and location.

Challenges I ran into

  1. I ran into lot of issues with GPRS / GPS raspberry had to get internet capability to the raspberry PI.
  2. I had issue with debugging the custom vision module deployed on edge device using IOT edge run time in visual studio.

Accomplishments that I'm proud of

  1. I came to know about this Hackathon 3 weeks before the deadline, inspite of my schedule I still managed to build a working solution.
  2. I am proud of the idea itself.

What I learned

Things I learned are,

  1. Azure IOT Hub service
  2. Docker Containers
  3. Azure Custom Vision module creation and debugging the exported files.
  4. Creating and debugging Azure Functions from Visual Studio Code.
  5. Tillio API.

What's next for Intelligent Infant Hot Car Death Prevention

  1. Using streaming hub to consolidate the logs received from CV module and Temperature module.
  2. Build custom hardware that is packaged into a small form factor with built in LTE capability.
  3. Create a mobile app so that users can update emergency information and other configuration details.
+ 37 more
Share this project:

Updates