Inspiration

We have previously suffered from break ins the past. It was extremely complicated and expensive to setup a home surveillance system without extra help. Especially for our lovely grandparents, they have also suffered from break ins like this helpless on how to defend themselves. We wanted to build this solution to make sure we can protect our loved ones and those in need without the need for an expert.

What it does

It uses wifi signals from an esp32 to detect people in the vicinity, if the ai agent deems the person to be "suspsicious" it automatically flags it on the app and calls the necessary help (family or police) explaining the situation.

How we built it

We flashed the CSI communication firmware as a receiver into one esp32 and one as an emitter for another. We then decode the channel of the CSI from the esp32 from the rust server to a model that is able to label the needed CSI signals as a person. Then once it has done so and deemed the existence of a person, it sends this information to our frontend to display the person. Then we have an agent continuously running in the background of the current state of the people in the room, if it thinks it's suspicious it then uses elevenlabs to call the appropriate help.

Challenges we ran into

Flashing the esp32 was alot harder than we thought. Alot of problems with the esp32 like we ran into limitations of how well we can identify people with just the hardware we had.

Accomplishments that we're proud of

  • First time flashing esp32 firmware
  • Used Zed with their acp protocol for the first time and was great to debug rust code
  • Having the info streamed through websockets to the frontend with actual data from an esp32

What we learned

Even technically daunting tasks can be done in a short amount of time. We also learned to be laser focused on the problem instead of implementation, to make it a more coherent business idea.

What's next for Neblim

  • Add more esp32s to see how the final outcome would be
  • Contact internet providers if they would be willing to partner with us, right now we are using and esp32 as an emitter for PoC but in production that would be the wifi of our clients. To get the access to this we would need help from internet providers l,,

Built With

Share this project:

Updates