Early prototype of setting up the camera
Early prototype of Behaviors Setting
Early prototype Key Binding
"Business" Affairs Logo

"Business" Affairs

Group:/HackRealm
Members: Sai Coumar, Daniel Trager, Albert Lua, Jason Leong
Category: Funniest Hack, Best UI, Security Hack, AI Hack

Inspiration For "Business" Affairs

The inspiration was for when your parents barge in on your privacy, despite having the door closed.

What Does It Do

The application will use the user's webcam to detect if there are any intruders in the room. If there are, it will execute a custom routine of scripts that can minimize your windows, mute your computer, and/or turn off your monitors to protect your privacy.

How We Created It

We use the Tensorflow object detection API to count the number of people in the webcam feed. We built out front end with pywebview javascript API, which allows for a HTML/CSS/Javascript UI that can execute functions in python. We use this feature to set custom keybinds and settings for powershell/apple scripts scripts that can minimize your windows, mute your computer, and/or turn off your monitors.

Challenges We Ran Into

One issue was threading, Listening for keybinds constantly while running an infinite object detection loop was difficult, but we managed it by trying different modules in python. We also struggled to implement a flask server because it needed to share data with the machine learning code, but only one of them could run in the main function at a time. This made sharing memory very difficult, even with multiprocessing. Using the pywebview javascript API resolved this issue because it does not require a separate server thread.

Accomplishments That We Are Proud Of

Linking our object detection code to the user options in the front-end, making a way to set custom key binds and constantly check for them, and making a practical and aesthetically pleasing user interface.

What We Learned

We learned to use process data from the tensor flow object detection API, how to execute powershell/ apple scripts within python, and use the pywebview API to link javascript interactiveness with python features.