The RBG

Inspiration

We got in trouble. A couple weeks ago we had a noise complaint from our RA, so we decided to never have a noise complaint again.

What it does

Identifies certain scenarios and deals with them accordingly, scenarios such as having someone knock on the door or if the residents are too loud.

How we built it

We McGyvered a number of pieces and libraries together into a self contained system. Using an Arduino with a microphone plus a Raspberry PI with a camera. We used the Clarifai API to recognize if there was a person at the door.

Challenges we ran into

We had trouble figuring out how to measure these noises and visuals. Also how to reduce mic interference, how to identify who or what was at the door, how to take an image remotely, processing images, etc. We also had an android app and Pebble app that did not come to fruition.

Accomplishments that we're proud of

We were able to establish two-way connection between the Arduino and the Raspberry Pi, all of our API's are integrated correctly, and all of the Arduino outputs are wired correctly.

What we learned

Bluetooth integration is a lot more annoying than the android tutorial might suggest. There are a large number of factors to two-step Bluetooth integration between master and slave computers.

What's next for The RBG

Finishing the Android app to interface between different users and the app, being able to change who is on what whitelist and what notifications each person gets for what situations matched. Ideally this will also have a firewall built in to protect the numbers of the users, and that there would be different whitelists for different notifications.

Built With

Submitted to

HackUMass IV

Created by

I helped plan and design the mobile app; I focused most of my time on building the android app. It connects to the Rasberry Pi 3 via Bluetooth and would use a constant stream of inputs and outputs between the phone and the Rasberry Pi to communicate the different notifications to the user. It has a settings page where the use can control which notifications he/she may want and a volume page where the user can see the volume(decibel) in real time with sound controls. The code was done mostly in Java in the Android Studio IDE.

JJason121
I helped plan the build and began with working on the Pebble app. It was reliant on us also finishing a mobile app on Android so I moved elswhere in case it didn't finish. I spent most my time programming the Arduino. Getting the microphone to detect the correct noises. This was done in C C++. I also filmed the whole process.

Kirs Imsong
I focused mainly on hardware development. By integrating the sensors used in the Arduino IoT configuration, it allowed the device to be able to receive and transmit valuable data necessary to the project. This data included sound level information and media from the Pi Camera. I also helped to develop the housing and demonstration pieces. In addition, I contributed to the sourcing and specification of the parts required in order for the project to function.

Tim Zhang
Roy Jackman

Updates

JJason121 posted an update — Oct 09, 2016 06:33 AM EDT

I focused mainly on building the android app that would connect to the Rasberry Pi 3. The app has a bluetooth function which would allow a constant stream of inputs and outputs between the phone and the Rasberry Pi. However testing took more time than we planned, so the app was scratched so I could help out on the other aspects of this project.

Log in or sign up for Devpost to join the conversation.

Roy Jackman started this project — Oct 09, 2016 06:28 AM EDT

Leave feedback in the comments!

Log in or sign up for Devpost to join the conversation.