Inspiration
I really enjoy the cyberpunk aesthetic, and realized that Arduino's challenge would be a great chance to explore some new technologies as well as have some fun dressing to play the part.
What it does
Jetson Nano The project uses a jetson nano to handle all of it's ML and video streaming capabilities. The project has 2 main portions, the c920 and a thermal camera in the form of adafruit mlx90640. The feed from the thermal camera and the C920 are both fed into a small LCD where S&R workers can take a look at key points in their surroundings. The LEDs strapped to the jacket are more for visual flare!
Quiz Website We made a quiz focusing on environmental protection so that people are aware of the environmental crisis.
Challenges we ran into
Hardware This hackathon was a first for me in working with sensors more specifically the thermal camera, which is an i2c. i2c's are essentially small controllers that use a communication protocol used by low-speed devices. Finding the right libraries to communicate with the sensor was quite difficult, as well as visualizing the data received. This was also my first hackathon doing anything with Machine Learning, so it was interesting to use pre-trained models and how the NVIDIA jetson platform handles things, so this time around I wasn't able to train some models, but I definitely plan on trying to in the future. The reason I was unable to add a 2D-heatmap was due to Jupyter Notebook having issues with installation.
Website Since we have no prior experience in react, we needed to learn while we code. The syntax and process were so new to me, and took me so long to complete simple tasks. Fortunately, I got so many help from grateful TreeHacks mentors and could finish the project.
Accomplishments that we're proud of
Hardware Being able to interface with the i2c at all was rather nice, especially since I had to pour through a lot of documentation in order to translate Raspberry Pi instructions to the Nano. Setting up the Nano to work with NVIDIAs "Hello AI World" was also quite enjoyable.
Website We made a quiz focusing on environmental protection so that people are aware of the environmental crisis. We used react, chakra-ui, we never used these before, so we learn while we code. The whole process of making something scratch was hard, but It was fun and so much learning at the same time. And seeing it come to life from 0 was good.
What we learned
Hardware I got to experience the world of micro-controllers a little more, as well as get an introduction into the world of using ML models. I also learned just how far you can push a small pc that is specialized to do interesting things. I really couldn't have asked for a better intro experience to the exciting world of electronics and AI!
Website We used react, chakra-ui, we never used these before, so we learn while we code. The whole process of making something scratch was hard, but It was fun and so much learning at the same time.
Built With
- arduino
- c920
- chakra-ui
- i2c
- javascript
- jetson-nano
- mlx90640
- node.js
- npm
- object-detection
- python
- react
- tensorrt
- thermal-camera
Log in or sign up for Devpost to join the conversation.