Inspiration
Potential future AI based defense systems
What it does
It takes the input commands from gestures to determine a target based on user input (We assumed that like monkeys the caveman too knows sign language and so can use signing to arm our sentry with his instructions).
How we built it
We started with a gesture based input system as a client that uses python sockets. Then manually collected data and trained a computer vision classifier model to tell the different dinos apart from each other. We used NVIDIA Jetson Orin Nano Super as a backend to run a client server and turret bringing all of the parts of the project together.
Challenges we ran into
Object classifier training crashing. Video streaming being sent reliably over sockets with many use during execution. Jetson Orin Nano gave us a lot of trouble with configuring pins and we had to use an Arduino Nano to move the camera & laser on the servo instead
Accomplishments that we're proud of
Getting every part of the intended product closely finished within the day that we spent building. We had very few but significant hiccups(refer to challenges we ran into).
What we learned
CV, sending video over sockets, training a dataset, using the jetson orin nano and flashing jetpack ISO for everything to work.
What's next for RockHeedMartin
Anti-Pterodactyl capabilities / swarm mecha dinos to counter dinosaur stampedes.
Log in or sign up for Devpost to join the conversation.