Inspiration
- Desire to learn more about machine learning outside the classroom
- Goal of making an AR mobile application
- Fallout 3
- Noodle Talks!
- Rage Against the Machine
What it does
- You awaken as a corrupted cyborg with a craving to corrupt other machines
- Use your phone to detect 'corruptible' machines with computer vision techniques
- Play a 'hacking' minigame heavily based on Fallout 3 to successfully 'corrupt' them
- Successfully 'corrupting' the machine allows you to detect a person and declare war against humanity
- Unsuccessfully 'corrupting' the machines prompts you to play again, as you should! (We don't give up here!)
- In the end, your developer confronts you, and you become factory reset as you face the consequences of your code
How I built it
Gamified Object Detection
- Used Flask to create an API to communicate between Python in Google Colab and C# in Unity
- Used YOLOv5 to detect corruptible devices (phones and laptops)
Dynamic Puzzle Solving -Heavily referenced Fallout 3 -Used python to scrape data from varying sources containing CMU information -Populated scriptable objects for each string of size x[2,8] -Pseudo-randomly selected words from the data set on each turn to encourage replay-ability
Immersive Storytelling -Combines traditional mobile gaming through the hacking terminal and AR technologies through real world interaction with devices to immerse players -Responsive animations and sound effects guide players through gameplay -Compelling narration entices players to crave a larger story
Challenges I ran into
- APIs
- Bugs arising from Unity components versus code
- github merge conflicts
Accomplishments that I'm proud of
- We have successfully implemented a model prototype of our vision!
- Overcame fear of delving into APIs
- Significant improvement in video game development; comparison of relying on tutorials to make simple mini games versus being able to mimic and improve on popular video games of today!
What I learned
- API things
- Never give up!
- It's ok to not sleep sometimes :(
What's next for Rage Against the Humans
- Improve accuracy of object detection by fine tuning or training new data sets
- Fully randomized hacking rounds; instead of using a template and pseudo-random algorithms
- More variation in hacking mini games
- Longer gameplay
- VFX for player immersion
- Sound implementation
Log in or sign up for Devpost to join the conversation.