Inspiration
We decided to build this project because we wanted to implement machine-learning into a simple game about the COMS mascot and we decided to have our hand be used to protect little ducklings.
What is it?
We made a 2D Arcade styled side scroller, where your objective is to protect your little ducklings from the multitude of dangers in nature. You play as the mama duck, where with a hand tracer built upon machine learning, you interact with the ducklings and the environment.
How we built it
- Website hosted/run using node.js
- Open source Machine-learning gave us the hand webtracking.
- Codex helped elevate our plans
Challenges we ran into
Training the machine-learning hand movements to actually correctly guess our movements was extremely difficult and required hours of refining. Also, Quality control over AI systems are extremely tough, so we had to sit down and develop a much better plan of outline for our game
Accomplishments that we're proud of
- We managed to make the hand correctly work inside of the app and it is able to track your hand correctly and you are able to actually move the ducks.
- Gameplay is actually playable
What we learned
Machine-learning is extremely powerful and can be used to make such cool new things! integrating it into this game was a huge amount of fun!
AI Use
Throughout this project we utilized Codex and Claude to aid with the development process
