Twist Twist Revolution

• 

• 

  Game interface

• 

  Hand detection

Inspiration

One of my favourite games is osu!mania. I have over 550 hours in this rhythm game and am currently rank 1 in Canada! For this hackathon, I wanted to try creating something new: a game, and the first thing that came to mind was a rhythm game. However, I didn't want to make it just another typical one, so I thought of incorporating computer vision in order to create a unique experience in the realm of rhythm games. I was also inspired by Dance Dance Revolution's style, including the large involvement of movement.

What it does

Twist Twist Revolution is a rhythm game where there are arrows moving up, down, left, or right, and you must hit the respective arrows in a precise timeframe by moving your hand into the locations of the receptors in your webcam. Based on the preciseness of the timing, your score increases or decreases by a certain amount which determines the quality of the play. You also have HP that will cause you to fail if it reaches zero.

How we built it

It is built entirely with Python, using Pygame, OpenCV, and MediaPipe to create the game.

Challenges we ran into

It was my first time working solo in a hackathon, so the workload was heavier than usual. This was also my first time using Python so I ran into many unfamiliar issues.

Accomplishments that we're proud of

Doing a solo project for the first time. Creating a game for the first time. Finally getting around to learning and using Python.

What we learned

I learned how to code in Python, how to build a game with Pygame, and basics of hand gesture tracking with OpenCV and MediaPipe.

What's next for Twist Twist Revolution

Making the motion tracking functional to the game, adding songs/maps to the game, optimizing the judgement times, and designing a menu, a pause screen, an options page, and other features that can be incorporated.

Built With

• mediapipe
• opencv
• pygame
• python