Inspiration
How to make gaming more accessible to people with disabilities. Traditional gaming controllers can be difficult or impossible to use for people with certain disabilities. By using hand gestures as a control method, we can make gaming more accessible to everyone.
What it does
StreetBoaxer is a video game that uses computer vision to track hand gestures and allow players to control the game without using a traditional controller. This makes the game more accessible to people with disabilities, as well as to people who simply prefer to control games with their hands.
How we built it
We used the MediaPipe library to track hand landmarks in real time. We then used these landmarks to detect punches and other movements, and to control the character in the game.
Challenges we ran into
Media pipe: necessary for landmark tracking used to detect punches and movement. It was hard to set up initially, and even harder to teach it how to “learn” punches. Object Collision: making sure the characters follow the basic game logic like don't faze through each other, or count hits while being 10 meters apart and so on. But with object collisions we would use the game properly with players. Dealing with coordinates: Health value management: Sprite: Managing smoother animations between pictures and we weren't able to fix that.
Accomplishments that we're proud of
We're proud of the fact that we were able to create a working game that uses computer vision to control the characters. We're also proud of the fact that our game is more accessible to people with disabilities.
What we learned
We learned a lot about computer vision and machine learning in the process of developing StreetBoxer. We also learned a lot about game development and how to create accessible games.
What's next for StreetBoxer?
-adding socket.io to make it real-time. Where players can connect and play online. -improved gesture tracking -Adding more games with support of body gestures to help the community.
Contributors -Soham Nawthale -Muhammad Hassan -Tanjim Redwan -Thaison
Log in or sign up for Devpost to join the conversation.